-- Logs begin at Tue 2022-08-23 02:46:54 UTC, end at Tue 2022-08-23 04:40:15 UTC. -- Aug 23 04:04:09.298084 dv-cinder-854070-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 23 04:04:09.305241 dv-cinder-854070-1-smb devstack@keystone.service[82344]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 23 04:04:09.307237 dv-cinder-854070-1-smb devstack@keystone.service[82344]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 23 04:04:09 2022] *** Aug 23 04:04:09.307237 dv-cinder-854070-1-smb devstack@keystone.service[82344]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 04:04:09.307237 dv-cinder-854070-1-smb devstack@keystone.service[82344]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 04:04:09.307237 dv-cinder-854070-1-smb devstack@keystone.service[82344]: nodename: dv-cinder-854070-1-smb Aug 23 04:04:09.307237 dv-cinder-854070-1-smb devstack@keystone.service[82344]: machine: x86_64 Aug 23 04:04:09.307237 dv-cinder-854070-1-smb devstack@keystone.service[82344]: clock source: unix Aug 23 04:04:09.307237 dv-cinder-854070-1-smb devstack@keystone.service[82344]: pcre jit disabled Aug 23 04:04:09.307696 dv-cinder-854070-1-smb devstack@keystone.service[82344]: detected number of CPU cores: 4 Aug 23 04:04:09.307696 dv-cinder-854070-1-smb devstack@keystone.service[82344]: current working directory: / Aug 23 04:04:09.307696 dv-cinder-854070-1-smb devstack@keystone.service[82344]: detected binary path: /usr/bin/uwsgi-core Aug 23 04:04:09.307696 dv-cinder-854070-1-smb devstack@keystone.service[82344]: your processes number limit is 47680 Aug 23 04:04:09.307696 dv-cinder-854070-1-smb devstack@keystone.service[82344]: your memory page size is 4096 bytes Aug 23 04:04:09.307696 dv-cinder-854070-1-smb devstack@keystone.service[82344]: detected max file descriptor number: 2048 Aug 23 04:04:09.307696 dv-cinder-854070-1-smb devstack@keystone.service[82344]: lock engine: pthread robust mutexes Aug 23 04:04:09.307696 dv-cinder-854070-1-smb devstack@keystone.service[82344]: thunder lock: enabled Aug 23 04:04:09.307696 dv-cinder-854070-1-smb devstack@keystone.service[82344]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 23 04:04:09.307696 dv-cinder-854070-1-smb devstack@keystone.service[82344]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 23 04:04:09.350294 dv-cinder-854070-1-smb devstack@keystone.service[82344]: Python main interpreter initialized at 0x55bbb4e6f9c0 Aug 23 04:04:09.350294 dv-cinder-854070-1-smb devstack@keystone.service[82344]: python threads support enabled Aug 23 04:04:09.350294 dv-cinder-854070-1-smb devstack@keystone.service[82344]: your server socket listen backlog is limited to 100 connections Aug 23 04:04:09.350294 dv-cinder-854070-1-smb devstack@keystone.service[82344]: your mercy for graceful operations on workers is 90 seconds Aug 23 04:04:09.350671 dv-cinder-854070-1-smb devstack@keystone.service[82344]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 04:04:09.350742 dv-cinder-854070-1-smb devstack@keystone.service[82344]: *** Operational MODE: preforking *** Aug 23 04:04:09.351021 dv-cinder-854070-1-smb devstack@keystone.service[82344]: *** uWSGI is running in multiple interpreter mode *** Aug 23 04:04:09.351021 dv-cinder-854070-1-smb devstack@keystone.service[82344]: spawned uWSGI master process (pid: 82344) Aug 23 04:04:09.351238 dv-cinder-854070-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 23 04:04:09.357215 dv-cinder-854070-1-smb devstack@keystone.service[82344]: spawned uWSGI worker 1 (pid: 82354, cores: 1) Aug 23 04:04:09.357215 dv-cinder-854070-1-smb devstack@keystone.service[82344]: spawned uWSGI worker 2 (pid: 82355, cores: 1) Aug 23 04:04:09.357215 dv-cinder-854070-1-smb devstack@keystone.service[82344]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 04:04:13.648694 dv-cinder-854070-1-smb devstack@keystone.service[82355]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 04:04:13.648694 dv-cinder-854070-1-smb devstack@keystone.service[82355]: from cryptography.utils import int_from_bytes Aug 23 04:04:13.649545 dv-cinder-854070-1-smb devstack@keystone.service[82355]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 04:04:13.649545 dv-cinder-854070-1-smb devstack@keystone.service[82355]: from cryptography.utils import int_from_bytes Aug 23 04:04:13.650627 dv-cinder-854070-1-smb devstack@keystone.service[82354]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 04:04:13.650627 dv-cinder-854070-1-smb devstack@keystone.service[82354]: from cryptography.utils import int_from_bytes Aug 23 04:04:13.651084 dv-cinder-854070-1-smb devstack@keystone.service[82354]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 04:04:13.651084 dv-cinder-854070-1-smb devstack@keystone.service[82354]: from cryptography.utils import int_from_bytes Aug 23 04:04:13.701430 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 04:04:13.701625 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 04:04:13.701713 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 04:04:13.701814 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] command line args: [] {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 04:04:13.701899 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 04:04:13.702076 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 04:04:13.702165 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] command line args: [] {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 04:04:13.702244 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ================================================================================ {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 04:04:13.702351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 04:04:13.702497 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] admin_token = **** {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.702588 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ================================================================================ {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 04:04:13.702743 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] config_dir = [] {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.702834 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] admin_token = **** {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.702935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.703022 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] config_dir = [] {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.703101 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] config_source = [] {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.703185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.703286 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] debug = True {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.703372 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] config_source = [] {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.703484 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.703772 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] debug = True {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.703772 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.704013 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.704121 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.704226 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.704322 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.704429 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.704534 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.704637 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.704741 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.704839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] list_limit = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.704950 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] list_limit = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.705058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] log_config_append = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.705199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] log_config_append = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.705300 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.705410 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.705527 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] log_dir = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.705625 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] log_dir = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.705731 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] log_file = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.705840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] log_file = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.705948 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.706051 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.706130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.706209 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.706291 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.706365 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.706436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.706516 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.706623 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.706712 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.706787 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.706866 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.706944 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.707022 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.707135 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.707267 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.707348 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.707506 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.707612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.707744 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.707834 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.707981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.708066 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.708218 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.708304 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.708469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.708559 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.708724 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.708809 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.709004 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.709259 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.711816 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] publish_errors = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.711909 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.711985 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.712069 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] publish_errors = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.712144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.712216 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.712293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.712371 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.712444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.712568 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.712664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.712738 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.712810 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] standard_threads = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.712887 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.712968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.713047 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] standard_threads = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.713166 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.713249 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.713322 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.713400 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.713481 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] use_journal = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.713561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.713634 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] use_json = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.713707 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] use_journal = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.713785 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] use_stderr = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.713863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] use_json = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.713947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] use_syslog = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.714026 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] use_stderr = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.714104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.714184 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] use_syslog = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.714257 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.714329 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 04:04:13.714411 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.714485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.714557 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.714628 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.714700 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.714850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.714946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.715633 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.715713 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.715785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.715863 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.715944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.716023 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.716096 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.716173 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.716246 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.716355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.716451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.716580 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.716658 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.716730 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.716842 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.716923 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.717004 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.717107 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.717185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.717273 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.717349 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.717427 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.717508 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.717583 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.717655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.717733 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.717811 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.717891 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.717972 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.718046 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.718118 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.718189 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.718260 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.718332 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.718412 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.718486 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.718563 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.718657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.718741 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.718839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.718954 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.719032 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.719103 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.719175 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.719298 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.719382 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.719534 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.719611 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.719708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.719812 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.719952 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.720079 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.720205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.720297 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.720458 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.720547 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.720693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.720773 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.720929 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.721017 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.721203 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.721286 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.721454 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.721548 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.721691 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.721907 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.721994 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.722057 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.722157 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.722249 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.722390 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.722470 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.722624 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.722705 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.722858 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.722946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.723086 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.723165 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.723319 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.723399 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.723554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.723649 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.723807 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.723887 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.724022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.724104 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.724252 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.724349 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.724488 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.724567 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.724725 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.724800 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.724963 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.725059 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.725236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.725375 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.725493 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.725574 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.725705 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.725786 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.725910 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.725994 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.726147 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.726231 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.726383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.726461 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.726657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.726751 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.726850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.726960 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.727123 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.727206 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.727328 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.727410 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.727530 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.727621 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.727778 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.727859 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.728015 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.728100 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.728249 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.728344 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.728486 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.728567 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.728723 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.728812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.728962 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.729041 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.729240 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.729322 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.729491 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.729629 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.729737 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.729819 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.729977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.730120 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.730219 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.730308 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.730458 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.730550 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.730724 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.730850 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.730965 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.731220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.731301 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.731485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.731691 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.731772 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.731975 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.732067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.732219 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.732424 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.732510 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.732686 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.732800 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.732927 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.733190 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.733275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.733477 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.735919 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.736051 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.736139 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.736139 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.736289 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.736363 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.736436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.736508 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.736580 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.736661 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.736735 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.736808 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.736880 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.736952 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.737024 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.737147 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.737226 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.737300 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.737372 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.737445 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.737518 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.737608 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.737684 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.737757 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.737830 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.737903 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.737982 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.738064 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.738139 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.738212 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.738290 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.738290 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.738422 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.738502 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.738577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.738649 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.738722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.738794 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.738883 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.739000 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.739078 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] auth.external = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.739205 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.739284 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.739357 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] auth.external = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.739430 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.739512 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.739613 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.739704 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.739786 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] auth.password = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.739861 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.739934 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] auth.token = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.740007 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] auth.password = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.740080 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.740214 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] auth.token = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.740295 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.740369 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.740496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.740582 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.740714 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.740794 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.740874 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.740955 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.741029 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.741136 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.741227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.741305 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.741379 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] credential.caching = True {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.741453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.741526 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.741616 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] credential.caching = True {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.741762 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.741850 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.742057 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.742145 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.742305 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.742393 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.742543 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.742624 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.742785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.742864 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.743020 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.743101 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.743277 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.743359 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.743520 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.743600 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.743761 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.743840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.744017 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.744099 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.744293 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.744373 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.744539 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.744619 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.744796 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.744892 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.745045 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.745166 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.745360 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.745464 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] federation.caching = True {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.745618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] federation.caching = True {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.745703 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.745779 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.745854 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.746028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.746110 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.746302 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.746388 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.746535 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.746616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.746784 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.746865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.747019 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.747102 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.747274 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.747354 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.747510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.747591 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.747767 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.747849 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.748005 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.748086 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.748254 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.748342 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] identity.caching = True {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.748492 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] identity.caching = True {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.748574 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.748741 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.748823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.748982 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.749062 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.749243 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.749331 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.749482 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.749563 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.749732 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.749815 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.749998 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.750090 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.750189 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.750268 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.750438 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.750527 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.750678 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.750758 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.750911 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.750996 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.751135 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.751228 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.751361 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.751443 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.751608 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.751689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.751856 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.751945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.752102 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.752184 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.752351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.752431 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.752598 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.752693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.752857 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.752940 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.753151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.753273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.753386 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.753500 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.753579 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.753652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.753804 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.753887 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.754036 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.754125 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.754274 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.754355 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.754517 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.754597 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.754762 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.754850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.754995 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.755076 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.755233 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.755312 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.755482 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.755571 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.755721 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.755842 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.755956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.756069 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.756207 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.756334 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.756429 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.756509 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.756668 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.756751 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.756902 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.756993 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.757153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.757240 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.757396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.757479 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.757635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.757774 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.758009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.758091 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.758252 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.758333 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.758492 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.758582 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.758744 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.758874 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.759000 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.759085 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.759220 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.759311 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.759451 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.759533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.759702 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.759784 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.759953 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.760047 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.760192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.760318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.760431 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.760512 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.760669 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.760762 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.user = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.760903 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.user = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.760983 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.761178 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.761263 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.761417 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.761510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.761668 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.761749 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.762503 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.762601 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.762677 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.762762 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.762921 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.763004 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.763154 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.763241 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.763384 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.763473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.763621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.763703 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.763858 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.763939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.764089 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.764171 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.764318 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.764398 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.764566 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.764652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.764813 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.764903 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.765060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.765158 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.765337 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.765428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.765569 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.765652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.765805 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.765885 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.766049 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.766129 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.766286 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.766368 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.766522 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.766603 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.766756 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.766835 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.766991 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.767074 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.767236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.767318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.767475 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.767556 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.767710 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.767791 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.767956 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.768036 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.768186 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.768277 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.768435 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.768523 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.768672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.768754 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.768910 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.768992 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.769170 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.769253 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.769411 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.769494 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.769650 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.769730 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.769880 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.769962 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.770119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.770200 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] resource.caching = True {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.770364 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] resource.caching = True {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.770453 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.770615 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.770697 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.770857 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.770939 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.771093 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.771173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.771345 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.771427 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.771584 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.771665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.771823 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.771904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.772063 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.772145 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.772300 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.772384 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.772538 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] role.caching = True {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.772618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.772774 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] role.caching = True {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.772855 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] role.driver = sql {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.773015 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.773117 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] role.driver = sql {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.773269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.773355 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.773521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.773604 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.773769 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.773857 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.774019 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.774108 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.774267 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.774435 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.774519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.774594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.774751 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.774833 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.775001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.775083 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.775236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.775317 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.775473 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.775560 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.775721 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.775803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.775970 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.776053 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.776218 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.776308 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.776466 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.776626 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.776868 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.776948 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.777126 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.780555 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.780695 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.780784 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.780784 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.780920 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.780994 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.781076 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.781171 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.781257 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.781333 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.781407 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.781480 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.781562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.781638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.781712 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.781791 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.781866 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.781939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.782021 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.782096 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.782176 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.782251 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.782325 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.782400 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.782480 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.782480 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.782615 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.782689 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.782763 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.782836 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.782917 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.782993 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.783066 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.783139 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.783216 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] token.caching = True {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.783297 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] token.caching = True {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.783372 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.783445 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.783518 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.783591 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.783665 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.783745 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.783820 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.783894 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.783967 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.784040 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.784112 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.784193 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.784275 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.784350 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.784423 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.784496 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.784569 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.784650 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.784760 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.784824 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.784897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.784970 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.785043 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.785162 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.785241 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.785315 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.785389 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.785463 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.785537 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.785618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.785694 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.785767 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.785872 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.786003 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.786140 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] database.connection = **** {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.786268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] database.connection = **** {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.786390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.786516 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.786642 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.786766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.786885 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.787006 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.787131 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.787250 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.787371 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.787488 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.787599 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.787727 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.787907 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.787989 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.788151 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.788234 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.788418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.788543 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.788641 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.788723 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.788875 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.788952 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.789132 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.789218 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.789387 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.789468 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.789626 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.789710 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.789869 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.789950 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.790101 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.790182 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.790342 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.790423 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.790577 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.790662 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 04:04:13.790838 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 04:04:13.790925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 04:04:13.819928 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:13.820159 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:13.820350 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:13.820437 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:13.820586 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:13.820817 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:13.829340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:13.829852 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:13.857878 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:13.858084 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:13.858199 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:13.858322 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:13.911875 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:13.915059 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:13.961113 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:13.961362 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:13.961524 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:13.961764 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.117366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.117600 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.117761 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.117851 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.117931 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.118036 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.118122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.118256 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.118341 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.118473 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.118558 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.118719 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.142340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.142570 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.142664 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.142792 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.142880 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.143011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.143109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.143227 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.143312 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.143440 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.143525 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.143653 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.143784 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.143868 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.155046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.155291 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.167827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.168199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.168470 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.168558 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.168711 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.168796 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.168937 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.169023 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.169187 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.169274 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.169407 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.169506 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.169622 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.169834 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 04:04:14.186782 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.186992 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 04:04:14.187302 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.187390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.187515 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 04:04:14.187600 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 04:04:14.187787 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.187870 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.188043 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 04:04:14.188128 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.188319 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.188558 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.188641 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.188822 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.189115 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.189377 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.198148 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.198430 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.198665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.198763 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.198949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.199034 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.199222 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.200071 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.206528 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.207050 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.209421 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.209710 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.209963 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.210060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.210251 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.210336 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.210532 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.210615 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.210792 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.210886 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.211061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.211144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.211334 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.211417 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.211604 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.211715 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.211880 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.211992 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.212263 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.212353 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.212540 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.212812 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.235165 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.235714 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.236617 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.236904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.237197 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.237487 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.241578 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.241866 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.242133 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.242219 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.242421 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.242708 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.248987 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.249296 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.249626 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.249921 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.253420 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.253714 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.253978 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.254076 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.254263 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.254347 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.254537 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.254622 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.254811 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.254904 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.255084 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.255168 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.255351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.255443 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.255624 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.255895 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.272153 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.272434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.272847 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.273152 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.276278 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.276985 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.279498 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.279802 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.280243 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.280546 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.283990 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.284719 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.287124 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.287848 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.290362 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.290664 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.290950 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.291072 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.291236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.291364 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.291519 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.291655 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.291813 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.291946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.292228 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.292520 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.308064 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.308365 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.309524 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.309652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.309797 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.309944 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.310214 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.310486 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.316680 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.317390 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.318232 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.318509 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.318891 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.319173 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.321128 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.321418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.321710 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.321820 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.322000 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.322109 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.322275 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.322403 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.322693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.322971 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.333507 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.333792 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.334073 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.334355 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.334452 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.334638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.334724 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.334916 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.335001 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.335193 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.335279 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.335507 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.335788 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.336069 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.350479 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.351302 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.353495 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.354339 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.356878 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.357731 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.358323 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.359156 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.359769 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.360062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.360353 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.360612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.360903 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.361226 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.366728 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.367631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.368177 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.369071 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.371065 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.371922 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.372207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.372490 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.372587 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.372829 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.373144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.373444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.380355 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.380650 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.380932 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.381338 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.381633 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.381918 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.387768 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.388055 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.388343 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.388623 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.388789 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 04:04:14.388886 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.389076 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.389183 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.389384 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.389479 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.389664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.389760 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.389940 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.390028 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.390223 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.390313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.390508 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.390592 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.390772 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.390855 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.391051 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.391143 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.391313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.391396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.391593 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.391855 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.392144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.392406 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 04:04:14.425586 dv-cinder-854070-1-smb devstack@keystone.service[82355]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bbb4e6f9c0 pid: 82355 (default app) Aug 23 04:04:14.426338 dv-cinder-854070-1-smb devstack@keystone.service[82354]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bbb4e6f9c0 pid: 82354 (default app) Aug 23 04:04:14.428893 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766345b-805a-4eff-9a06-c7943823e32a None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:14.429206 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766345b-805a-4eff-9a06-c7943823e32a None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:14.429481 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766345b-805a-4eff-9a06-c7943823e32a None None] PATH_INFO: `/v3` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:14.434511 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Tue Aug 23 04:04:14 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:21.687716 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6e800-5f9a-4c8d-8f60-86d1ec03ff40 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:21.688228 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6e800-5f9a-4c8d-8f60-86d1ec03ff40 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:21.688308 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6e800-5f9a-4c8d-8f60-86d1ec03ff40 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:21.692585 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 04:04:21.699056 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b3238-94fa-4531-ad6d-246bc1bef5b8 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:21.699464 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b3238-94fa-4531-ad6d-246bc1bef5b8 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:21.699665 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b3238-94fa-4531-ad6d-246bc1bef5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:21.768890 dv-cinder-854070-1-smb devstack@keystone.service[82355]: INFO dbcounter [None req-d57b3238-94fa-4531-ad6d-246bc1bef5b8 None None] Registered counter for database keystone Aug 23 04:04:21.787662 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG oslo_db.sqlalchemy.engines [None req-d57b3238-94fa-4531-ad6d-246bc1bef5b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82355) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 04:04:21.793820 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writer thread running {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 04:04:21.973911 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG passlib.handlers.bcrypt [None req-d57b3238-94fa-4531-ad6d-246bc1bef5b8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=82355) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 23 04:04:21.974327 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG passlib.handlers.bcrypt [None req-d57b3238-94fa-4531-ad6d-246bc1bef5b8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82355) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 23 04:04:22.028603 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-d57b3238-94fa-4531-ad6d-246bc1bef5b8 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:22.030777 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-d57b3238-94fa-4531-ad6d-246bc1bef5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:22.157206 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 23 04:04:22.597110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6e800-5f9a-4c8d-8f60-86d1ec03ff40 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:22.664904 dv-cinder-854070-1-smb devstack@keystone.service[82354]: INFO dbcounter [None req-00f6e800-5f9a-4c8d-8f60-86d1ec03ff40 None None] Registered counter for database keystone Aug 23 04:04:22.686134 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG oslo_db.sqlalchemy.engines [None req-00f6e800-5f9a-4c8d-8f60-86d1ec03ff40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82354) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 04:04:22.692155 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writer thread running {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 04:04:22.810005 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6e800-5f9a-4c8d-8f60-86d1ec03ff40 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:22.814741 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd9cebe-d66e-40ee-9e76-0e9b51f841c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:22.815370 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9cebe-d66e-40ee-9e76-0e9b51f841c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:22.815650 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9cebe-d66e-40ee-9e76-0e9b51f841c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:22.815923 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9cebe-d66e-40ee-9e76-0e9b51f841c8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:22.823876 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd9cebe-d66e-40ee-9e76-0e9b51f841c8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:22.874686 dv-cinder-854070-1-smb devstack@keystone.service[82354]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0dd9cebe-d66e-40ee-9e76-0e9b51f841c8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 04:04:22.874972 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd9cebe-d66e-40ee-9e76-0e9b51f841c8 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:22.884476 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Aug 23 04:04:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 04:04:22.891106 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b3238-94fa-4531-ad6d-246bc1bef5b8 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:22.905265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b3238-94fa-4531-ad6d-246bc1bef5b8 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:22.909581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0691e9-867e-4e73-b461-79e333832697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:22.910677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0691e9-867e-4e73-b461-79e333832697 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:22.910985 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0691e9-867e-4e73-b461-79e333832697 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:22.911257 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0691e9-867e-4e73-b461-79e333832697 admin admin] PATH_INFO: `/v3/projects/cb9c03cfd85c4ddcb76ee846b01a3645` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:22.912811 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0691e9-867e-4e73-b461-79e333832697 admin admin] RBAC: Authorizing `identity:get_project(project_id=cb9c03cfd85c4ddcb76ee846b01a3645)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:22.965562 dv-cinder-854070-1-smb devstack@keystone.service[82355]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2e0691e9-867e-4e73-b461-79e333832697 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 04:04:22.965916 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0691e9-867e-4e73-b461-79e333832697 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:22.970541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Aug 23 04:04:22 2022] GET /identity/v3/projects/cb9c03cfd85c4ddcb76ee846b01a3645 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:24.810349 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d74b6-2931-4d02-8a04-a8a92adab5c2 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:24.810859 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d74b6-2931-4d02-8a04-a8a92adab5c2 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:24.810945 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d74b6-2931-4d02-8a04-a8a92adab5c2 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:24.815782 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:04:24.821182 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df2851-8fe8-4faa-bbd1-4c1d477eaed4 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:24.821569 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df2851-8fe8-4faa-bbd1-4c1d477eaed4 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:24.821743 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df2851-8fe8-4faa-bbd1-4c1d477eaed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:24.841134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-d7df2851-8fe8-4faa-bbd1-4c1d477eaed4 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:24.842666 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-d7df2851-8fe8-4faa-bbd1-4c1d477eaed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:24.850284 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 23 04:04:25.114201 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d74b6-2931-4d02-8a04-a8a92adab5c2 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:25.126085 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d74b6-2931-4d02-8a04-a8a92adab5c2 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:25.130286 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4958ad1-cc40-432e-86a0-d771e9ce0022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:25.130883 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4958ad1-cc40-432e-86a0-d771e9ce0022 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:25.131165 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4958ad1-cc40-432e-86a0-d771e9ce0022 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:25.131437 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4958ad1-cc40-432e-86a0-d771e9ce0022 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:25.139236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4958ad1-cc40-432e-86a0-d771e9ce0022 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:25.141010 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4958ad1-cc40-432e-86a0-d771e9ce0022 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:25.149529 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Aug 23 04:04:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 04:04:25.155318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df2851-8fe8-4faa-bbd1-4c1d477eaed4 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:25.164263 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df2851-8fe8-4faa-bbd1-4c1d477eaed4 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:25.168605 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383349af-bd00-4532-bf7b-e5624e51ae80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:25.169359 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383349af-bd00-4532-bf7b-e5624e51ae80 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:25.170139 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383349af-bd00-4532-bf7b-e5624e51ae80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:25.170416 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383349af-bd00-4532-bf7b-e5624e51ae80 admin admin] PATH_INFO: `/v3/users/54d7bb4b588246d59feaf1dfc8886cde` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:25.171731 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383349af-bd00-4532-bf7b-e5624e51ae80 admin admin] RBAC: Authorizing `identity:get_user(user_id=54d7bb4b588246d59feaf1dfc8886cde)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:25.173594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383349af-bd00-4532-bf7b-e5624e51ae80 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:25.175110 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Aug 23 04:04:25 2022] GET /identity/v3/users/54d7bb4b588246d59feaf1dfc8886cde => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:04:27.120480 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37ac34-202c-4fb7-8e52-ebdb310303f8 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:27.120982 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37ac34-202c-4fb7-8e52-ebdb310303f8 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:27.121054 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37ac34-202c-4fb7-8e52-ebdb310303f8 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:27.122432 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:04:27.127531 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b98a82-b900-406f-8dde-66570e1cfbd5 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:27.127899 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b98a82-b900-406f-8dde-66570e1cfbd5 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:27.128200 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b98a82-b900-406f-8dde-66570e1cfbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:27.146393 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-a4b98a82-b900-406f-8dde-66570e1cfbd5 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:27.147573 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-a4b98a82-b900-406f-8dde-66570e1cfbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:27.159269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be068e5d-5ae0-4185-b5f9-2a9921a8e9b2 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:27.159556 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be068e5d-5ae0-4185-b5f9-2a9921a8e9b2 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:27.159829 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be068e5d-5ae0-4185-b5f9-2a9921a8e9b2 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:27.161166 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 6/11] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 04:04:27.166184 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976e17d-9673-4f48-aaf1-a25a4a1e29ae None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:27.166463 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976e17d-9673-4f48-aaf1-a25a4a1e29ae None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:27.166736 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976e17d-9673-4f48-aaf1-a25a4a1e29ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:27.208580 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG passlib.handlers.bcrypt [None req-d976e17d-9673-4f48-aaf1-a25a4a1e29ae None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=82354) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 23 04:04:27.208918 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG passlib.handlers.bcrypt [None req-d976e17d-9673-4f48-aaf1-a25a4a1e29ae None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82354) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 23 04:04:27.228070 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:04:27.254294 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-d976e17d-9673-4f48-aaf1-a25a4a1e29ae None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:27.255869 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-d976e17d-9673-4f48-aaf1-a25a4a1e29ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:27.352937 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 04:04:27.492842 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b98a82-b900-406f-8dde-66570e1cfbd5 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:27.517278 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:27.596717 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b98a82-b900-406f-8dde-66570e1cfbd5 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:27.615459 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976e17d-9673-4f48-aaf1-a25a4a1e29ae None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:27.632192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f0002-5b33-4a5f-b74b-3b3ffd82d848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:27.632837 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f0002-5b33-4a5f-b74b-3b3ffd82d848 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:27.633149 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f0002-5b33-4a5f-b74b-3b3ffd82d848 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:27.633431 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f0002-5b33-4a5f-b74b-3b3ffd82d848 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:27.645682 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f0002-5b33-4a5f-b74b-3b3ffd82d848 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:04:27.654207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-8f8f0002-5b33-4a5f-b74b-3b3ffd82d848 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:04:27.654207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:04:27.654207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:04:27.654207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:04:27.654207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:04:27.654207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:04:27.654207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:04:27.654207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:04:27.654207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:04:27.654207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:04:27.654207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:04:27.654207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:04:27.654207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:04:27.654207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:04:27.654207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:04:27.654207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:04:27.655227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:04:27.655227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:04:27.655227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:04:27.655227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:04:27.655227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:04:27.655227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:04:27.655227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:04:27.655227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:04:27.655227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:04:27.655227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:04:27.655227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:04:27.655227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:04:27.655227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:04:27.655227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:04:27.655227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:04:27.655227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:04:27.656227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:04:27.656227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:04:27.656227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:04:27.656227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:04:27.656227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:04:27.656227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:04:27.656227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:04:27.656227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:04:27.656227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:04:27.656227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:04:27.656227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:04:27.656227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:04:27.656227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 7/14] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:04:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:04:27.662865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f0002-5b33-4a5f-b74b-3b3ffd82d848 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:27.721210 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976e17d-9673-4f48-aaf1-a25a4a1e29ae None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:27.723569 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:27.745007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:27.758977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0dc77e-1cb5-426e-b41f-09f175b6c7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:27.759835 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dc77e-1cb5-426e-b41f-09f175b6c7bd None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:27.760125 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dc77e-1cb5-426e-b41f-09f175b6c7bd None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:27.760403 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dc77e-1cb5-426e-b41f-09f175b6c7bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:27.762957 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f0002-5b33-4a5f-b74b-3b3ffd82d848 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:27.797308 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00a5ac-13ea-4b93-b890-c737df660783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:27.797925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00a5ac-13ea-4b93-b890-c737df660783 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:27.798207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00a5ac-13ea-4b93-b890-c737df660783 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:27.798479 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00a5ac-13ea-4b93-b890-c737df660783 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:27.799611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00a5ac-13ea-4b93-b890-c737df660783 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:27.799889 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00a5ac-13ea-4b93-b890-c737df660783 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:27.801652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00a5ac-13ea-4b93-b890-c737df660783 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:27.814383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 8/15] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:04:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:04:27.819974 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00a5ac-13ea-4b93-b890-c737df660783 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:27.828264 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0dc77e-1cb5-426e-b41f-09f175b6c7bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:27.829834 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0dc77e-1cb5-426e-b41f-09f175b6c7bd None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:27.917032 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00a5ac-13ea-4b93-b890-c737df660783 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:27.925615 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 8/16] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:04:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 04:04:27.931076 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0dc77e-1cb5-426e-b41f-09f175b6c7bd None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:27.934315 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:27.951219 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34193550-ca92-4e6f-82de-5f4faa036a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:27.951913 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34193550-ca92-4e6f-82de-5f4faa036a9e None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:27.952201 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34193550-ca92-4e6f-82de-5f4faa036a9e None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:27.952483 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34193550-ca92-4e6f-82de-5f4faa036a9e None admin] PATH_INFO: `/v3/users/54d7bb4b588246d59feaf1dfc8886cde` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:27.953694 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34193550-ca92-4e6f-82de-5f4faa036a9e None admin] RBAC: Authorizing `identity:get_user(user_id=54d7bb4b588246d59feaf1dfc8886cde)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:27.955187 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34193550-ca92-4e6f-82de-5f4faa036a9e None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:27.956791 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 9/17] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:04:27 2022] GET /identity/v3/users/54d7bb4b588246d59feaf1dfc8886cde => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:04:27.962671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34193550-ca92-4e6f-82de-5f4faa036a9e None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:27.977878 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:28.031541 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0dc77e-1cb5-426e-b41f-09f175b6c7bd None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:28.062795 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34193550-ca92-4e6f-82de-5f4faa036a9e None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:28.065047 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7014e-db50-4136-aa97-24d0a3c353cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:28.065939 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7014e-db50-4136-aa97-24d0a3c353cb None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:28.066225 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7014e-db50-4136-aa97-24d0a3c353cb None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:28.066502 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7014e-db50-4136-aa97-24d0a3c353cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:28.085469 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7014e-db50-4136-aa97-24d0a3c353cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:28.086945 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7014e-db50-4136-aa97-24d0a3c353cb None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:28.096077 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c4ebf-14d9-418b-81d9-d9bf98201b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:28.096715 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c4ebf-14d9-418b-81d9-d9bf98201b40 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:28.096997 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c4ebf-14d9-418b-81d9-d9bf98201b40 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:28.097296 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c4ebf-14d9-418b-81d9-d9bf98201b40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:28.098419 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c4ebf-14d9-418b-81d9-d9bf98201b40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:28.099848 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c4ebf-14d9-418b-81d9-d9bf98201b40 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:28.101439 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 10/18] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:04:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:04:28.105200 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-e8a7014e-db50-4136-aa97-24d0a3c353cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:04:28.105200 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:04:28.105200 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:04:28.105200 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:04:28.105200 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:04:28.105200 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:04:28.105200 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:04:28.105200 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:04:28.105200 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:04:28.105200 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:04:28.105200 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:04:28.105200 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:04:28.105200 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:04:28.105200 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:04:28.105200 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:04:28.105200 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:04:28.106177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:04:28.106177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:04:28.106177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:04:28.106177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:04:28.106177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:04:28.106177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:04:28.106177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:04:28.106177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:04:28.106177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:04:28.106177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:04:28.106177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:04:28.106177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:04:28.106177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:04:28.106177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:04:28.106177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:04:28.106177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:04:28.106177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:04:28.107030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:04:28.107030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:04:28.107030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:04:28.107030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 9/19] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:04:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:04:28.107732 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c4ebf-14d9-418b-81d9-d9bf98201b40 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:28.112844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7014e-db50-4136-aa97-24d0a3c353cb None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:28.170051 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:28.189059 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:28.208366 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c4ebf-14d9-418b-81d9-d9bf98201b40 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:28.215412 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7014e-db50-4136-aa97-24d0a3c353cb None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:28.242804 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9971c4c-8d39-411c-bcff-32d2ac3fcbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:28.243411 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9971c4c-8d39-411c-bcff-32d2ac3fcbb7 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:28.243692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9971c4c-8d39-411c-bcff-32d2ac3fcbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:28.243969 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9971c4c-8d39-411c-bcff-32d2ac3fcbb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:28.244694 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9971c4c-8d39-411c-bcff-32d2ac3fcbb7 None admin] RBAC: Adding query filter params (role.id=255d9e4004c54505a7cda1b8af74e5f1, scope.domain.id=default, user.id=54d7bb4b588246d59feaf1dfc8886cde) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:28.245005 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9971c4c-8d39-411c-bcff-32d2ac3fcbb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:28.246486 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9971c4c-8d39-411c-bcff-32d2ac3fcbb7 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:28.248483 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22471d4e-eb2f-405a-af75-ea0f9b6ff09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:28.249113 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22471d4e-eb2f-405a-af75-ea0f9b6ff09f None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:28.249406 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22471d4e-eb2f-405a-af75-ea0f9b6ff09f None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:28.249685 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22471d4e-eb2f-405a-af75-ea0f9b6ff09f None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:28.250331 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22471d4e-eb2f-405a-af75-ea0f9b6ff09f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:28.250637 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22471d4e-eb2f-405a-af75-ea0f9b6ff09f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:28.252013 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22471d4e-eb2f-405a-af75-ea0f9b6ff09f None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:28.253713 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 11/20] 10.222.0.42 () {56 vars in 1322 bytes} [Tue Aug 23 04:04:28 2022] GET /identity/v3/role_assignments?user.id=54d7bb4b588246d59feaf1dfc8886cde&scope.domain.id=default&role.id=255d9e4004c54505a7cda1b8af74e5f1 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:04:28.274135 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 10/21] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:04:30.548924 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31107fe-afda-4c57-933f-2ca6b730a840 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:30.549509 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31107fe-afda-4c57-933f-2ca6b730a840 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:30.549509 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31107fe-afda-4c57-933f-2ca6b730a840 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:30.550855 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 12/22] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:04:30.566211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e8bff-766a-4bc1-a2fd-253ca1fdaa9d None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:30.566714 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e8bff-766a-4bc1-a2fd-253ca1fdaa9d None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:30.566797 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e8bff-766a-4bc1-a2fd-253ca1fdaa9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:30.601621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-d62e8bff-766a-4bc1-a2fd-253ca1fdaa9d None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:30.602813 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-d62e8bff-766a-4bc1-a2fd-253ca1fdaa9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:30.691945 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 11/23] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 04:04:30.745641 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9e0db-3a1e-470e-a7bb-975b4bd6d74a None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:30.746285 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9e0db-3a1e-470e-a7bb-975b4bd6d74a None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:30.746781 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9e0db-3a1e-470e-a7bb-975b4bd6d74a None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:30.749002 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:04:30.754605 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561d12f-fcf7-4a4f-b7d7-3c94faad581d None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:30.756270 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7baeeb-d593-4a0a-8b2b-a017f5f2b56c None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:30.756555 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7baeeb-d593-4a0a-8b2b-a017f5f2b56c None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:30.756831 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7baeeb-d593-4a0a-8b2b-a017f5f2b56c None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:30.758287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 14/25] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 04:04:30.758404 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561d12f-fcf7-4a4f-b7d7-3c94faad581d None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:30.758578 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561d12f-fcf7-4a4f-b7d7-3c94faad581d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:30.765795 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dada6b-14c5-4202-8df5-c3750bb6cb0d None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:30.766082 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dada6b-14c5-4202-8df5-c3750bb6cb0d None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:30.766363 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dada6b-14c5-4202-8df5-c3750bb6cb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:30.792724 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-d561d12f-fcf7-4a4f-b7d7-3c94faad581d None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:30.794476 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-d561d12f-fcf7-4a4f-b7d7-3c94faad581d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:30.800329 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-16dada6b-14c5-4202-8df5-c3750bb6cb0d None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:30.801464 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-16dada6b-14c5-4202-8df5-c3750bb6cb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:30.852481 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:30.879278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 12/26] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:04:30.880319 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0e4b6-da1c-4ffb-a850-42ffae4c075e None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:30.880627 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0e4b6-da1c-4ffb-a850-42ffae4c075e None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:30.886755 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0e4b6-da1c-4ffb-a850-42ffae4c075e None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:30.886755 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:04:30.897060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de602957-8fa7-4c63-976c-1ab90261e33a None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:30.897060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de602957-8fa7-4c63-976c-1ab90261e33a None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:30.897060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de602957-8fa7-4c63-976c-1ab90261e33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:30.927031 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-de602957-8fa7-4c63-976c-1ab90261e33a None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:30.928256 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-de602957-8fa7-4c63-976c-1ab90261e33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:30.947187 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 15/28] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 04:04:31.019689 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 14/29] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 04:04:31.221912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dada6b-14c5-4202-8df5-c3750bb6cb0d None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:31.233328 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de602957-8fa7-4c63-976c-1ab90261e33a None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:31.334023 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:31.359651 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dada6b-14c5-4202-8df5-c3750bb6cb0d None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:31.415675 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de602957-8fa7-4c63-976c-1ab90261e33a None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:31.419828 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9f0a1-7cd3-4e9d-b182-804fb8a48596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:31.420696 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9f0a1-7cd3-4e9d-b182-804fb8a48596 None admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:31.421237 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9f0a1-7cd3-4e9d-b182-804fb8a48596 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:31.421745 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9f0a1-7cd3-4e9d-b182-804fb8a48596 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:31.422721 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9f0a1-7cd3-4e9d-b182-804fb8a48596 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:31.424095 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:31.425276 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9f0a1-7cd3-4e9d-b182-804fb8a48596 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:31.456963 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66530357-460d-4b11-8b5d-6b5f814a549d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:31.457650 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66530357-460d-4b11-8b5d-6b5f814a549d None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:31.457938 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66530357-460d-4b11-8b5d-6b5f814a549d None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:31.458214 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66530357-460d-4b11-8b5d-6b5f814a549d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:31.470959 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66530357-460d-4b11-8b5d-6b5f814a549d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:04:31.477510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-66530357-460d-4b11-8b5d-6b5f814a549d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:04:31.477510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:04:31.477510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:04:31.477510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:04:31.477510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:04:31.477510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:04:31.477510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:04:31.477510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:04:31.477510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:04:31.477510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:04:31.477510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:04:31.477510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:04:31.477510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:04:31.477510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:04:31.477510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:04:31.477510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:04:31.478401 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:04:31.478401 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:04:31.478401 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:04:31.478401 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:04:31.478401 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:04:31.478401 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:04:31.478401 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:04:31.478401 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:04:31.478401 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:04:31.478401 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:04:31.478401 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:04:31.478401 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:04:31.478401 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:04:31.478401 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:04:31.478401 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:04:31.478401 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:04:31.479296 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:04:31.479296 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:04:31.479296 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:04:31.479296 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:04:31.479296 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:04:31.479296 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:04:31.479296 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:04:31.479296 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:04:31.479296 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:04:31.479296 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:04:31.479296 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:04:31.479296 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:04:31.479296 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 15/30] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:04:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:04:31.479948 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66530357-460d-4b11-8b5d-6b5f814a549d None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:31.587200 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66530357-460d-4b11-8b5d-6b5f814a549d None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:31.624087 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88518e59-2dd2-4ecd-a0f8-5d38345c7b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:31.625048 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88518e59-2dd2-4ecd-a0f8-5d38345c7b55 None admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:31.625563 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88518e59-2dd2-4ecd-a0f8-5d38345c7b55 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:31.626054 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88518e59-2dd2-4ecd-a0f8-5d38345c7b55 None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:31.626988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88518e59-2dd2-4ecd-a0f8-5d38345c7b55 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:31.628594 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88518e59-2dd2-4ecd-a0f8-5d38345c7b55 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:31.668956 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 16/31] 10.222.0.42 () {60 vars in 1131 bytes} [Tue Aug 23 04:04:31 2022] POST /identity/v3/roles => generated 225 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:04:31.676879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9f0a1-7cd3-4e9d-b182-804fb8a48596 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:31.791377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9f0a1-7cd3-4e9d-b182-804fb8a48596 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:31.829590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f2035-6b07-4eae-9e84-0c9b9fa77ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:31.830267 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f2035-6b07-4eae-9e84-0c9b9fa77ad3 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:31.830558 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f2035-6b07-4eae-9e84-0c9b9fa77ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:31.830840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f2035-6b07-4eae-9e84-0c9b9fa77ad3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:31.842460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:31.852082 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f2035-6b07-4eae-9e84-0c9b9fa77ad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:31.852082 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f2035-6b07-4eae-9e84-0c9b9fa77ad3 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:31.864304 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-b06f2035-6b07-4eae-9e84-0c9b9fa77ad3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:04:31.864304 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:04:31.864304 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:04:31.864304 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:04:31.864304 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:04:31.864304 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:04:31.864304 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:04:31.864304 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:04:31.864304 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:04:31.864304 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:04:31.864304 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:04:31.864304 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:04:31.864304 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:04:31.864304 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:04:31.864304 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:04:31.864304 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:04:31.865239 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:04:31.865239 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:04:31.865239 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:04:31.865239 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:04:31.865239 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:04:31.865239 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:04:31.865239 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:04:31.865239 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:04:31.865239 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:04:31.865239 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:04:31.865239 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:04:31.865239 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:04:31.865239 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:04:31.865239 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:04:31.865239 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:04:31.865239 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:04:31.865239 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:04:31.866054 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:04:31.866054 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:04:31.866054 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:04:31.869224 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 17/32] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:04:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:04:31.869479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 16/33] 10.222.0.42 () {60 vars in 1131 bytes} [Tue Aug 23 04:04:31 2022] POST /identity/v3/roles => generated 219 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:04:31.870364 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f2035-6b07-4eae-9e84-0c9b9fa77ad3 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:31.874563 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88518e59-2dd2-4ecd-a0f8-5d38345c7b55 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:31.916997 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:32.028568 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88518e59-2dd2-4ecd-a0f8-5d38345c7b55 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:32.037551 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f2035-6b07-4eae-9e84-0c9b9fa77ad3 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:32.082470 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ef39f-1c1d-4049-94cf-9ab07c62813d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:32.083538 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ef39f-1c1d-4049-94cf-9ab07c62813d None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:32.084018 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ef39f-1c1d-4049-94cf-9ab07c62813d None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:32.084513 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ef39f-1c1d-4049-94cf-9ab07c62813d None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:32.085640 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ef39f-1c1d-4049-94cf-9ab07c62813d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:32.086093 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ef39f-1c1d-4049-94cf-9ab07c62813d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:32.086534 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89164585-1832-463c-9ccf-d9b32cca99c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:32.087274 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89164585-1832-463c-9ccf-d9b32cca99c5 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:32.087666 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89164585-1832-463c-9ccf-d9b32cca99c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:32.088048 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89164585-1832-463c-9ccf-d9b32cca99c5 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:32.088516 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ef39f-1c1d-4049-94cf-9ab07c62813d None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:32.089023 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89164585-1832-463c-9ccf-d9b32cca99c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:32.089495 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89164585-1832-463c-9ccf-d9b32cca99c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:32.091083 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89164585-1832-463c-9ccf-d9b32cca99c5 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:32.100991 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 18/34] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:04:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:32.102690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7b71c-b97e-4cb2-bd07-ca7a39f457cf None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:32.103086 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7b71c-b97e-4cb2-bd07-ca7a39f457cf None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:32.103472 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7b71c-b97e-4cb2-bd07-ca7a39f457cf None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:32.104724 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 17/35] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:04:32.109761 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:04:32.111095 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7b71c-b97e-4cb2-bd07-ca7a39f457cf None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:32.111883 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc0f46-5b76-4ef7-94c3-8d9fa11be834 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:32.112422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc0f46-5b76-4ef7-94c3-8d9fa11be834 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:32.112906 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc0f46-5b76-4ef7-94c3-8d9fa11be834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:32.137220 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-bdbc0f46-5b76-4ef7-94c3-8d9fa11be834 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:32.140067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-bdbc0f46-5b76-4ef7-94c3-8d9fa11be834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:32.185259 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:32.222192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 18/37] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:04:32.223017 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc0f46-5b76-4ef7-94c3-8d9fa11be834 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:32.242873 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:32.251203 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7b71c-b97e-4cb2-bd07-ca7a39f457cf None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:32.286825 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f605e1-1708-4670-9910-a887c586e454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:32.287480 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f605e1-1708-4670-9910-a887c586e454 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:32.287769 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f605e1-1708-4670-9910-a887c586e454 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:32.288051 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f605e1-1708-4670-9910-a887c586e454 None admin] PATH_INFO: `/v3/users/54d7bb4b588246d59feaf1dfc8886cde` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:32.289510 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f605e1-1708-4670-9910-a887c586e454 None admin] RBAC: Authorizing `identity:get_user(user_id=54d7bb4b588246d59feaf1dfc8886cde)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:32.290911 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f605e1-1708-4670-9910-a887c586e454 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:32.292638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:04:32 2022] GET /identity/v3/users/54d7bb4b588246d59feaf1dfc8886cde => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:32.299046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f605e1-1708-4670-9910-a887c586e454 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:32.350565 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc0f46-5b76-4ef7-94c3-8d9fa11be834 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:32.398688 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426fd35-1e88-4860-926c-a477b4b7db71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:32.399931 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426fd35-1e88-4860-926c-a477b4b7db71 None admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:32.400604 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426fd35-1e88-4860-926c-a477b4b7db71 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:32.401144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426fd35-1e88-4860-926c-a477b4b7db71 None admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:32.402340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426fd35-1e88-4860-926c-a477b4b7db71 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:32.404509 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426fd35-1e88-4860-926c-a477b4b7db71 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:32.408487 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f605e1-1708-4670-9910-a887c586e454 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:32.426815 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:32.446595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea283b4-a3cf-4950-855f-0a9a5661c33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:32.447363 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea283b4-a3cf-4950-855f-0a9a5661c33a None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:32.447990 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea283b4-a3cf-4950-855f-0a9a5661c33a None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:32.448590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea283b4-a3cf-4950-855f-0a9a5661c33a None admin] PATH_INFO: `/v3/domains/default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:32.450076 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea283b4-a3cf-4950-855f-0a9a5661c33a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:32.454532 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea283b4-a3cf-4950-855f-0a9a5661c33a None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:32.460533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 21/39] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:04:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:04:32.460533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1306a2-5a36-45d5-a7ab-dfec95ca1ec0 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:32.460533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1306a2-5a36-45d5-a7ab-dfec95ca1ec0 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:32.460533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1306a2-5a36-45d5-a7ab-dfec95ca1ec0 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:32.460533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 22/40] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:04:32.462768 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1306a2-5a36-45d5-a7ab-dfec95ca1ec0 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:32.517471 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 19/41] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 23 04:04:32 2022] POST /identity/v3/projects => generated 301 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:04:32.518719 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4793728-1d09-44b2-b9e9-7d279b3ba17c None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:32.519015 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4793728-1d09-44b2-b9e9-7d279b3ba17c None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:32.519296 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4793728-1d09-44b2-b9e9-7d279b3ba17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:32.540324 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-e4793728-1d09-44b2-b9e9-7d279b3ba17c None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:32.541636 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-e4793728-1d09-44b2-b9e9-7d279b3ba17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:32.579877 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1306a2-5a36-45d5-a7ab-dfec95ca1ec0 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:32.615202 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:32.621147 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 20/42] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:04:32.622027 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4793728-1d09-44b2-b9e9-7d279b3ba17c None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:32.625346 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08320695-9deb-4918-af01-3dcfa99752fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:32.627410 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08320695-9deb-4918-af01-3dcfa99752fa None admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:32.627995 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08320695-9deb-4918-af01-3dcfa99752fa None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:32.628611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08320695-9deb-4918-af01-3dcfa99752fa None admin] PATH_INFO: `/v3/domains/default/users/54d7bb4b588246d59feaf1dfc8886cde/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:32.630977 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08320695-9deb-4918-af01-3dcfa99752fa None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=54d7bb4b588246d59feaf1dfc8886cde, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:32.633868 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08320695-9deb-4918-af01-3dcfa99752fa None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:32.724323 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 23/43] 10.222.0.42 () {58 vars in 1361 bytes} [Tue Aug 23 04:04:32 2022] PUT /identity/v3/domains/default/users/54d7bb4b588246d59feaf1dfc8886cde/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:04:32.729377 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4793728-1d09-44b2-b9e9-7d279b3ba17c None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:32.777415 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956edf0-6ef2-445a-a2be-96c263bd7d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:32.778145 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956edf0-6ef2-445a-a2be-96c263bd7d31 None admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:32.778433 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956edf0-6ef2-445a-a2be-96c263bd7d31 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:32.778712 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956edf0-6ef2-445a-a2be-96c263bd7d31 None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:32.779413 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956edf0-6ef2-445a-a2be-96c263bd7d31 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:32.780884 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956edf0-6ef2-445a-a2be-96c263bd7d31 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:32.848854 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 21/44] 10.222.0.42 () {60 vars in 1131 bytes} [Tue Aug 23 04:04:32 2022] POST /identity/v3/roles => generated 223 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:04:32.903508 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08320695-9deb-4918-af01-3dcfa99752fa None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:32.962638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:33.020244 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08320695-9deb-4918-af01-3dcfa99752fa None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:33.057443 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274df501-9546-4843-a5a0-fcf09ca319c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:33.058345 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274df501-9546-4843-a5a0-fcf09ca319c1 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:33.058628 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274df501-9546-4843-a5a0-fcf09ca319c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:33.058902 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274df501-9546-4843-a5a0-fcf09ca319c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:33.060647 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274df501-9546-4843-a5a0-fcf09ca319c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:33.062142 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274df501-9546-4843-a5a0-fcf09ca319c1 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:33.063893 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 24/45] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:04:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:33.069399 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956edf0-6ef2-445a-a2be-96c263bd7d31 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:33.126328 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:33.168265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956edf0-6ef2-445a-a2be-96c263bd7d31 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:33.201930 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6be63-017f-45e5-92e1-153a687d3b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:33.202551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6be63-017f-45e5-92e1-153a687d3b01 None admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:33.202838 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6be63-017f-45e5-92e1-153a687d3b01 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:33.203114 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6be63-017f-45e5-92e1-153a687d3b01 None admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:33.203768 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d6be63-017f-45e5-92e1-153a687d3b01 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:33.205259 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d6be63-017f-45e5-92e1-153a687d3b01 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:33.270949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 22/46] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 23 04:04:33 2022] POST /identity/v3/projects => generated 312 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:04:34.655537 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d8d51-4c0c-4d1a-8d1f-4ccc12fb65f3 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:34.656054 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d8d51-4c0c-4d1a-8d1f-4ccc12fb65f3 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:34.656137 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d8d51-4c0c-4d1a-8d1f-4ccc12fb65f3 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:34.657483 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 25/47] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:04:34.662908 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8055288-149b-4703-a022-ed6c77218fbc None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:34.663307 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8055288-149b-4703-a022-ed6c77218fbc None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:34.663472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8055288-149b-4703-a022-ed6c77218fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:34.681037 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-c8055288-149b-4703-a022-ed6c77218fbc None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:34.682236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c8055288-149b-4703-a022-ed6c77218fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:34.747644 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 23/48] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:04:35.025972 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d8d51-4c0c-4d1a-8d1f-4ccc12fb65f3 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:35.127901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d8d51-4c0c-4d1a-8d1f-4ccc12fb65f3 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:35.141051 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:35.142605 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e9d46-9268-4997-8799-8cfbe792b821 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:35.142901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e9d46-9268-4997-8799-8cfbe792b821 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:35.143204 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e9d46-9268-4997-8799-8cfbe792b821 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:35.144529 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 24/49] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 04:04:35.149312 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf187f-a63f-46d6-8860-4be723297ad1 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:35.149599 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf187f-a63f-46d6-8860-4be723297ad1 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:35.149882 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf187f-a63f-46d6-8860-4be723297ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:35.162722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07339bb-2249-435f-b5ef-9e035733af50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:35.163368 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07339bb-2249-435f-b5ef-9e035733af50 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:35.163659 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07339bb-2249-435f-b5ef-9e035733af50 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:35.163936 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07339bb-2249-435f-b5ef-9e035733af50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:35.167416 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-70bf187f-a63f-46d6-8860-4be723297ad1 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:35.169157 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-70bf187f-a63f-46d6-8860-4be723297ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:35.176443 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07339bb-2249-435f-b5ef-9e035733af50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:04:35.181183 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-b07339bb-2249-435f-b5ef-9e035733af50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:04:35.181183 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:04:35.181183 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:04:35.181183 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:04:35.181183 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:04:35.181183 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:04:35.181183 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:04:35.181183 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:04:35.181183 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:04:35.181183 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:04:35.181183 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:04:35.181183 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:04:35.181183 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:04:35.181183 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:04:35.181183 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:04:35.181183 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:04:35.182232 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:04:35.182232 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:04:35.182232 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:04:35.182232 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:04:35.182232 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:04:35.182232 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:04:35.182232 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:04:35.182232 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:04:35.182232 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:04:35.182232 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:04:35.182232 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:04:35.182232 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:04:35.182232 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:04:35.182232 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:04:35.182232 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:04:35.182232 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:04:35.183274 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:04:35.183274 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:04:35.183274 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:04:35.183274 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:04:35.183274 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:04:35.183274 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:04:35.183274 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:04:35.183274 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:04:35.183274 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:04:35.183274 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:04:35.183274 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:04:35.183274 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:04:35.183274 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 26/50] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:04:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:04:35.188815 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07339bb-2249-435f-b5ef-9e035733af50 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:35.203974 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:35.239802 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 25/51] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 04:04:35.391046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07339bb-2249-435f-b5ef-9e035733af50 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:35.423995 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805c2e0-a99a-44f9-bbb3-cda0b6e9e3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:35.424607 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805c2e0-a99a-44f9-bbb3-cda0b6e9e3d6 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:35.424899 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805c2e0-a99a-44f9-bbb3-cda0b6e9e3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:35.425214 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805c2e0-a99a-44f9-bbb3-cda0b6e9e3d6 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:35.425892 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805c2e0-a99a-44f9-bbb3-cda0b6e9e3d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:35.426204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805c2e0-a99a-44f9-bbb3-cda0b6e9e3d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:35.427588 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805c2e0-a99a-44f9-bbb3-cda0b6e9e3d6 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:35.436532 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 27/52] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:04:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:04:35.441943 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf187f-a63f-46d6-8860-4be723297ad1 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:35.505726 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805c2e0-a99a-44f9-bbb3-cda0b6e9e3d6 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:35.540207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:35.542690 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf187f-a63f-46d6-8860-4be723297ad1 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:35.611156 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805c2e0-a99a-44f9-bbb3-cda0b6e9e3d6 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:35.646698 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac0f4c-f513-4658-8627-78d199c1db47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:35.647354 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac0f4c-f513-4658-8627-78d199c1db47 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:35.647643 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac0f4c-f513-4658-8627-78d199c1db47 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:35.647926 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac0f4c-f513-4658-8627-78d199c1db47 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:35.649126 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac0f4c-f513-4658-8627-78d199c1db47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:35.650584 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac0f4c-f513-4658-8627-78d199c1db47 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:35.652194 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 28/53] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:04:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:04:35.658203 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac0f4c-f513-4658-8627-78d199c1db47 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:35.682172 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75031ba-b704-4bd1-8571-cb5a46f44e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:35.683090 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75031ba-b704-4bd1-8571-cb5a46f44e02 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:35.683379 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75031ba-b704-4bd1-8571-cb5a46f44e02 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:35.683659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75031ba-b704-4bd1-8571-cb5a46f44e02 None admin] PATH_INFO: `/v3/users/54d7bb4b588246d59feaf1dfc8886cde` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:35.685014 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75031ba-b704-4bd1-8571-cb5a46f44e02 None admin] RBAC: Authorizing `identity:get_user(user_id=54d7bb4b588246d59feaf1dfc8886cde)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:35.686511 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75031ba-b704-4bd1-8571-cb5a46f44e02 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:35.688096 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 26/54] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:04:35 2022] GET /identity/v3/users/54d7bb4b588246d59feaf1dfc8886cde => generated 247 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:35.693486 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75031ba-b704-4bd1-8571-cb5a46f44e02 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:35.732840 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:35.759458 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac0f4c-f513-4658-8627-78d199c1db47 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:35.760959 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:35.793950 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a138d-b89e-4086-b01c-580497affcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:35.794587 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a138d-b89e-4086-b01c-580497affcbf None admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:35.794874 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a138d-b89e-4086-b01c-580497affcbf None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:35.795153 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a138d-b89e-4086-b01c-580497affcbf None admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:35.795809 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a138d-b89e-4086-b01c-580497affcbf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:35.796205 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75031ba-b704-4bd1-8571-cb5a46f44e02 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:35.797316 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a138d-b89e-4086-b01c-580497affcbf None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:35.831435 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b30052-1c6a-42e0-9c97-590975ea2fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:35.832065 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b30052-1c6a-42e0-9c97-590975ea2fd9 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:35.832349 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b30052-1c6a-42e0-9c97-590975ea2fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:35.832624 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b30052-1c6a-42e0-9c97-590975ea2fd9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:35.833748 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b30052-1c6a-42e0-9c97-590975ea2fd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:35.835181 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b30052-1c6a-42e0-9c97-590975ea2fd9 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:35.836731 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:04:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:04:35.842976 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b30052-1c6a-42e0-9c97-590975ea2fd9 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:35.877914 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 29/56] 10.222.0.42 () {60 vars in 1140 bytes} [Tue Aug 23 04:04:35 2022] POST /identity/v3/projects => generated 298 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:04:35.947033 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b30052-1c6a-42e0-9c97-590975ea2fd9 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:35.958174 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:35.985743 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d54d03-a1d6-4d20-b609-6c4cf917d207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:35.986377 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d54d03-a1d6-4d20-b609-6c4cf917d207 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:35.986663 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d54d03-a1d6-4d20-b609-6c4cf917d207 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:35.986940 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d54d03-a1d6-4d20-b609-6c4cf917d207 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:35.987687 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d54d03-a1d6-4d20-b609-6c4cf917d207 None admin] RBAC: Adding query filter params (role.id=255d9e4004c54505a7cda1b8af74e5f1, scope.domain.id=default, user.id=54d7bb4b588246d59feaf1dfc8886cde) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:35.988006 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d54d03-a1d6-4d20-b609-6c4cf917d207 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:35.989482 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d54d03-a1d6-4d20-b609-6c4cf917d207 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:35.999328 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1322 bytes} [Tue Aug 23 04:04:35 2022] GET /identity/v3/role_assignments?user.id=54d7bb4b588246d59feaf1dfc8886cde&scope.domain.id=default&role.id=255d9e4004c54505a7cda1b8af74e5f1 => generated 530 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:04:37.795131 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da6808-3d33-4bb5-8bbc-0d2c470114e9 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:37.795645 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da6808-3d33-4bb5-8bbc-0d2c470114e9 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:37.795757 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da6808-3d33-4bb5-8bbc-0d2c470114e9 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:37.797024 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 30/58] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:04:37.802342 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63025f8-dc37-4ed1-acd6-e14742c23f4e None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:37.802739 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63025f8-dc37-4ed1-acd6-e14742c23f4e None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:37.802912 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63025f8-dc37-4ed1-acd6-e14742c23f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:37.821132 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-e63025f8-dc37-4ed1-acd6-e14742c23f4e None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:37.822370 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-e63025f8-dc37-4ed1-acd6-e14742c23f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:37.887864 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 29/59] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:04:38.163671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da6808-3d33-4bb5-8bbc-0d2c470114e9 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:38.263725 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da6808-3d33-4bb5-8bbc-0d2c470114e9 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:38.296115 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67669b8-baa2-4901-85ad-b9f1ac34a85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:38.296741 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67669b8-baa2-4901-85ad-b9f1ac34a85b None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:38.297027 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67669b8-baa2-4901-85ad-b9f1ac34a85b None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:38.297334 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67669b8-baa2-4901-85ad-b9f1ac34a85b None admin] PATH_INFO: `/v3/domains/default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:38.298453 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67669b8-baa2-4901-85ad-b9f1ac34a85b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:38.299900 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67669b8-baa2-4901-85ad-b9f1ac34a85b None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:38.301491 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 31/60] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:04:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:38.306892 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63025f8-dc37-4ed1-acd6-e14742c23f4e None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:38.403377 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:38.406270 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63025f8-dc37-4ed1-acd6-e14742c23f4e None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:38.439387 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87da580-f2bd-427d-93e1-0a41c879e633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:38.439941 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87da580-f2bd-427d-93e1-0a41c879e633 None admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:38.440229 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87da580-f2bd-427d-93e1-0a41c879e633 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:38.440511 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87da580-f2bd-427d-93e1-0a41c879e633 None admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:38.441219 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87da580-f2bd-427d-93e1-0a41c879e633 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:38.442689 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87da580-f2bd-427d-93e1-0a41c879e633 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:38.538114 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 30/61] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 23 04:04:38 2022] POST /identity/v3/users => generated 275 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:04:41.572395 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93564e03-8be2-4e09-8a2e-967864476840 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:41.572930 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93564e03-8be2-4e09-8a2e-967864476840 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:41.572930 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93564e03-8be2-4e09-8a2e-967864476840 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:41.575108 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 32/62] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:04:41.580185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d640c-8d59-4a27-8ca9-84e8e908fd87 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:41.580574 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d640c-8d59-4a27-8ca9-84e8e908fd87 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:41.580770 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d640c-8d59-4a27-8ca9-84e8e908fd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:41.602126 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-204d640c-8d59-4a27-8ca9-84e8e908fd87 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:41.603326 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-204d640c-8d59-4a27-8ca9-84e8e908fd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:41.699247 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 31/63] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:04:41.707852 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbe211-fb06-484d-b47e-d9d36a75eb89 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:41.708420 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbe211-fb06-484d-b47e-d9d36a75eb89 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:41.708892 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbe211-fb06-484d-b47e-d9d36a75eb89 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:41.710459 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 33/64] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:04:41.716356 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd79a8-ca31-4c3c-b550-1b6673323d26 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:41.716879 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd79a8-ca31-4c3c-b550-1b6673323d26 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:41.717479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd79a8-ca31-4c3c-b550-1b6673323d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:41.750113 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-03dd79a8-ca31-4c3c-b550-1b6673323d26 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:41.751672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-03dd79a8-ca31-4c3c-b550-1b6673323d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:41.828988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 32/65] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:04:41.929009 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e71bf-23a3-47f0-be7e-92892b8878f1 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:41.929688 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e71bf-23a3-47f0-be7e-92892b8878f1 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:41.930159 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e71bf-23a3-47f0-be7e-92892b8878f1 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:41.931714 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 34/66] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:04:41.937569 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66ff7c-b0b7-49a7-a467-43c2efc87546 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:41.938091 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66ff7c-b0b7-49a7-a467-43c2efc87546 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:41.938577 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66ff7c-b0b7-49a7-a467-43c2efc87546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:41.941405 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893813f-a2fe-419d-8d31-b54061813018 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:41.941919 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893813f-a2fe-419d-8d31-b54061813018 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:41.942383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893813f-a2fe-419d-8d31-b54061813018 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:41.948903 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 35/67] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 04:04:41.957108 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db17c7-5cc4-4eef-8532-f32ea1eb4488 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:41.957108 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db17c7-5cc4-4eef-8532-f32ea1eb4488 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:41.957108 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db17c7-5cc4-4eef-8532-f32ea1eb4488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:41.972030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-7e66ff7c-b0b7-49a7-a467-43c2efc87546 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:41.973258 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-7e66ff7c-b0b7-49a7-a467-43c2efc87546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:41.984689 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:41.994078 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-a1db17c7-5cc4-4eef-8532-f32ea1eb4488 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:41.995687 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-a1db17c7-5cc4-4eef-8532-f32ea1eb4488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:42.041469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:42.066381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 33/68] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:04:42.071659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66ff7c-b0b7-49a7-a467-43c2efc87546 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:42.100455 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 36/69] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:04:42.127638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db17c7-5cc4-4eef-8532-f32ea1eb4488 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:42.238760 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66ff7c-b0b7-49a7-a467-43c2efc87546 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:42.270498 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db17c7-5cc4-4eef-8532-f32ea1eb4488 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:42.274115 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bbda0b-6c3a-4d9b-9684-0704d8f3df44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:42.274765 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbda0b-6c3a-4d9b-9684-0704d8f3df44 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:42.275052 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbda0b-6c3a-4d9b-9684-0704d8f3df44 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:42.275334 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbda0b-6c3a-4d9b-9684-0704d8f3df44 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:42.289898 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bbda0b-6c3a-4d9b-9684-0704d8f3df44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:04:42.294653 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-d9bbda0b-6c3a-4d9b-9684-0704d8f3df44 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:04:42.294653 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:04:42.294653 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:04:42.294653 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:04:42.294653 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:04:42.294653 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:04:42.294653 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:04:42.294653 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:04:42.294653 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:04:42.294653 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:04:42.294653 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:04:42.294653 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:04:42.294653 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:04:42.294653 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:04:42.294653 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:04:42.294653 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:04:42.295503 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:04:42.295503 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:04:42.295503 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:04:42.295503 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:04:42.295503 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:04:42.295503 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:04:42.295503 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:04:42.295503 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:04:42.295503 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:04:42.295503 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:04:42.295503 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:04:42.295503 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:04:42.295503 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:04:42.295503 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:04:42.295503 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:04:42.295503 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:04:42.296278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:04:42.296278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:04:42.296278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:04:42.296278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:04:42.296278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:04:42.296278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:04:42.296278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:04:42.296278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:04:42.296278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:04:42.296278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:04:42.296278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:04:42.296278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:04:42.296278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 34/70] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:04:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:04:42.297657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50286a5-b8dd-4c2a-9ca7-a60a4984ab16 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:42.297754 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50286a5-b8dd-4c2a-9ca7-a60a4984ab16 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:42.298000 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50286a5-b8dd-4c2a-9ca7-a60a4984ab16 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:42.299379 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 35/71] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:04:42.304924 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecca65-fd6b-46b1-943d-7d5f37435f03 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:42.305238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecca65-fd6b-46b1-943d-7d5f37435f03 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:42.305518 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecca65-fd6b-46b1-943d-7d5f37435f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:42.314081 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc29e16-c958-483b-97d2-43ead3e99305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:42.314965 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc29e16-c958-483b-97d2-43ead3e99305 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:42.315438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc29e16-c958-483b-97d2-43ead3e99305 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:42.315925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc29e16-c958-483b-97d2-43ead3e99305 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:42.318824 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:42.325580 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-60ecca65-fd6b-46b1-943d-7d5f37435f03 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:42.326832 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-60ecca65-fd6b-46b1-943d-7d5f37435f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:42.329284 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc29e16-c958-483b-97d2-43ead3e99305 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:04:42.334803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-0fc29e16-c958-483b-97d2-43ead3e99305 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 04:04:42.334803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:04:42.334803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:04:42.334803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:04:42.334803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:04:42.334803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:04:42.334803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:04:42.334803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:04:42.334803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:04:42.334803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:04:42.334803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:04:42.334803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:04:42.334803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:04:42.334803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:04:42.334803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:04:42.334803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:04:42.335640 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:04:42.335640 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:04:42.335640 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:04:42.335640 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:04:42.335640 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:04:42.335640 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:04:42.335640 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:04:42.335640 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:04:42.335640 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:04:42.335640 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:04:42.335640 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:04:42.335640 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:04:42.335640 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:04:42.335640 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:04:42.335640 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:04:42.335640 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:04:42.336420 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:04:42.336420 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:04:42.336420 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:04:42.336420 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:04:42.336420 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:04:42.336420 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:04:42.336420 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:04:42.336420 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:04:42.336420 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:04:42.336420 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:04:42.336420 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 04:04:42.336420 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:04:42.338348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 37/72] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 23 04:04:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:04:42.341135 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc29e16-c958-483b-97d2-43ead3e99305 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:42.360849 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:42.399182 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 36/73] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:04:42.400194 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecca65-fd6b-46b1-943d-7d5f37435f03 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:42.468007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc29e16-c958-483b-97d2-43ead3e99305 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:42.505514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41df26-84bd-4902-91e3-94b75c062b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:42.506049 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41df26-84bd-4902-91e3-94b75c062b15 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:42.506337 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41df26-84bd-4902-91e3-94b75c062b15 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:42.506748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41df26-84bd-4902-91e3-94b75c062b15 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:42.507328 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41df26-84bd-4902-91e3-94b75c062b15 None admin] RBAC: Adding query filter params (name=member) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:42.507596 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41df26-84bd-4902-91e3-94b75c062b15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:42.508998 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41df26-84bd-4902-91e3-94b75c062b15 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:42.509637 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecca65-fd6b-46b1-943d-7d5f37435f03 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:42.518010 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 38/74] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 23 04:04:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:42.518652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41df26-84bd-4902-91e3-94b75c062b15 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:42.556729 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de2ff4-3938-4027-8f40-08fc09bf876a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:42.557644 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de2ff4-3938-4027-8f40-08fc09bf876a None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:42.557935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de2ff4-3938-4027-8f40-08fc09bf876a None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:42.558213 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de2ff4-3938-4027-8f40-08fc09bf876a None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:42.559407 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de2ff4-3938-4027-8f40-08fc09bf876a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:42.559718 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de2ff4-3938-4027-8f40-08fc09bf876a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:42.561181 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de2ff4-3938-4027-8f40-08fc09bf876a None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:42.564900 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:42.574029 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 37/75] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:04:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:42.577276 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de2ff4-3938-4027-8f40-08fc09bf876a None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:42.601737 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:42.628692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41df26-84bd-4902-91e3-94b75c062b15 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:42.666208 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4771ccc-098c-4cbc-a663-bf93a9118b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:42.666858 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4771ccc-098c-4cbc-a663-bf93a9118b73 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:42.667142 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4771ccc-098c-4cbc-a663-bf93a9118b73 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:42.667417 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4771ccc-098c-4cbc-a663-bf93a9118b73 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:42.679341 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4771ccc-098c-4cbc-a663-bf93a9118b73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:04:42.685681 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-c4771ccc-098c-4cbc-a663-bf93a9118b73 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:04:42.685681 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:04:42.685681 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:04:42.685681 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:04:42.685681 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:04:42.685681 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:04:42.685681 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:04:42.685681 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:04:42.685681 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:04:42.685681 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:04:42.685681 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:04:42.685681 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:04:42.685681 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:04:42.685681 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:04:42.685681 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:04:42.685681 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:04:42.686719 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:04:42.686719 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:04:42.686719 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:04:42.686719 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:04:42.686719 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:04:42.686719 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:04:42.686719 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:04:42.686719 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:04:42.686719 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:04:42.686719 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:04:42.686719 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:04:42.686719 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:04:42.686719 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:04:42.686719 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:04:42.686719 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:04:42.686719 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:04:42.689981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:04:42.689981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:04:42.689981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:04:42.689981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:04:42.689981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:04:42.689981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:04:42.689981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:04:42.689981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:04:42.689981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:04:42.689981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:04:42.689981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:04:42.689981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:04:42.690571 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de2ff4-3938-4027-8f40-08fc09bf876a None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:42.690971 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 39/76] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:04:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:04:42.690971 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4771ccc-098c-4cbc-a663-bf93a9118b73 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:42.720559 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c1dd0-ffd4-4a42-a83a-3738e9792d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:42.721231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c1dd0-ffd4-4a42-a83a-3738e9792d2c None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:42.721525 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c1dd0-ffd4-4a42-a83a-3738e9792d2c None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:42.721805 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c1dd0-ffd4-4a42-a83a-3738e9792d2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:42.732363 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c1dd0-ffd4-4a42-a83a-3738e9792d2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:04:42.737149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-683c1dd0-ffd4-4a42-a83a-3738e9792d2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:04:42.737149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:04:42.737149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:04:42.737149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:04:42.737149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:04:42.737149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:04:42.737149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:04:42.737149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:04:42.737149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:04:42.737149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:04:42.737149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:04:42.737149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:04:42.737149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:04:42.737149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:04:42.737149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:04:42.737149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:04:42.737987 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:04:42.737987 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:04:42.737987 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:04:42.737987 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:04:42.737987 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:04:42.737987 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:04:42.737987 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:04:42.737987 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:04:42.737987 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:04:42.737987 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:04:42.737987 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:04:42.737987 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:04:42.737987 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:04:42.737987 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:04:42.737987 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:04:42.737987 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:04:42.738801 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:04:42.738801 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:04:42.738801 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:04:42.738801 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:04:42.738801 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:04:42.738801 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:04:42.738801 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:04:42.738801 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:04:42.738801 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:04:42.738801 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:04:42.738801 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:04:42.738801 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:04:42.738801 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 38/77] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:04:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:04:42.739729 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c1dd0-ffd4-4a42-a83a-3738e9792d2c None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:42.789032 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4771ccc-098c-4cbc-a663-bf93a9118b73 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:42.797993 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:42.822858 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c3e96-df80-4344-b0f0-f8556b411d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:42.823501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c3e96-df80-4344-b0f0-f8556b411d8e None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:42.823781 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c3e96-df80-4344-b0f0-f8556b411d8e None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:42.824056 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c3e96-df80-4344-b0f0-f8556b411d8e None admin] PATH_INFO: `/v3/users/93456d60ff574c9a8ee4661d1bbe9633` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:42.826053 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:42.837628 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c3e96-df80-4344-b0f0-f8556b411d8e None admin] RBAC: Authorizing `identity:get_user(user_id=93456d60ff574c9a8ee4661d1bbe9633)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:42.839089 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c3e96-df80-4344-b0f0-f8556b411d8e None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:42.839239 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c1dd0-ffd4-4a42-a83a-3738e9792d2c None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:42.840706 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 40/78] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:04:42 2022] GET /identity/v3/users/93456d60ff574c9a8ee4661d1bbe9633 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:42.841489 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c3e96-df80-4344-b0f0-f8556b411d8e None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:42.878102 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa59555-58e1-4bd9-ade7-4797f5e66b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:42.878846 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa59555-58e1-4bd9-ade7-4797f5e66b9a None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:42.879086 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa59555-58e1-4bd9-ade7-4797f5e66b9a None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:42.879367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa59555-58e1-4bd9-ade7-4797f5e66b9a None admin] PATH_INFO: `/v3/users/93456d60ff574c9a8ee4661d1bbe9633` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:42.880511 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa59555-58e1-4bd9-ade7-4797f5e66b9a None admin] RBAC: Authorizing `identity:get_user(user_id=93456d60ff574c9a8ee4661d1bbe9633)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:42.882010 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa59555-58e1-4bd9-ade7-4797f5e66b9a None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:42.883587 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 39/79] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:04:42 2022] GET /identity/v3/users/93456d60ff574c9a8ee4661d1bbe9633 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:42.884353 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa59555-58e1-4bd9-ade7-4797f5e66b9a None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:42.946994 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c3e96-df80-4344-b0f0-f8556b411d8e None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:42.981572 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87bc05-0a77-46f6-a81e-539b031bba50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:42.982206 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87bc05-0a77-46f6-a81e-539b031bba50 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:42.982491 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87bc05-0a77-46f6-a81e-539b031bba50 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:42.982769 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87bc05-0a77-46f6-a81e-539b031bba50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:42.983897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87bc05-0a77-46f6-a81e-539b031bba50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:42.984302 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa59555-58e1-4bd9-ade7-4797f5e66b9a None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:42.985390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87bc05-0a77-46f6-a81e-539b031bba50 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:42.987114 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 41/80] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:04:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:42.987723 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87bc05-0a77-46f6-a81e-539b031bba50 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:43.012316 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:43.020712 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40f344-d90c-4ed1-b8ff-7fdcc519d0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:43.021370 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40f344-d90c-4ed1-b8ff-7fdcc519d0e0 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:43.021660 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40f344-d90c-4ed1-b8ff-7fdcc519d0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:43.021937 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40f344-d90c-4ed1-b8ff-7fdcc519d0e0 None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:43.022608 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40f344-d90c-4ed1-b8ff-7fdcc519d0e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:43.025749 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40f344-d90c-4ed1-b8ff-7fdcc519d0e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:43.025749 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40f344-d90c-4ed1-b8ff-7fdcc519d0e0 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:43.032681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 40/81] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 23 04:04:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:43.033504 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40f344-d90c-4ed1-b8ff-7fdcc519d0e0 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:43.051982 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:43.091843 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87bc05-0a77-46f6-a81e-539b031bba50 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:43.125791 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f9cff-9dfe-4f4a-81d6-4a799bb57120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:43.126403 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f9cff-9dfe-4f4a-81d6-4a799bb57120 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:43.126683 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f9cff-9dfe-4f4a-81d6-4a799bb57120 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:43.126959 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f9cff-9dfe-4f4a-81d6-4a799bb57120 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:43.127630 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f9cff-9dfe-4f4a-81d6-4a799bb57120 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:43.127933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f9cff-9dfe-4f4a-81d6-4a799bb57120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:43.129393 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f9cff-9dfe-4f4a-81d6-4a799bb57120 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:43.131763 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40f344-d90c-4ed1-b8ff-7fdcc519d0e0 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:43.137079 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 42/82] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:04:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:43.141626 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f9cff-9dfe-4f4a-81d6-4a799bb57120 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:43.169289 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae9798-fae1-4faf-926e-3386e62d2ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:43.169907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae9798-fae1-4faf-926e-3386e62d2ed9 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:43.170189 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae9798-fae1-4faf-926e-3386e62d2ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:43.170467 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae9798-fae1-4faf-926e-3386e62d2ed9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:43.226262 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:43.238534 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae9798-fae1-4faf-926e-3386e62d2ed9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:43.240027 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae9798-fae1-4faf-926e-3386e62d2ed9 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:43.240955 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f9cff-9dfe-4f4a-81d6-4a799bb57120 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:43.262846 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:43.274986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3030b0-d6ba-442f-ba63-959c058c008e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:43.275601 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3030b0-d6ba-442f-ba63-959c058c008e None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:43.275888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3030b0-d6ba-442f-ba63-959c058c008e None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:43.276166 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3030b0-d6ba-442f-ba63-959c058c008e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:43.338796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 41/83] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:04:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:04:43.340135 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae9798-fae1-4faf-926e-3386e62d2ed9 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:43.347123 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3030b0-d6ba-442f-ba63-959c058c008e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:43.348606 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3030b0-d6ba-442f-ba63-959c058c008e None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:43.426989 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:43.439226 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae9798-fae1-4faf-926e-3386e62d2ed9 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:43.447053 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 43/84] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:04:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:04:43.449552 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3030b0-d6ba-442f-ba63-959c058c008e None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:43.473321 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:43.474652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49b9fa-6f39-4364-b07a-d333253eae6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:43.475276 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49b9fa-6f39-4364-b07a-d333253eae6a None admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:43.475594 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49b9fa-6f39-4364-b07a-d333253eae6a None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:43.475870 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49b9fa-6f39-4364-b07a-d333253eae6a None admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:43.476519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49b9fa-6f39-4364-b07a-d333253eae6a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:43.478020 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49b9fa-6f39-4364-b07a-d333253eae6a None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:43.548786 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3030b0-d6ba-442f-ba63-959c058c008e None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:43.548977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 42/85] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 23 04:04:43 2022] POST /identity/v3/users => generated 289 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:04:43.549925 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49b9fa-6f39-4364-b07a-d333253eae6a None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:43.588280 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679f9a0-0f85-49a9-bc0a-b7386523e9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:43.588984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679f9a0-0f85-49a9-bc0a-b7386523e9af None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:43.589326 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679f9a0-0f85-49a9-bc0a-b7386523e9af None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:43.590177 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679f9a0-0f85-49a9-bc0a-b7386523e9af None admin] PATH_INFO: `/v3/users/93456d60ff574c9a8ee4661d1bbe9633` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:43.591414 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679f9a0-0f85-49a9-bc0a-b7386523e9af None admin] RBAC: Authorizing `identity:get_user(user_id=93456d60ff574c9a8ee4661d1bbe9633)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:43.592945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679f9a0-0f85-49a9-bc0a-b7386523e9af None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:43.594673 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 44/86] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:04:43 2022] GET /identity/v3/users/93456d60ff574c9a8ee4661d1bbe9633 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:43.595564 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679f9a0-0f85-49a9-bc0a-b7386523e9af None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:43.664770 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49b9fa-6f39-4364-b07a-d333253eae6a None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:43.701306 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a4afb-f0b6-4d95-a75e-2c2891dda1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:43.702010 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a4afb-f0b6-4d95-a75e-2c2891dda1b7 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:43.702299 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a4afb-f0b6-4d95-a75e-2c2891dda1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:43.702575 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a4afb-f0b6-4d95-a75e-2c2891dda1b7 None admin] PATH_INFO: `/v3/users/54d7bb4b588246d59feaf1dfc8886cde` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:43.703715 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a4afb-f0b6-4d95-a75e-2c2891dda1b7 None admin] RBAC: Authorizing `identity:get_user(user_id=54d7bb4b588246d59feaf1dfc8886cde)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:43.705197 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a4afb-f0b6-4d95-a75e-2c2891dda1b7 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:43.706788 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 43/87] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:04:43 2022] GET /identity/v3/users/54d7bb4b588246d59feaf1dfc8886cde => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:43.707601 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a4afb-f0b6-4d95-a75e-2c2891dda1b7 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:43.722726 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:43.725128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:43.734497 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679f9a0-0f85-49a9-bc0a-b7386523e9af None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:43.775533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657b421-6ad4-492b-af4a-d793c4c487ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:43.776189 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657b421-6ad4-492b-af4a-d793c4c487ac None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:43.776477 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657b421-6ad4-492b-af4a-d793c4c487ac None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:43.776764 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657b421-6ad4-492b-af4a-d793c4c487ac None admin] PATH_INFO: `/v3/projects/3371d174840948c183eab2505d3b2776` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:43.781570 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657b421-6ad4-492b-af4a-d793c4c487ac None admin] RBAC: Authorizing `identity:get_project(project_id=3371d174840948c183eab2505d3b2776)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:43.783180 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657b421-6ad4-492b-af4a-d793c4c487ac None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:43.785197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 45/88] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:04:43 2022] GET /identity/v3/projects/3371d174840948c183eab2505d3b2776 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:43.786112 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657b421-6ad4-492b-af4a-d793c4c487ac None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:43.834594 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a4afb-f0b6-4d95-a75e-2c2891dda1b7 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:43.881691 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c13548-4048-4c9e-a543-050a220b9d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:43.882707 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c13548-4048-4c9e-a543-050a220b9d8a None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:43.882707 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c13548-4048-4c9e-a543-050a220b9d8a None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:43.882886 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c13548-4048-4c9e-a543-050a220b9d8a None admin] PATH_INFO: `/v3/projects/3371d174840948c183eab2505d3b2776` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:43.884569 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c13548-4048-4c9e-a543-050a220b9d8a None admin] RBAC: Authorizing `identity:get_project(project_id=3371d174840948c183eab2505d3b2776)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:43.886127 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c13548-4048-4c9e-a543-050a220b9d8a None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:43.888427 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 44/89] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:04:43 2022] GET /identity/v3/projects/3371d174840948c183eab2505d3b2776 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:43.889243 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c13548-4048-4c9e-a543-050a220b9d8a None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:43.928379 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657b421-6ad4-492b-af4a-d793c4c487ac None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:43.981576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f75c11-4b8d-49f9-b228-77c2c6773175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:43.983038 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f75c11-4b8d-49f9-b228-77c2c6773175 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:43.983468 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f75c11-4b8d-49f9-b228-77c2c6773175 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:43.984129 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f75c11-4b8d-49f9-b228-77c2c6773175 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:43.998947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:44.021020 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c13548-4048-4c9e-a543-050a220b9d8a None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:44.026361 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:44.064590 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392a96f-7493-4054-ac58-9e6da83e4c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:44.065817 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392a96f-7493-4054-ac58-9e6da83e4c67 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:44.066133 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392a96f-7493-4054-ac58-9e6da83e4c67 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:44.066420 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392a96f-7493-4054-ac58-9e6da83e4c67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:44.080915 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f75c11-4b8d-49f9-b228-77c2c6773175 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:44.082553 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f75c11-4b8d-49f9-b228-77c2c6773175 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:44.159711 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392a96f-7493-4054-ac58-9e6da83e4c67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:44.161587 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392a96f-7493-4054-ac58-9e6da83e4c67 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:44.199145 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 46/90] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:04:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:04:44.200553 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f75c11-4b8d-49f9-b228-77c2c6773175 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:44.264558 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:44.268810 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:44.284864 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 45/91] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:04:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:04:44.285872 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392a96f-7493-4054-ac58-9e6da83e4c67 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:44.313991 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f75c11-4b8d-49f9-b228-77c2c6773175 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:44.351636 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0183e5-ea2f-4314-af09-1510aac50ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:44.352591 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0183e5-ea2f-4314-af09-1510aac50ac5 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:44.353075 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0183e5-ea2f-4314-af09-1510aac50ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:44.353585 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0183e5-ea2f-4314-af09-1510aac50ac5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:44.354518 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0183e5-ea2f-4314-af09-1510aac50ac5 None admin] RBAC: Adding query filter params (role.id=b28fe6f1db4c4738862acb96ff94007c, scope.project.id=3371d174840948c183eab2505d3b2776, user.id=93456d60ff574c9a8ee4661d1bbe9633) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:44.355601 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0183e5-ea2f-4314-af09-1510aac50ac5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:44.357281 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0183e5-ea2f-4314-af09-1510aac50ac5 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:44.363456 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 47/92] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:04:44 2022] GET /identity/v3/role_assignments?user.id=93456d60ff574c9a8ee4661d1bbe9633&scope.project.id=3371d174840948c183eab2505d3b2776&role.id=b28fe6f1db4c4738862acb96ff94007c => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:44.364582 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0183e5-ea2f-4314-af09-1510aac50ac5 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:44.399155 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392a96f-7493-4054-ac58-9e6da83e4c67 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:44.438836 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e64cb8-a93c-4fc9-a7a4-6dd0aa49779b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:44.439515 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e64cb8-a93c-4fc9-a7a4-6dd0aa49779b None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:44.439809 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e64cb8-a93c-4fc9-a7a4-6dd0aa49779b None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:44.440093 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e64cb8-a93c-4fc9-a7a4-6dd0aa49779b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:44.440841 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e64cb8-a93c-4fc9-a7a4-6dd0aa49779b None admin] RBAC: Adding query filter params (role.id=5434f93251a0417c890b94b90b40ab71, scope.project.id=3371d174840948c183eab2505d3b2776, user.id=93456d60ff574c9a8ee4661d1bbe9633) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:44.441188 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e64cb8-a93c-4fc9-a7a4-6dd0aa49779b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:44.442718 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e64cb8-a93c-4fc9-a7a4-6dd0aa49779b None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:44.448520 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 46/93] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:04:44 2022] GET /identity/v3/role_assignments?user.id=93456d60ff574c9a8ee4661d1bbe9633&scope.project.id=3371d174840948c183eab2505d3b2776&role.id=5434f93251a0417c890b94b90b40ab71 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:44.449744 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e64cb8-a93c-4fc9-a7a4-6dd0aa49779b None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:44.483139 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0183e5-ea2f-4314-af09-1510aac50ac5 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:44.511898 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:44.516909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:44.525357 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078224b1-67bd-435f-9272-ca899fcd0141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:44.526339 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078224b1-67bd-435f-9272-ca899fcd0141 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:44.526785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078224b1-67bd-435f-9272-ca899fcd0141 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:44.527819 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078224b1-67bd-435f-9272-ca899fcd0141 None admin] PATH_INFO: `/v3/projects/9dc57ab50a454ffd926916aec30dcc11` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:44.529240 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078224b1-67bd-435f-9272-ca899fcd0141 None admin] RBAC: Authorizing `identity:get_project(project_id=9dc57ab50a454ffd926916aec30dcc11)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:44.530885 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078224b1-67bd-435f-9272-ca899fcd0141 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:44.533167 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 48/94] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:04:44 2022] GET /identity/v3/projects/9dc57ab50a454ffd926916aec30dcc11 => generated 312 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:44.542235 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078224b1-67bd-435f-9272-ca899fcd0141 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:44.635080 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e64cb8-a93c-4fc9-a7a4-6dd0aa49779b None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:44.684083 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d97624-582d-468f-bef3-2030c49b092d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:44.685271 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d97624-582d-468f-bef3-2030c49b092d None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:44.685759 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d97624-582d-468f-bef3-2030c49b092d None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:44.686231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d97624-582d-468f-bef3-2030c49b092d None admin] PATH_INFO: `/v3/projects/3371d174840948c183eab2505d3b2776` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:44.687703 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d97624-582d-468f-bef3-2030c49b092d None admin] RBAC: Authorizing `identity:get_project(project_id=3371d174840948c183eab2505d3b2776)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:44.689400 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d97624-582d-468f-bef3-2030c49b092d None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:44.691280 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 47/95] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:04:44 2022] GET /identity/v3/projects/3371d174840948c183eab2505d3b2776 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:44.697384 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d97624-582d-468f-bef3-2030c49b092d None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:44.742904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078224b1-67bd-435f-9272-ca899fcd0141 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:44.804087 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0dbc22-27df-476b-b719-19e6215f4bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:44.805055 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dbc22-27df-476b-b719-19e6215f4bee None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:44.805576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dbc22-27df-476b-b719-19e6215f4bee None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:44.806127 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dbc22-27df-476b-b719-19e6215f4bee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:44.807174 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0dbc22-27df-476b-b719-19e6215f4bee None admin] RBAC: Adding query filter params (role.id=b28fe6f1db4c4738862acb96ff94007c, scope.project.id=9dc57ab50a454ffd926916aec30dcc11, user.id=93456d60ff574c9a8ee4661d1bbe9633) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:44.807930 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0dbc22-27df-476b-b719-19e6215f4bee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:44.810510 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0dbc22-27df-476b-b719-19e6215f4bee None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:44.817271 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 49/96] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:04:44 2022] GET /identity/v3/role_assignments?user.id=93456d60ff574c9a8ee4661d1bbe9633&scope.project.id=9dc57ab50a454ffd926916aec30dcc11&role.id=b28fe6f1db4c4738862acb96ff94007c => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:44.863375 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d97624-582d-468f-bef3-2030c49b092d None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:44.885961 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:44.915479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88c830-d94f-4327-8685-f60ed30d2c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:44.916119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88c830-d94f-4327-8685-f60ed30d2c76 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:44.916412 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88c830-d94f-4327-8685-f60ed30d2c76 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:44.916697 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88c830-d94f-4327-8685-f60ed30d2c76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:44.917582 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88c830-d94f-4327-8685-f60ed30d2c76 None admin] RBAC: Adding query filter params (role.id=255d9e4004c54505a7cda1b8af74e5f1, scope.project.id=3371d174840948c183eab2505d3b2776, user.id=54d7bb4b588246d59feaf1dfc8886cde) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:44.918495 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88c830-d94f-4327-8685-f60ed30d2c76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:44.919969 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88c830-d94f-4327-8685-f60ed30d2c76 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:44.929898 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 48/97] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:04:44 2022] GET /identity/v3/role_assignments?user.id=54d7bb4b588246d59feaf1dfc8886cde&scope.project.id=3371d174840948c183eab2505d3b2776&role.id=255d9e4004c54505a7cda1b8af74e5f1 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:46.172217 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa736879-7c5b-42ac-923c-7c683c231e4e None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:46.172712 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa736879-7c5b-42ac-923c-7c683c231e4e None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:46.172813 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa736879-7c5b-42ac-923c-7c683c231e4e None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:46.174463 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 50/98] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:04:46.179315 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f524477-ef05-47bd-9263-48e9ad3c3ea1 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:46.179690 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f524477-ef05-47bd-9263-48e9ad3c3ea1 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:46.179955 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f524477-ef05-47bd-9263-48e9ad3c3ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:46.210147 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-6f524477-ef05-47bd-9263-48e9ad3c3ea1 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:46.211299 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-6f524477-ef05-47bd-9263-48e9ad3c3ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:46.298408 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 49/99] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:04:46.414957 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6795799-0f71-42a3-8cbf-dc1b4cf94d8b None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:46.415579 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6795799-0f71-42a3-8cbf-dc1b4cf94d8b None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:46.416051 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6795799-0f71-42a3-8cbf-dc1b4cf94d8b None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:46.418519 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 51/100] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:04:46.424308 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6980f-6e37-4f80-aff9-a5221809d387 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:46.424609 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6980f-6e37-4f80-aff9-a5221809d387 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:46.424896 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6980f-6e37-4f80-aff9-a5221809d387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:46.450083 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-e6b6980f-6e37-4f80-aff9-a5221809d387 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:46.451289 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-e6b6980f-6e37-4f80-aff9-a5221809d387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:46.521738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 50/101] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:04:46.825241 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6795799-0f71-42a3-8cbf-dc1b4cf94d8b None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:46.835037 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6980f-6e37-4f80-aff9-a5221809d387 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:46.897927 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:46.946200 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:46.988400 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6980f-6e37-4f80-aff9-a5221809d387 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:47.001710 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6795799-0f71-42a3-8cbf-dc1b4cf94d8b None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:47.037309 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eedb7b1-c0da-4da9-9d2a-2294ca6fbffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:47.038291 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedb7b1-c0da-4da9-9d2a-2294ca6fbffc None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:47.038584 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedb7b1-c0da-4da9-9d2a-2294ca6fbffc None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:47.039010 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedb7b1-c0da-4da9-9d2a-2294ca6fbffc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:47.050382 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eedb7b1-c0da-4da9-9d2a-2294ca6fbffc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:04:47.055751 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-1eedb7b1-c0da-4da9-9d2a-2294ca6fbffc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 04:04:47.055751 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:04:47.055751 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:04:47.055751 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:04:47.055751 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:04:47.055751 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:04:47.055751 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:04:47.055751 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:04:47.055751 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:04:47.055751 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:04:47.055751 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:04:47.055751 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:04:47.055751 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:04:47.055751 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:04:47.055751 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:04:47.055751 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:04:47.056616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:04:47.056616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:04:47.056616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:04:47.056616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:04:47.056616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:04:47.056616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:04:47.056616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:04:47.056616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:04:47.056616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:04:47.056616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:04:47.056616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:04:47.056616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:04:47.056616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:04:47.056616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:04:47.056616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:04:47.056616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:04:47.057692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:04:47.057692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:04:47.057692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:04:47.057692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:04:47.057692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:04:47.057692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:04:47.057692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:04:47.057692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:04:47.057692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:04:47.057692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:04:47.057692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 04:04:47.057692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:04:47.057692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 52/102] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:04:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:04:47.065632 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2ce3d-3ef5-4a0e-8557-941111660b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:47.066302 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2ce3d-3ef5-4a0e-8557-941111660b80 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:47.066500 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eedb7b1-c0da-4da9-9d2a-2294ca6fbffc None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:47.066596 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2ce3d-3ef5-4a0e-8557-941111660b80 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:47.066859 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2ce3d-3ef5-4a0e-8557-941111660b80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:47.068165 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2ce3d-3ef5-4a0e-8557-941111660b80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:47.069679 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2ce3d-3ef5-4a0e-8557-941111660b80 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:47.071577 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 51/103] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:04:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:47.078192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2ce3d-3ef5-4a0e-8557-941111660b80 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:47.207404 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eedb7b1-c0da-4da9-9d2a-2294ca6fbffc None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:47.227809 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:47.231021 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2ce3d-3ef5-4a0e-8557-941111660b80 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:47.233989 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:47.249106 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6890f6-abf6-43ee-98dd-93b9138df968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:47.249912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6890f6-abf6-43ee-98dd-93b9138df968 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:47.250018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6890f6-abf6-43ee-98dd-93b9138df968 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:47.250302 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6890f6-abf6-43ee-98dd-93b9138df968 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:47.250999 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6890f6-abf6-43ee-98dd-93b9138df968 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:47.251310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6890f6-abf6-43ee-98dd-93b9138df968 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:47.252747 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6890f6-abf6-43ee-98dd-93b9138df968 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:47.265169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 53/104] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 23 04:04:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:47.267941 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29899ff-064c-43f2-bfd8-5a530f732ebc None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:47.267941 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29899ff-064c-43f2-bfd8-5a530f732ebc None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:47.267941 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29899ff-064c-43f2-bfd8-5a530f732ebc None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:47.269650 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 54/105] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:04:47.270952 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac3eb7-78e6-4d4b-a0b2-96822e83fbc7 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:47.272480 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac3eb7-78e6-4d4b-a0b2-96822e83fbc7 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:47.273612 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac3eb7-78e6-4d4b-a0b2-96822e83fbc7 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:47.275658 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 55/106] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:04:47.277271 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac3eb7-78e6-4d4b-a0b2-96822e83fbc7 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:47.282751 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055bd346-be48-465d-b0a9-61861e5d229d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:47.283457 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bd346-be48-465d-b0a9-61861e5d229d None admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:47.283843 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bd346-be48-465d-b0a9-61861e5d229d None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:47.284196 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bd346-be48-465d-b0a9-61861e5d229d None admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:47.284937 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055bd346-be48-465d-b0a9-61861e5d229d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:47.286815 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055bd346-be48-465d-b0a9-61861e5d229d None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:47.379491 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 52/107] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 23 04:04:47 2022] POST /identity/v3/projects => generated 302 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:04:47.384869 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc00de-5636-4eb1-98a9-4f5e73af587a None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:47.384869 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc00de-5636-4eb1-98a9-4f5e73af587a None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:47.384869 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc00de-5636-4eb1-98a9-4f5e73af587a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:47.417956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-92dc00de-5636-4eb1-98a9-4f5e73af587a None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:47.419543 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac3eb7-78e6-4d4b-a0b2-96822e83fbc7 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:47.422144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-92dc00de-5636-4eb1-98a9-4f5e73af587a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:47.489212 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11966d0-c4b0-400f-a0c2-d3e069d5ca94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:47.490973 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11966d0-c4b0-400f-a0c2-d3e069d5ca94 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:47.491263 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11966d0-c4b0-400f-a0c2-d3e069d5ca94 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:47.491544 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11966d0-c4b0-400f-a0c2-d3e069d5ca94 None admin] PATH_INFO: `/v3/users/b5a3de6a55f042c2bfc387c162cfeec8` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:47.520854 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11966d0-c4b0-400f-a0c2-d3e069d5ca94 None admin] RBAC: Authorizing `identity:get_user(user_id=b5a3de6a55f042c2bfc387c162cfeec8)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:47.522743 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11966d0-c4b0-400f-a0c2-d3e069d5ca94 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:47.524914 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 56/108] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:04:47 2022] GET /identity/v3/users/b5a3de6a55f042c2bfc387c162cfeec8 => generated 289 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:47.526367 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f32f2-f25b-4750-8a67-3e2257ca6ba1 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:47.527703 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f32f2-f25b-4750-8a67-3e2257ca6ba1 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:47.528185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f32f2-f25b-4750-8a67-3e2257ca6ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:47.537942 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 53/109] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:04:47.546232 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc00de-5636-4eb1-98a9-4f5e73af587a None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:47.568938 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-b17f32f2-f25b-4750-8a67-3e2257ca6ba1 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:47.570509 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-b17f32f2-f25b-4750-8a67-3e2257ca6ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:47.601946 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:47.662398 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:47.678759 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc00de-5636-4eb1-98a9-4f5e73af587a None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:47.702363 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 57/110] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:04:47.724656 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd104a-2958-421d-b1e6-16d4aa899619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:47.725309 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd104a-2958-421d-b1e6-16d4aa899619 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:47.725596 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd104a-2958-421d-b1e6-16d4aa899619 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:47.725875 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd104a-2958-421d-b1e6-16d4aa899619 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:47.799490 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd104a-2958-421d-b1e6-16d4aa899619 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:47.800971 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd104a-2958-421d-b1e6-16d4aa899619 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:47.891072 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:47.911713 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 54/111] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:04:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:04:47.915545 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f32f2-f25b-4750-8a67-3e2257ca6ba1 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:47.931971 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd104a-2958-421d-b1e6-16d4aa899619 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:48.040618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd104a-2958-421d-b1e6-16d4aa899619 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:48.044827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f32f2-f25b-4750-8a67-3e2257ca6ba1 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:48.077912 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de2351-eae6-4400-9d80-21fbc666a6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:48.078795 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de2351-eae6-4400-9d80-21fbc666a6b3 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:48.079224 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de2351-eae6-4400-9d80-21fbc666a6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:48.079669 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de2351-eae6-4400-9d80-21fbc666a6b3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:48.082199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43dace-e792-4057-a31a-c3df791dfd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:48.083070 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43dace-e792-4057-a31a-c3df791dfd74 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:48.083496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43dace-e792-4057-a31a-c3df791dfd74 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:48.083910 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43dace-e792-4057-a31a-c3df791dfd74 None admin] PATH_INFO: `/v3/projects/3371d174840948c183eab2505d3b2776` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:48.085214 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43dace-e792-4057-a31a-c3df791dfd74 None admin] RBAC: Authorizing `identity:get_project(project_id=3371d174840948c183eab2505d3b2776)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:48.086928 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43dace-e792-4057-a31a-c3df791dfd74 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:48.089184 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 58/112] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:04:47 2022] GET /identity/v3/projects/3371d174840948c183eab2505d3b2776 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:48.091018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b39fc-bbe9-459a-8f86-7d6d75fc2a01 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:48.091445 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b39fc-bbe9-459a-8f86-7d6d75fc2a01 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:48.091860 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b39fc-bbe9-459a-8f86-7d6d75fc2a01 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:48.093319 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 59/113] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:04:48.098290 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1eaff6-f99a-458b-a30f-50772959dbfb None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:48.098428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de2351-eae6-4400-9d80-21fbc666a6b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:04:48.098879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1eaff6-f99a-458b-a30f-50772959dbfb None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:48.099310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1eaff6-f99a-458b-a30f-50772959dbfb None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:48.100699 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 60/114] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:04:48.101665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-d1de2351-eae6-4400-9d80-21fbc666a6b3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 04:04:48.101665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:04:48.101665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:04:48.101665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:04:48.101665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:04:48.101665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:04:48.101665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:04:48.101665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:04:48.101665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:04:48.101665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:04:48.101665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:04:48.101665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:04:48.101665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:04:48.101665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:04:48.101665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:04:48.101665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:04:48.102705 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:04:48.102705 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:04:48.102705 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:04:48.102705 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:04:48.102705 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:04:48.102705 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:04:48.102705 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:04:48.102705 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:04:48.102705 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:04:48.102705 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:04:48.102705 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:04:48.102705 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:04:48.102705 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:04:48.102705 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:04:48.102705 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:04:48.102705 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:04:48.103640 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:04:48.103640 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:04:48.103640 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:04:48.103640 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:04:48.103640 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:04:48.103640 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:04:48.103640 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:04:48.103640 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:04:48.103640 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:04:48.103640 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:04:48.103640 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 04:04:48.103640 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:04:48.103640 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 55/115] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 23 04:04:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:04:48.103640 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de2351-eae6-4400-9d80-21fbc666a6b3 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:48.104990 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcd217-d700-479b-8a48-5ea6c7998f15 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:48.105445 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcd217-d700-479b-8a48-5ea6c7998f15 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:48.105968 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcd217-d700-479b-8a48-5ea6c7998f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:48.124910 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-33bcd217-d700-479b-8a48-5ea6c7998f15 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:48.126453 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-33bcd217-d700-479b-8a48-5ea6c7998f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:48.155892 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:48.159398 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:48.201181 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 61/116] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:04:48.202427 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214d317-4406-4bd0-8050-28deb417d24f None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:48.202716 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214d317-4406-4bd0-8050-28deb417d24f None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:48.202995 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214d317-4406-4bd0-8050-28deb417d24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:48.219684 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de2351-eae6-4400-9d80-21fbc666a6b3 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:48.232526 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-e214d317-4406-4bd0-8050-28deb417d24f None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:48.234484 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-e214d317-4406-4bd0-8050-28deb417d24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:48.255908 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589d515-a4b8-49bd-8ae9-495502d8f15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:48.256615 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589d515-a4b8-49bd-8ae9-495502d8f15b None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:48.256974 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589d515-a4b8-49bd-8ae9-495502d8f15b None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:48.257344 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589d515-a4b8-49bd-8ae9-495502d8f15b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:48.258152 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589d515-a4b8-49bd-8ae9-495502d8f15b None admin] RBAC: Adding query filter params (role.id=7fc47a10f402467489b6123c3cb7e260, scope.project.id=3371d174840948c183eab2505d3b2776, user.id=b5a3de6a55f042c2bfc387c162cfeec8) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:48.258529 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589d515-a4b8-49bd-8ae9-495502d8f15b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:48.260099 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589d515-a4b8-49bd-8ae9-495502d8f15b None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:48.273312 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 56/117] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:04:48 2022] GET /identity/v3/role_assignments?user.id=b5a3de6a55f042c2bfc387c162cfeec8&scope.project.id=3371d174840948c183eab2505d3b2776&role.id=7fc47a10f402467489b6123c3cb7e260 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:48.274382 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589d515-a4b8-49bd-8ae9-495502d8f15b None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:48.320624 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 62/118] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:04:48.328219 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214d317-4406-4bd0-8050-28deb417d24f None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:48.504082 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:48.509638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214d317-4406-4bd0-8050-28deb417d24f None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:48.543571 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589d515-a4b8-49bd-8ae9-495502d8f15b None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:48.550976 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fcab5-bc78-4dfb-b9dd-4f1e256e08bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:48.551905 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fcab5-bc78-4dfb-b9dd-4f1e256e08bd None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:48.552382 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fcab5-bc78-4dfb-b9dd-4f1e256e08bd None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:48.552872 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fcab5-bc78-4dfb-b9dd-4f1e256e08bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:48.561418 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:48.565451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fcab5-bc78-4dfb-b9dd-4f1e256e08bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:04:48.570870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-328fcab5-bc78-4dfb-b9dd-4f1e256e08bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:04:48.570870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:04:48.570870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:04:48.570870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:04:48.570870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:04:48.570870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:04:48.570870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:04:48.570870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:04:48.570870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:04:48.570870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:04:48.570870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:04:48.570870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:04:48.570870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:04:48.570870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:04:48.570870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:04:48.570870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:04:48.576868 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:04:48.576868 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:04:48.576868 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:04:48.576868 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:04:48.576868 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:04:48.576868 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:04:48.576868 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:04:48.576868 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:04:48.576868 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:04:48.576868 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:04:48.576868 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:04:48.576868 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:04:48.576868 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:04:48.576868 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:04:48.576868 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:04:48.576868 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:04:48.577742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:04:48.577742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:04:48.577742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:04:48.577742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:04:48.577742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:04:48.577742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:04:48.577742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:04:48.577742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:04:48.577742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:04:48.577742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:04:48.577742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:04:48.577742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:04:48.577742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 63/119] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:04:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:04:48.577742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fcab5-bc78-4dfb-b9dd-4f1e256e08bd None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:48.673847 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf459eda-d389-48ec-be67-43dc1139ddd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:48.674494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf459eda-d389-48ec-be67-43dc1139ddd7 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:48.674789 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf459eda-d389-48ec-be67-43dc1139ddd7 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:48.675076 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf459eda-d389-48ec-be67-43dc1139ddd7 None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:48.675770 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf459eda-d389-48ec-be67-43dc1139ddd7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:48.676081 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf459eda-d389-48ec-be67-43dc1139ddd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:48.677520 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf459eda-d389-48ec-be67-43dc1139ddd7 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:48.683987 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fcab5-bc78-4dfb-b9dd-4f1e256e08bd None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:48.703327 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 57/120] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:04:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:48.704208 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf459eda-d389-48ec-be67-43dc1139ddd7 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:48.726477 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3b075-1bc8-48e0-9699-52fe4e814462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:48.727181 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3b075-1bc8-48e0-9699-52fe4e814462 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:48.727475 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3b075-1bc8-48e0-9699-52fe4e814462 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:48.727755 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3b075-1bc8-48e0-9699-52fe4e814462 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:48.739397 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec3b075-1bc8-48e0-9699-52fe4e814462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:04:48.745069 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-5ec3b075-1bc8-48e0-9699-52fe4e814462 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:04:48.745069 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:04:48.745069 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:04:48.745069 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:04:48.745069 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:04:48.745069 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:04:48.745069 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:04:48.745069 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:04:48.745069 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:04:48.745069 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:04:48.745069 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:04:48.745069 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:04:48.745069 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:04:48.745069 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:04:48.745069 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:04:48.745069 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:04:48.746018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:04:48.746018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:04:48.746018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:04:48.746018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:04:48.746018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:04:48.746018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:04:48.746018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:04:48.746018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:04:48.746018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:04:48.746018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:04:48.746018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:04:48.746018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:04:48.746018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:04:48.746018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:04:48.746018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:04:48.746018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:04:48.746798 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:04:48.746798 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:04:48.746798 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:04:48.746798 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:04:48.746798 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:04:48.746798 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:04:48.746798 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:04:48.746798 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:04:48.746798 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:04:48.746798 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:04:48.746798 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:04:48.746798 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:04:48.746798 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 64/121] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:04:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:04:48.747433 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3b075-1bc8-48e0-9699-52fe4e814462 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:48.768661 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:48.867023 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf459eda-d389-48ec-be67-43dc1139ddd7 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:48.867212 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3b075-1bc8-48e0-9699-52fe4e814462 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:48.902987 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a9146-6dd5-442d-a9b0-806164576526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:48.903635 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a9146-6dd5-442d-a9b0-806164576526 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:48.903920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a9146-6dd5-442d-a9b0-806164576526 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:48.904197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a9146-6dd5-442d-a9b0-806164576526 None admin] PATH_INFO: `/v3/users/93456d60ff574c9a8ee4661d1bbe9633` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:48.905440 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a9146-6dd5-442d-a9b0-806164576526 None admin] RBAC: Authorizing `identity:get_user(user_id=93456d60ff574c9a8ee4661d1bbe9633)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:48.906896 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a9146-6dd5-442d-a9b0-806164576526 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:48.908708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 65/122] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:04:48 2022] GET /identity/v3/users/93456d60ff574c9a8ee4661d1bbe9633 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:48.913951 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a9146-6dd5-442d-a9b0-806164576526 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:48.916447 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c12d9d-6ffa-4db4-bb39-7f8e08272b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:48.918598 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c12d9d-6ffa-4db4-bb39-7f8e08272b65 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:48.919102 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c12d9d-6ffa-4db4-bb39-7f8e08272b65 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:48.919583 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c12d9d-6ffa-4db4-bb39-7f8e08272b65 None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:48.920491 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c12d9d-6ffa-4db4-bb39-7f8e08272b65 None admin] RBAC: Adding query filter params (name=member) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:48.921001 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c12d9d-6ffa-4db4-bb39-7f8e08272b65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:48.922626 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c12d9d-6ffa-4db4-bb39-7f8e08272b65 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:48.935411 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 58/123] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 23 04:04:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:48.941885 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c12d9d-6ffa-4db4-bb39-7f8e08272b65 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:48.991334 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:49.015669 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:49.037732 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a9146-6dd5-442d-a9b0-806164576526 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:49.077196 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c12d9d-6ffa-4db4-bb39-7f8e08272b65 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:49.085269 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb522f-dee5-4859-b5e1-3bb0b2faa996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:49.086151 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb522f-dee5-4859-b5e1-3bb0b2faa996 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:49.086622 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb522f-dee5-4859-b5e1-3bb0b2faa996 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:49.087567 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb522f-dee5-4859-b5e1-3bb0b2faa996 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:49.102096 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb522f-dee5-4859-b5e1-3bb0b2faa996 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:04:49.110799 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-1fcb522f-dee5-4859-b5e1-3bb0b2faa996 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:04:49.110799 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:04:49.110799 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:04:49.110799 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:04:49.110799 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:04:49.110799 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:04:49.110799 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:04:49.110799 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:04:49.110799 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:04:49.110799 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:04:49.110799 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:04:49.110799 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:04:49.110799 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:04:49.110799 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:04:49.110799 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:04:49.110799 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:04:49.111692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:04:49.111692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:04:49.111692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:04:49.111692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:04:49.111692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:04:49.111692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:04:49.111692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:04:49.111692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:04:49.111692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:04:49.111692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:04:49.111692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:04:49.111692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:04:49.111692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:04:49.111692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:04:49.111692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:04:49.111692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:04:49.112473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:04:49.112473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:04:49.112473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:04:49.112473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:04:49.112473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:04:49.112473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:04:49.112473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:04:49.112473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:04:49.112473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:04:49.112473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:04:49.112473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:04:49.112473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:04:49.119177 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 66/124] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:04:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:04:49.119177 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb522f-dee5-4859-b5e1-3bb0b2faa996 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:49.119370 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f7872-063d-4a84-bebd-60a920eb7144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:49.119370 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f7872-063d-4a84-bebd-60a920eb7144 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:49.119370 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f7872-063d-4a84-bebd-60a920eb7144 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:49.119370 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f7872-063d-4a84-bebd-60a920eb7144 None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:49.119650 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f7872-063d-4a84-bebd-60a920eb7144 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:49.119881 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f7872-063d-4a84-bebd-60a920eb7144 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:49.122583 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f7872-063d-4a84-bebd-60a920eb7144 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:49.134217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 59/125] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:04:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:49.136631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f7872-063d-4a84-bebd-60a920eb7144 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:49.240245 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb522f-dee5-4859-b5e1-3bb0b2faa996 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:49.249403 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:49.257831 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f7872-063d-4a84-bebd-60a920eb7144 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:49.282994 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c9af1-63cd-4731-899b-c2a3dc6be033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:49.283706 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c9af1-63cd-4731-899b-c2a3dc6be033 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:49.283996 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c9af1-63cd-4731-899b-c2a3dc6be033 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:49.284273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c9af1-63cd-4731-899b-c2a3dc6be033 None admin] PATH_INFO: `/v3/projects/3371d174840948c183eab2505d3b2776` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:49.285458 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c9af1-63cd-4731-899b-c2a3dc6be033 None admin] RBAC: Authorizing `identity:get_project(project_id=3371d174840948c183eab2505d3b2776)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:49.286956 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c9af1-63cd-4731-899b-c2a3dc6be033 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:49.288920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 67/126] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:04:49 2022] GET /identity/v3/projects/3371d174840948c183eab2505d3b2776 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:49.294463 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c9af1-63cd-4731-899b-c2a3dc6be033 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:49.303971 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc222ac1-e5e5-4aaf-9456-b5587b30d69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:49.305488 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc222ac1-e5e5-4aaf-9456-b5587b30d69e None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:49.306031 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc222ac1-e5e5-4aaf-9456-b5587b30d69e None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:49.306546 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc222ac1-e5e5-4aaf-9456-b5587b30d69e None admin] PATH_INFO: `/v3/users/93456d60ff574c9a8ee4661d1bbe9633` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:49.307775 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:49.309869 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc222ac1-e5e5-4aaf-9456-b5587b30d69e None admin] RBAC: Authorizing `identity:get_user(user_id=93456d60ff574c9a8ee4661d1bbe9633)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:49.311942 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc222ac1-e5e5-4aaf-9456-b5587b30d69e None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:49.314611 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 60/127] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:04:49 2022] GET /identity/v3/users/93456d60ff574c9a8ee4661d1bbe9633 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:49.320730 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc222ac1-e5e5-4aaf-9456-b5587b30d69e None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:49.408210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c9af1-63cd-4731-899b-c2a3dc6be033 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:49.439787 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc222ac1-e5e5-4aaf-9456-b5587b30d69e None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:49.450124 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c55599-6bef-49dd-b6fc-7041c28a1493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:49.451446 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c55599-6bef-49dd-b6fc-7041c28a1493 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:49.452318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c55599-6bef-49dd-b6fc-7041c28a1493 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:49.452926 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c55599-6bef-49dd-b6fc-7041c28a1493 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:49.454084 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c55599-6bef-49dd-b6fc-7041c28a1493 None admin] RBAC: Adding query filter params (name=member) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:49.454576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c55599-6bef-49dd-b6fc-7041c28a1493 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:49.456879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c55599-6bef-49dd-b6fc-7041c28a1493 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:49.469971 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 68/128] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 23 04:04:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:49.471246 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c55599-6bef-49dd-b6fc-7041c28a1493 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:49.486455 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b22fd-8110-44e7-a725-2e8fbd775e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:49.487205 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b22fd-8110-44e7-a725-2e8fbd775e71 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:49.487610 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b22fd-8110-44e7-a725-2e8fbd775e71 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:49.487961 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b22fd-8110-44e7-a725-2e8fbd775e71 None admin] PATH_INFO: `/v3/users/54d7bb4b588246d59feaf1dfc8886cde` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:49.489408 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b22fd-8110-44e7-a725-2e8fbd775e71 None admin] RBAC: Authorizing `identity:get_user(user_id=54d7bb4b588246d59feaf1dfc8886cde)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:49.491010 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b22fd-8110-44e7-a725-2e8fbd775e71 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:49.492937 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 61/129] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:04:49 2022] GET /identity/v3/users/54d7bb4b588246d59feaf1dfc8886cde => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:49.493822 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b22fd-8110-44e7-a725-2e8fbd775e71 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:49.530086 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:49.561465 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:49.601472 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c55599-6bef-49dd-b6fc-7041c28a1493 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:49.607145 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b22fd-8110-44e7-a725-2e8fbd775e71 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:49.644097 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70861ad6-ee0a-4c6a-a6cd-d082e1aa9346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:49.644301 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b4fcf-ca68-4e64-82f3-5c7364cdb944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:49.644879 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b4fcf-ca68-4e64-82f3-5c7364cdb944 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:49.645260 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b4fcf-ca68-4e64-82f3-5c7364cdb944 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:49.645614 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b4fcf-ca68-4e64-82f3-5c7364cdb944 None admin] PATH_INFO: `/v3/projects/3371d174840948c183eab2505d3b2776` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:49.645966 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70861ad6-ee0a-4c6a-a6cd-d082e1aa9346 None admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:49.646518 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70861ad6-ee0a-4c6a-a6cd-d082e1aa9346 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:49.646964 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70861ad6-ee0a-4c6a-a6cd-d082e1aa9346 None admin] PATH_INFO: `/v3/projects/3371d174840948c183eab2505d3b2776/users/93456d60ff574c9a8ee4661d1bbe9633/roles/5434f93251a0417c890b94b90b40ab71` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:49.647078 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b4fcf-ca68-4e64-82f3-5c7364cdb944 None admin] RBAC: Authorizing `identity:get_project(project_id=3371d174840948c183eab2505d3b2776)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:49.648893 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b4fcf-ca68-4e64-82f3-5c7364cdb944 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:49.649645 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70861ad6-ee0a-4c6a-a6cd-d082e1aa9346 None admin] RBAC: Authorizing `identity:create_grant(project_id=3371d174840948c183eab2505d3b2776, user_id=93456d60ff574c9a8ee4661d1bbe9633, role_id=5434f93251a0417c890b94b90b40ab71)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:49.650909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 62/130] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:04:49 2022] GET /identity/v3/projects/3371d174840948c183eab2505d3b2776 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:49.652331 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70861ad6-ee0a-4c6a-a6cd-d082e1aa9346 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:49.657159 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b4fcf-ca68-4e64-82f3-5c7364cdb944 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:49.724478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 69/131] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 23 04:04:49 2022] PUT /identity/v3/projects/3371d174840948c183eab2505d3b2776/users/93456d60ff574c9a8ee4661d1bbe9633/roles/5434f93251a0417c890b94b90b40ab71 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:04:49.730361 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70861ad6-ee0a-4c6a-a6cd-d082e1aa9346 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:49.799795 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:49.803836 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b4fcf-ca68-4e64-82f3-5c7364cdb944 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:49.850317 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa94534-3222-4a47-8ce9-b5bd0186a2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:49.850996 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa94534-3222-4a47-8ce9-b5bd0186a2b7 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:49.851400 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa94534-3222-4a47-8ce9-b5bd0186a2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:49.851750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa94534-3222-4a47-8ce9-b5bd0186a2b7 None admin] PATH_INFO: `/v3/users/93456d60ff574c9a8ee4661d1bbe9633` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:49.853340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa94534-3222-4a47-8ce9-b5bd0186a2b7 None admin] RBAC: Authorizing `identity:get_user(user_id=93456d60ff574c9a8ee4661d1bbe9633)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:49.863000 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa94534-3222-4a47-8ce9-b5bd0186a2b7 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:49.863000 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 63/132] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:04:49 2022] GET /identity/v3/users/93456d60ff574c9a8ee4661d1bbe9633 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:49.863000 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa94534-3222-4a47-8ce9-b5bd0186a2b7 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:49.919176 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70861ad6-ee0a-4c6a-a6cd-d082e1aa9346 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:49.970070 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78619fe-53bd-43dc-9583-ec44b1d5d955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:49.971287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78619fe-53bd-43dc-9583-ec44b1d5d955 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:49.972241 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78619fe-53bd-43dc-9583-ec44b1d5d955 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:49.973023 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78619fe-53bd-43dc-9583-ec44b1d5d955 None admin] PATH_INFO: `/v3/projects/3371d174840948c183eab2505d3b2776` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:49.977335 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:49.978376 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78619fe-53bd-43dc-9583-ec44b1d5d955 None admin] RBAC: Authorizing `identity:get_project(project_id=3371d174840948c183eab2505d3b2776)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:49.980500 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78619fe-53bd-43dc-9583-ec44b1d5d955 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:49.983430 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 70/133] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:04:49 2022] GET /identity/v3/projects/3371d174840948c183eab2505d3b2776 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:49.988111 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43d7e5-d222-4fbb-a9af-db3e7dd9010f None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:49.988111 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43d7e5-d222-4fbb-a9af-db3e7dd9010f None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:49.988111 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43d7e5-d222-4fbb-a9af-db3e7dd9010f None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:49.988111 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 71/134] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:04:49.988111 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43d7e5-d222-4fbb-a9af-db3e7dd9010f None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:50.006930 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa94534-3222-4a47-8ce9-b5bd0186a2b7 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:50.055016 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b438c8-a00d-4c36-9f98-0edc29b343ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:50.056072 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b438c8-a00d-4c36-9f98-0edc29b343ea None admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:50.056210 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b438c8-a00d-4c36-9f98-0edc29b343ea None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:50.056390 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b438c8-a00d-4c36-9f98-0edc29b343ea None admin] PATH_INFO: `/v3/projects/3371d174840948c183eab2505d3b2776/users/93456d60ff574c9a8ee4661d1bbe9633/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:50.058621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b438c8-a00d-4c36-9f98-0edc29b343ea None admin] RBAC: Authorizing `identity:create_grant(project_id=3371d174840948c183eab2505d3b2776, user_id=93456d60ff574c9a8ee4661d1bbe9633, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:50.060186 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b438c8-a00d-4c36-9f98-0edc29b343ea None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:50.110135 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43d7e5-d222-4fbb-a9af-db3e7dd9010f None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:50.133804 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 64/135] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 23 04:04:49 2022] PUT /identity/v3/projects/3371d174840948c183eab2505d3b2776/users/93456d60ff574c9a8ee4661d1bbe9633/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:04:50.134938 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b438c8-a00d-4c36-9f98-0edc29b343ea None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:50.148265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68f506-4faa-4b86-939a-5a6e58d8329b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:50.149460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68f506-4faa-4b86-939a-5a6e58d8329b None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:50.149971 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68f506-4faa-4b86-939a-5a6e58d8329b None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:50.150442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68f506-4faa-4b86-939a-5a6e58d8329b None admin] PATH_INFO: `/v3/projects/9dc57ab50a454ffd926916aec30dcc11` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:50.152399 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c68f506-4faa-4b86-939a-5a6e58d8329b None admin] RBAC: Authorizing `identity:get_project(project_id=9dc57ab50a454ffd926916aec30dcc11)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:50.154151 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c68f506-4faa-4b86-939a-5a6e58d8329b None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:50.156472 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 72/136] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:04:49 2022] GET /identity/v3/projects/9dc57ab50a454ffd926916aec30dcc11 => generated 312 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:50.163124 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646058d5-f021-4a63-8748-bb426fadf3b7 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:50.163774 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646058d5-f021-4a63-8748-bb426fadf3b7 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:50.164274 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646058d5-f021-4a63-8748-bb426fadf3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:50.172830 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:50.194358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-646058d5-f021-4a63-8748-bb426fadf3b7 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:50.195935 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-646058d5-f021-4a63-8748-bb426fadf3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:50.266028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b438c8-a00d-4c36-9f98-0edc29b343ea None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:50.305582 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506d7a6-4fae-4da1-bf03-30b5fa8a5604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:50.306378 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506d7a6-4fae-4da1-bf03-30b5fa8a5604 None admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:50.306671 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506d7a6-4fae-4da1-bf03-30b5fa8a5604 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:50.306957 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506d7a6-4fae-4da1-bf03-30b5fa8a5604 None admin] PATH_INFO: `/v3/projects/3371d174840948c183eab2505d3b2776/users/54d7bb4b588246d59feaf1dfc8886cde/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:50.309479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506d7a6-4fae-4da1-bf03-30b5fa8a5604 None admin] RBAC: Authorizing `identity:create_grant(project_id=3371d174840948c183eab2505d3b2776, user_id=54d7bb4b588246d59feaf1dfc8886cde, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:50.311641 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506d7a6-4fae-4da1-bf03-30b5fa8a5604 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:50.335450 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:50.343829 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 73/137] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:04:50.344676 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646058d5-f021-4a63-8748-bb426fadf3b7 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:50.380476 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 65/138] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 23 04:04:50 2022] PUT /identity/v3/projects/3371d174840948c183eab2505d3b2776/users/54d7bb4b588246d59feaf1dfc8886cde/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:04:50.388036 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563ec20-06bb-48c8-b886-39e540451a4c None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:50.388615 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563ec20-06bb-48c8-b886-39e540451a4c None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:50.389067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563ec20-06bb-48c8-b886-39e540451a4c None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:50.393706 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 66/139] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:04:50.399581 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae698f5c-13da-4936-a1a3-9baf13eba64c None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:50.400122 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae698f5c-13da-4936-a1a3-9baf13eba64c None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:50.400771 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae698f5c-13da-4936-a1a3-9baf13eba64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:50.443017 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-ae698f5c-13da-4936-a1a3-9baf13eba64c None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:50.444227 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-ae698f5c-13da-4936-a1a3-9baf13eba64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:50.506619 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646058d5-f021-4a63-8748-bb426fadf3b7 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:50.577138 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253fc0b-5149-4641-9b6f-d30834807351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:50.577831 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253fc0b-5149-4641-9b6f-d30834807351 None admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:50.578111 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253fc0b-5149-4641-9b6f-d30834807351 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:50.578384 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253fc0b-5149-4641-9b6f-d30834807351 None admin] PATH_INFO: `/v3/projects/9dc57ab50a454ffd926916aec30dcc11/users/93456d60ff574c9a8ee4661d1bbe9633/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:50.582487 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c253fc0b-5149-4641-9b6f-d30834807351 None admin] RBAC: Authorizing `identity:create_grant(project_id=9dc57ab50a454ffd926916aec30dcc11, user_id=93456d60ff574c9a8ee4661d1bbe9633, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:50.584260 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 67/140] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:04:50.589801 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c253fc0b-5149-4641-9b6f-d30834807351 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:50.676055 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 74/141] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 23 04:04:50 2022] PUT /identity/v3/projects/9dc57ab50a454ffd926916aec30dcc11/users/93456d60ff574c9a8ee4661d1bbe9633/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:04:50.741071 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae698f5c-13da-4936-a1a3-9baf13eba64c None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:50.763626 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:50.864105 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae698f5c-13da-4936-a1a3-9baf13eba64c None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:50.913814 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6acfcb-4a17-4807-96d4-c6dd0d8689a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:50.914712 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6acfcb-4a17-4807-96d4-c6dd0d8689a7 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:50.915133 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6acfcb-4a17-4807-96d4-c6dd0d8689a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:50.915581 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6acfcb-4a17-4807-96d4-c6dd0d8689a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:50.916899 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6acfcb-4a17-4807-96d4-c6dd0d8689a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:50.919122 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6acfcb-4a17-4807-96d4-c6dd0d8689a7 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:50.921255 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 68/142] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:04:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:50.926575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253fc0b-5149-4641-9b6f-d30834807351 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:50.941010 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6acfcb-4a17-4807-96d4-c6dd0d8689a7 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:51.034647 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:51.110071 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:51.124618 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253fc0b-5149-4641-9b6f-d30834807351 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:51.137303 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6acfcb-4a17-4807-96d4-c6dd0d8689a7 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:51.188108 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ca046-c199-48f9-9a47-5b61935f2688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:51.188652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ca046-c199-48f9-9a47-5b61935f2688 None admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:51.189022 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ca046-c199-48f9-9a47-5b61935f2688 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:51.189321 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ca046-c199-48f9-9a47-5b61935f2688 None admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:51.190054 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ca046-c199-48f9-9a47-5b61935f2688 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:51.191499 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ca046-c199-48f9-9a47-5b61935f2688 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:51.206458 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df688514-cc45-4a7f-bbf1-5a3b12d43335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:51.207103 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df688514-cc45-4a7f-bbf1-5a3b12d43335 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:51.207388 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df688514-cc45-4a7f-bbf1-5a3b12d43335 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:51.207662 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df688514-cc45-4a7f-bbf1-5a3b12d43335 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:51.222275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df688514-cc45-4a7f-bbf1-5a3b12d43335 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:04:51.228314 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-df688514-cc45-4a7f-bbf1-5a3b12d43335 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 04:04:51.228314 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:04:51.228314 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:04:51.228314 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:04:51.228314 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:04:51.228314 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:04:51.228314 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:04:51.228314 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:04:51.228314 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:04:51.228314 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:04:51.228314 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:04:51.228314 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:04:51.228314 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:04:51.228314 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:04:51.228314 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:04:51.228314 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:04:51.229238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:04:51.229238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:04:51.229238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:04:51.229238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:04:51.229238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:04:51.229238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:04:51.229238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:04:51.229238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:04:51.229238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:04:51.229238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:04:51.229238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:04:51.229238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:04:51.229238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:04:51.229238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:04:51.229238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:04:51.229238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:04:51.231074 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:04:51.231074 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:04:51.231074 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:04:51.231074 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:04:51.231074 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:04:51.231074 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:04:51.231074 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:04:51.231074 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:04:51.231074 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:04:51.231074 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:04:51.231074 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 04:04:51.231074 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:04:51.231074 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 69/143] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:04:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:04:51.237879 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df688514-cc45-4a7f-bbf1-5a3b12d43335 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:51.293962 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 75/144] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 23 04:04:50 2022] POST /identity/v3/users => generated 283 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:04:51.366710 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df688514-cc45-4a7f-bbf1-5a3b12d43335 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:51.408616 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112516b6-c3f3-4378-8784-b9f562cdb7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:51.409436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112516b6-c3f3-4378-8784-b9f562cdb7b9 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:51.409819 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112516b6-c3f3-4378-8784-b9f562cdb7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:51.410190 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112516b6-c3f3-4378-8784-b9f562cdb7b9 None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:51.410981 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112516b6-c3f3-4378-8784-b9f562cdb7b9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:51.411401 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112516b6-c3f3-4378-8784-b9f562cdb7b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:51.412929 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112516b6-c3f3-4378-8784-b9f562cdb7b9 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:51.423413 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 70/145] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 23 04:04:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:04:51.429435 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ca046-c199-48f9-9a47-5b61935f2688 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:51.568401 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ca046-c199-48f9-9a47-5b61935f2688 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:51.589711 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:51.610159 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ad5ef-7944-454a-9490-9142536dbeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:51.610963 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ad5ef-7944-454a-9490-9142536dbeee None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:51.611348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ad5ef-7944-454a-9490-9142536dbeee None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:51.611716 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ad5ef-7944-454a-9490-9142536dbeee None admin] PATH_INFO: `/v3/users/b5a3de6a55f042c2bfc387c162cfeec8` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:51.612989 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ad5ef-7944-454a-9490-9142536dbeee None admin] RBAC: Authorizing `identity:get_user(user_id=b5a3de6a55f042c2bfc387c162cfeec8)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:51.614575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ad5ef-7944-454a-9490-9142536dbeee None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:51.616324 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 76/146] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:04:51 2022] GET /identity/v3/users/b5a3de6a55f042c2bfc387c162cfeec8 => generated 289 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:51.622148 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112516b6-c3f3-4378-8784-b9f562cdb7b9 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:51.635570 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:51.731360 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112516b6-c3f3-4378-8784-b9f562cdb7b9 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:51.767206 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b3455-8905-4e5f-bb1e-ed245f455800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:51.767999 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b3455-8905-4e5f-bb1e-ed245f455800 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:51.768378 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b3455-8905-4e5f-bb1e-ed245f455800 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:51.768766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b3455-8905-4e5f-bb1e-ed245f455800 None admin] PATH_INFO: `/v3/projects/3371d174840948c183eab2505d3b2776` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:51.770047 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b3455-8905-4e5f-bb1e-ed245f455800 None admin] RBAC: Authorizing `identity:get_project(project_id=3371d174840948c183eab2505d3b2776)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:51.771586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b3455-8905-4e5f-bb1e-ed245f455800 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:51.773573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 71/147] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:04:51 2022] GET /identity/v3/projects/3371d174840948c183eab2505d3b2776 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:51.779828 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ad5ef-7944-454a-9490-9142536dbeee None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:51.885399 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ad5ef-7944-454a-9490-9142536dbeee None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:51.922053 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38b21b-cfb9-4b4e-9054-c44632e8e73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:51.922888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38b21b-cfb9-4b4e-9054-c44632e8e73d None admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:51.923283 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38b21b-cfb9-4b4e-9054-c44632e8e73d None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:51.923664 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38b21b-cfb9-4b4e-9054-c44632e8e73d None admin] PATH_INFO: `/v3/projects/3371d174840948c183eab2505d3b2776/users/b5a3de6a55f042c2bfc387c162cfeec8/roles/7fc47a10f402467489b6123c3cb7e260` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:51.925696 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38b21b-cfb9-4b4e-9054-c44632e8e73d None admin] RBAC: Authorizing `identity:create_grant(project_id=3371d174840948c183eab2505d3b2776, user_id=b5a3de6a55f042c2bfc387c162cfeec8, role_id=7fc47a10f402467489b6123c3cb7e260)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:51.927263 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38b21b-cfb9-4b4e-9054-c44632e8e73d None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:52.007091 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 77/148] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 23 04:04:51 2022] PUT /identity/v3/projects/3371d174840948c183eab2505d3b2776/users/b5a3de6a55f042c2bfc387c162cfeec8/roles/7fc47a10f402467489b6123c3cb7e260 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:04:52.050676 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f5fb3-4eb4-47f2-825c-2cd2890d6218 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:52.051140 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f5fb3-4eb4-47f2-825c-2cd2890d6218 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:52.051519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f5fb3-4eb4-47f2-825c-2cd2890d6218 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:52.053043 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 72/149] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:04:52.067269 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0790ca4-66ab-48d1-97f7-70f23e9668ee None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:52.067560 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0790ca4-66ab-48d1-97f7-70f23e9668ee None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:52.067841 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0790ca4-66ab-48d1-97f7-70f23e9668ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:52.092096 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-f0790ca4-66ab-48d1-97f7-70f23e9668ee None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:52.093325 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-f0790ca4-66ab-48d1-97f7-70f23e9668ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:52.151777 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:52.188352 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 78/150] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:04:52.711819 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f5fb3-4eb4-47f2-825c-2cd2890d6218 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:52.804471 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7b9fc-4631-4e2b-b494-8d90c287e1e0 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:52.804990 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7b9fc-4631-4e2b-b494-8d90c287e1e0 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:52.805070 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7b9fc-4631-4e2b-b494-8d90c287e1e0 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:52.806710 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 79/151] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:04:52.812799 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246de9ca-efa8-4b49-8288-3dae62446944 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:52.813077 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246de9ca-efa8-4b49-8288-3dae62446944 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:52.813380 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246de9ca-efa8-4b49-8288-3dae62446944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:52.814041 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:52.853655 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f5fb3-4eb4-47f2-825c-2cd2890d6218 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:52.856141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-246de9ca-efa8-4b49-8288-3dae62446944 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:52.857568 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-246de9ca-efa8-4b49-8288-3dae62446944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:52.921718 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce129568-010b-4bd4-b520-61f97ff5cdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:52.923623 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce129568-010b-4bd4-b520-61f97ff5cdc3 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:52.924217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce129568-010b-4bd4-b520-61f97ff5cdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:52.925252 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce129568-010b-4bd4-b520-61f97ff5cdc3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:52.950633 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce129568-010b-4bd4-b520-61f97ff5cdc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:04:52.965688 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-ce129568-010b-4bd4-b520-61f97ff5cdc3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 04:04:52.965688 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:04:52.965688 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:04:52.965688 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:04:52.965688 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:04:52.965688 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:04:52.965688 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:04:52.965688 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:04:52.965688 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:04:52.965688 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:04:52.965688 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:04:52.965688 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:04:52.965688 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:04:52.965688 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:04:52.965688 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:04:52.965688 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:04:52.966551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:04:52.966551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:04:52.966551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:04:52.966551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:04:52.966551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:04:52.966551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:04:52.966551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:04:52.966551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:04:52.966551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:04:52.966551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:04:52.966551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:04:52.966551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:04:52.966551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:04:52.966551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:04:52.966551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:04:52.966551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:04:52.967321 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:04:52.967321 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:04:52.967321 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:04:52.967321 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:04:52.967321 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:04:52.967321 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:04:52.967321 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:04:52.967321 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:04:52.967321 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:04:52.967321 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:04:52.967321 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 04:04:52.967321 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:04:52.969761 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 73/152] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 23 04:04:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:04:52.986586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce129568-010b-4bd4-b520-61f97ff5cdc3 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:53.000662 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 80/153] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 04:04:53.102813 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce129568-010b-4bd4-b520-61f97ff5cdc3 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:53.143998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d84ee1-5ce8-4014-b7e8-1b8ffea9a148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:53.144618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d84ee1-5ce8-4014-b7e8-1b8ffea9a148 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:53.144898 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d84ee1-5ce8-4014-b7e8-1b8ffea9a148 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:53.145192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d84ee1-5ce8-4014-b7e8-1b8ffea9a148 None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:53.145870 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d84ee1-5ce8-4014-b7e8-1b8ffea9a148 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:53.146205 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d84ee1-5ce8-4014-b7e8-1b8ffea9a148 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:53.147551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d84ee1-5ce8-4014-b7e8-1b8ffea9a148 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:53.149903 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:53.158266 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 74/154] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:04:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:53.164091 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246de9ca-efa8-4b49-8288-3dae62446944 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:53.299503 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:53.303085 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246de9ca-efa8-4b49-8288-3dae62446944 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:53.345736 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1310d7-1931-40e9-8b99-555c14facd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:53.346386 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1310d7-1931-40e9-8b99-555c14facd88 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:53.346734 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1310d7-1931-40e9-8b99-555c14facd88 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:53.347011 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1310d7-1931-40e9-8b99-555c14facd88 None admin] PATH_INFO: `/v3/users/93456d60ff574c9a8ee4661d1bbe9633` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:53.348980 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1310d7-1931-40e9-8b99-555c14facd88 None admin] RBAC: Authorizing `identity:get_user(user_id=93456d60ff574c9a8ee4661d1bbe9633)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:53.350480 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1310d7-1931-40e9-8b99-555c14facd88 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:53.352077 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 81/155] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:04:53 2022] GET /identity/v3/users/93456d60ff574c9a8ee4661d1bbe9633 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:53.358312 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d84ee1-5ce8-4014-b7e8-1b8ffea9a148 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:53.474006 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d84ee1-5ce8-4014-b7e8-1b8ffea9a148 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:53.514910 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba7289-4184-4515-ad67-80b9fddfd971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:53.515897 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba7289-4184-4515-ad67-80b9fddfd971 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:53.516562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba7289-4184-4515-ad67-80b9fddfd971 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:53.517041 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba7289-4184-4515-ad67-80b9fddfd971 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:53.592002 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:53.595678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba7289-4184-4515-ad67-80b9fddfd971 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:53.597182 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba7289-4184-4515-ad67-80b9fddfd971 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:53.672230 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b4cd7-f287-481b-8a3f-1bd4915adeae None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:53.672547 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b4cd7-f287-481b-8a3f-1bd4915adeae None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:53.672784 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b4cd7-f287-481b-8a3f-1bd4915adeae None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:53.674217 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 82/156] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 04:04:53.683039 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152f9d7-38af-4963-9bd6-a258706e9d52 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:53.683380 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152f9d7-38af-4963-9bd6-a258706e9d52 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:53.683658 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152f9d7-38af-4963-9bd6-a258706e9d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:53.710094 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-5152f9d7-38af-4963-9bd6-a258706e9d52 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:53.712018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-5152f9d7-38af-4963-9bd6-a258706e9d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:53.756069 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 75/157] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:04:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:04:53.757015 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba7289-4184-4515-ad67-80b9fddfd971 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:53.844214 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 83/158] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:04:53.845372 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152f9d7-38af-4963-9bd6-a258706e9d52 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:53.951604 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:53.963236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba7289-4184-4515-ad67-80b9fddfd971 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:54.019749 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:54.028598 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152f9d7-38af-4963-9bd6-a258706e9d52 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:54.035663 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b3709-f0f1-45dd-88c5-0ff1249344e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:54.036316 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b3709-f0f1-45dd-88c5-0ff1249344e0 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:54.036596 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b3709-f0f1-45dd-88c5-0ff1249344e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:54.036872 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b3709-f0f1-45dd-88c5-0ff1249344e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:54.070054 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b3709-f0f1-45dd-88c5-0ff1249344e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:04:54.075463 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-3a1b3709-f0f1-45dd-88c5-0ff1249344e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:04:54.075463 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:04:54.075463 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:04:54.075463 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:04:54.075463 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:04:54.075463 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:04:54.075463 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:04:54.075463 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:04:54.075463 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:04:54.075463 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:04:54.075463 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:04:54.075463 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:04:54.075463 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:04:54.075463 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:04:54.075463 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:04:54.075463 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:04:54.076612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:04:54.076612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:04:54.076612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:04:54.076612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:04:54.076612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:04:54.076612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:04:54.076612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:04:54.076612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:04:54.076612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:04:54.076612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:04:54.076612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:04:54.076612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:04:54.076612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:04:54.076612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:04:54.076612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:04:54.076612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:04:54.077822 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:04:54.077822 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:04:54.077822 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:04:54.077822 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:04:54.077822 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:04:54.077822 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:04:54.077822 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:04:54.077822 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:04:54.077822 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:04:54.077822 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:04:54.077822 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:04:54.077822 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:04:54.077822 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 76/159] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:04:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:04:54.082384 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b3709-f0f1-45dd-88c5-0ff1249344e0 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:54.094733 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4fd5e-b1d5-4e8c-b103-81f78e5d5be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:54.095667 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4fd5e-b1d5-4e8c-b103-81f78e5d5be8 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:54.096099 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4fd5e-b1d5-4e8c-b103-81f78e5d5be8 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:54.096512 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4fd5e-b1d5-4e8c-b103-81f78e5d5be8 None admin] PATH_INFO: `/v3/projects/3371d174840948c183eab2505d3b2776` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:54.097883 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4fd5e-b1d5-4e8c-b103-81f78e5d5be8 None admin] RBAC: Authorizing `identity:get_project(project_id=3371d174840948c183eab2505d3b2776)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:54.100053 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4fd5e-b1d5-4e8c-b103-81f78e5d5be8 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:54.102474 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 84/160] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:04:53 2022] GET /identity/v3/projects/3371d174840948c183eab2505d3b2776 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:54.110031 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4fd5e-b1d5-4e8c-b103-81f78e5d5be8 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:54.254949 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4fd5e-b1d5-4e8c-b103-81f78e5d5be8 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:54.300392 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15c994-a13b-42aa-9e02-a463a7ca565d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:54.301029 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15c994-a13b-42aa-9e02-a463a7ca565d None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:54.301330 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15c994-a13b-42aa-9e02-a463a7ca565d None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:54.301598 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15c994-a13b-42aa-9e02-a463a7ca565d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:54.302484 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15c994-a13b-42aa-9e02-a463a7ca565d None admin] RBAC: Adding query filter params (role.id=5434f93251a0417c890b94b90b40ab71, scope.project.id=3371d174840948c183eab2505d3b2776, user.id=93456d60ff574c9a8ee4661d1bbe9633) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:54.302784 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15c994-a13b-42aa-9e02-a463a7ca565d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:54.304246 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15c994-a13b-42aa-9e02-a463a7ca565d None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:54.311633 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 85/161] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:04:54 2022] GET /identity/v3/role_assignments?user.id=93456d60ff574c9a8ee4661d1bbe9633&scope.project.id=3371d174840948c183eab2505d3b2776&role.id=5434f93251a0417c890b94b90b40ab71 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:54.312845 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b741d-cd2b-4720-95ad-b3234f657dce None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:54.317210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b741d-cd2b-4720-95ad-b3234f657dce None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:54.317607 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b741d-cd2b-4720-95ad-b3234f657dce None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:54.319235 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 86/162] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:04:54.335314 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602d2d1-59f1-484a-9076-56afe70f7b71 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:54.335612 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602d2d1-59f1-484a-9076-56afe70f7b71 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:54.335873 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602d2d1-59f1-484a-9076-56afe70f7b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:54.337797 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b3709-f0f1-45dd-88c5-0ff1249344e0 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:54.362701 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-c602d2d1-59f1-484a-9076-56afe70f7b71 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:54.363812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-c602d2d1-59f1-484a-9076-56afe70f7b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:54.403304 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:54.409812 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a568a-89b9-4319-81ac-5204cba001e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:54.410450 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a568a-89b9-4319-81ac-5204cba001e2 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:54.410742 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a568a-89b9-4319-81ac-5204cba001e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:54.411022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a568a-89b9-4319-81ac-5204cba001e2 None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:54.411715 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a568a-89b9-4319-81ac-5204cba001e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:54.412023 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a568a-89b9-4319-81ac-5204cba001e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:54.413467 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a568a-89b9-4319-81ac-5204cba001e2 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:54.427755 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 77/163] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 23 04:04:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:04:54.438078 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a568a-89b9-4319-81ac-5204cba001e2 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:54.470524 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:54.474509 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 87/164] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:04:54.577704 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a568a-89b9-4319-81ac-5204cba001e2 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:54.615671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602d2d1-59f1-484a-9076-56afe70f7b71 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:54.624286 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c05f27-cd87-4bab-8046-9669c749c01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:54.625106 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c05f27-cd87-4bab-8046-9669c749c01c None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:54.625484 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c05f27-cd87-4bab-8046-9669c749c01c None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:54.625776 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c05f27-cd87-4bab-8046-9669c749c01c None admin] PATH_INFO: `/v3/users/93456d60ff574c9a8ee4661d1bbe9633` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:54.629848 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c05f27-cd87-4bab-8046-9669c749c01c None admin] RBAC: Authorizing `identity:get_user(user_id=93456d60ff574c9a8ee4661d1bbe9633)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:54.631377 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c05f27-cd87-4bab-8046-9669c749c01c None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:54.633110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 78/165] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:04:54 2022] GET /identity/v3/users/93456d60ff574c9a8ee4661d1bbe9633 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:04:54.638892 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c05f27-cd87-4bab-8046-9669c749c01c None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:54.756356 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:54.762766 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602d2d1-59f1-484a-9076-56afe70f7b71 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:54.769474 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c05f27-cd87-4bab-8046-9669c749c01c None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:54.807062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee45021-433c-4832-afa7-2faf7182ba55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:54.807975 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee45021-433c-4832-afa7-2faf7182ba55 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:54.808394 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee45021-433c-4832-afa7-2faf7182ba55 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:54.808799 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee45021-433c-4832-afa7-2faf7182ba55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:54.815713 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306773a-bd8c-4740-b416-9adb47a9e188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:54.816340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306773a-bd8c-4740-b416-9adb47a9e188 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:54.816628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306773a-bd8c-4740-b416-9adb47a9e188 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:54.816908 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306773a-bd8c-4740-b416-9adb47a9e188 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:54.820607 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee45021-433c-4832-afa7-2faf7182ba55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:04:54.826524 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-3ee45021-433c-4832-afa7-2faf7182ba55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:04:54.826524 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:04:54.826524 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:04:54.826524 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:04:54.826524 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:04:54.826524 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:04:54.826524 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:04:54.826524 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:04:54.826524 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:04:54.826524 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:04:54.826524 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:04:54.826524 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:04:54.826524 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:04:54.826524 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:04:54.826524 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:04:54.826524 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:04:54.827575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:04:54.827575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:04:54.827575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:04:54.827575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:04:54.827575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:04:54.827575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:04:54.827575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:04:54.827575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:04:54.827575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:04:54.827575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:04:54.827575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:04:54.827575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:04:54.827575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:04:54.827575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:04:54.827575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:04:54.827575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:04:54.828709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:04:54.828709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:04:54.828709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:04:54.828709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:04:54.828709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:04:54.828709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:04:54.828709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:04:54.828709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:04:54.828709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:04:54.828709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:04:54.828709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:04:54.828709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:04:54.830736 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 88/166] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:04:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:04:54.860175 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee45021-433c-4832-afa7-2faf7182ba55 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:54.892101 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:54.898816 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306773a-bd8c-4740-b416-9adb47a9e188 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:54.900306 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306773a-bd8c-4740-b416-9adb47a9e188 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:55.062548 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee45021-433c-4832-afa7-2faf7182ba55 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:55.064423 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:55.088370 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 79/167] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:04:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 04:04:55.094282 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306773a-bd8c-4740-b416-9adb47a9e188 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:55.138677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe255de6-2964-422d-9a12-4ebed6dc4fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:55.139301 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe255de6-2964-422d-9a12-4ebed6dc4fbc None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:55.139580 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe255de6-2964-422d-9a12-4ebed6dc4fbc None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:55.139940 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe255de6-2964-422d-9a12-4ebed6dc4fbc None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:55.140656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe255de6-2964-422d-9a12-4ebed6dc4fbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:55.141023 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe255de6-2964-422d-9a12-4ebed6dc4fbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:55.142514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe255de6-2964-422d-9a12-4ebed6dc4fbc None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:55.151993 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 89/168] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:04:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:04:55.152829 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe255de6-2964-422d-9a12-4ebed6dc4fbc None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:55.249439 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306773a-bd8c-4740-b416-9adb47a9e188 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:55.255679 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:55.275769 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe255de6-2964-422d-9a12-4ebed6dc4fbc None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:55.301854 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fec02-8e73-4343-8505-15dd0e027d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:55.302521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fec02-8e73-4343-8505-15dd0e027d2d None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:55.302805 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fec02-8e73-4343-8505-15dd0e027d2d None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:55.303292 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fec02-8e73-4343-8505-15dd0e027d2d None admin] PATH_INFO: `/v3/projects/3371d174840948c183eab2505d3b2776` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:55.304312 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fec02-8e73-4343-8505-15dd0e027d2d None admin] RBAC: Authorizing `identity:get_project(project_id=3371d174840948c183eab2505d3b2776)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:55.305751 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fec02-8e73-4343-8505-15dd0e027d2d None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:55.307849 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 80/169] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:04:55 2022] GET /identity/v3/projects/3371d174840948c183eab2505d3b2776 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:04:55.308447 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fec02-8e73-4343-8505-15dd0e027d2d None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:55.324534 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857ef63-6103-48db-8a15-f493ce13260f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:55.325432 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857ef63-6103-48db-8a15-f493ce13260f None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:55.325951 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857ef63-6103-48db-8a15-f493ce13260f None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:55.326375 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857ef63-6103-48db-8a15-f493ce13260f None admin] PATH_INFO: `/v3/roles/member` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:55.345387 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e857ef63-6103-48db-8a15-f493ce13260f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:04:55.358429 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-e857ef63-6103-48db-8a15-f493ce13260f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:04:55.358429 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:04:55.358429 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:04:55.358429 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:04:55.358429 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:04:55.358429 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:04:55.358429 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:04:55.358429 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:04:55.358429 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:04:55.358429 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:04:55.358429 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:04:55.358429 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:04:55.358429 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:04:55.358429 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:04:55.358429 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:04:55.358429 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:04:55.359473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:04:55.359473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:04:55.359473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:04:55.359473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:04:55.359473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:04:55.359473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:04:55.359473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:04:55.359473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:04:55.359473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:04:55.359473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:04:55.359473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:04:55.359473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:04:55.359473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:04:55.359473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:04:55.359473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:04:55.359473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:04:55.360273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:04:55.360273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:04:55.360273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:04:55.360273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:04:55.360273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:04:55.360273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:04:55.360273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:04:55.360273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:04:55.360273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:04:55.360273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:04:55.360273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:04:55.360273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:04:55.363320 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 90/170] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:04:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:04:55.365611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857ef63-6103-48db-8a15-f493ce13260f None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:55.403511 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:55.455959 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fec02-8e73-4343-8505-15dd0e027d2d None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:55.500911 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65141b-7403-432a-a86d-4d1e8f5b80d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:55.501848 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65141b-7403-432a-a86d-4d1e8f5b80d8 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:55.502274 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65141b-7403-432a-a86d-4d1e8f5b80d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:55.502688 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65141b-7403-432a-a86d-4d1e8f5b80d8 None admin] PATH_INFO: `/v3/users/54d7bb4b588246d59feaf1dfc8886cde` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:55.509982 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65141b-7403-432a-a86d-4d1e8f5b80d8 None admin] RBAC: Authorizing `identity:get_user(user_id=54d7bb4b588246d59feaf1dfc8886cde)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:55.512850 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65141b-7403-432a-a86d-4d1e8f5b80d8 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:55.514861 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 81/171] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:04:55 2022] GET /identity/v3/users/54d7bb4b588246d59feaf1dfc8886cde => generated 247 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:55.515777 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65141b-7403-432a-a86d-4d1e8f5b80d8 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:55.547223 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857ef63-6103-48db-8a15-f493ce13260f None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:55.605388 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11430e-f8d3-41cd-be9e-da92eb560914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:55.605723 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11430e-f8d3-41cd-be9e-da92eb560914 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:55.606006 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11430e-f8d3-41cd-be9e-da92eb560914 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:55.606279 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11430e-f8d3-41cd-be9e-da92eb560914 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:55.607035 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11430e-f8d3-41cd-be9e-da92eb560914 None admin] RBAC: Adding query filter params (role.id=b28fe6f1db4c4738862acb96ff94007c, scope.project.id=3371d174840948c183eab2505d3b2776, user.id=93456d60ff574c9a8ee4661d1bbe9633) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:55.607344 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11430e-f8d3-41cd-be9e-da92eb560914 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:55.608823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11430e-f8d3-41cd-be9e-da92eb560914 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:55.623384 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 91/172] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:04:55 2022] GET /identity/v3/role_assignments?user.id=93456d60ff574c9a8ee4661d1bbe9633&scope.project.id=3371d174840948c183eab2505d3b2776&role.id=b28fe6f1db4c4738862acb96ff94007c => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:55.624259 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11430e-f8d3-41cd-be9e-da92eb560914 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:55.632883 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65141b-7403-432a-a86d-4d1e8f5b80d8 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:55.634121 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:55.661807 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:55.683416 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e66933-9b64-4ecf-afd8-b70b620c6f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:55.684337 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e66933-9b64-4ecf-afd8-b70b620c6f30 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:55.684764 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e66933-9b64-4ecf-afd8-b70b620c6f30 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:55.685594 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e66933-9b64-4ecf-afd8-b70b620c6f30 None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:55.687391 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e66933-9b64-4ecf-afd8-b70b620c6f30 None admin] RBAC: Adding query filter params (name=member) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:55.687868 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e66933-9b64-4ecf-afd8-b70b620c6f30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:55.689519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e66933-9b64-4ecf-afd8-b70b620c6f30 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:55.699525 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 82/173] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 23 04:04:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:55.705281 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e66933-9b64-4ecf-afd8-b70b620c6f30 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:55.772204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11430e-f8d3-41cd-be9e-da92eb560914 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:55.820688 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059d689-3915-4eda-b055-d9851d2045a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:55.821361 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059d689-3915-4eda-b055-d9851d2045a9 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:55.821644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059d689-3915-4eda-b055-d9851d2045a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:55.821935 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059d689-3915-4eda-b055-d9851d2045a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:55.825894 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e66933-9b64-4ecf-afd8-b70b620c6f30 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:55.871363 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cbad6-1603-42fc-bc03-7dfb23c7aae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:55.872957 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cbad6-1603-42fc-bc03-7dfb23c7aae3 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:55.873627 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cbad6-1603-42fc-bc03-7dfb23c7aae3 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:55.874776 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cbad6-1603-42fc-bc03-7dfb23c7aae3 None admin] PATH_INFO: `/v3/users/93456d60ff574c9a8ee4661d1bbe9633` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:55.881811 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cbad6-1603-42fc-bc03-7dfb23c7aae3 None admin] RBAC: Authorizing `identity:get_user(user_id=93456d60ff574c9a8ee4661d1bbe9633)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:55.883895 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cbad6-1603-42fc-bc03-7dfb23c7aae3 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:55.886038 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 83/174] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:04:55 2022] GET /identity/v3/users/93456d60ff574c9a8ee4661d1bbe9633 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:55.888358 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c7282-ffd8-4d8f-99d3-19ddacaafafd None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:55.889622 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c7282-ffd8-4d8f-99d3-19ddacaafafd None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:55.892126 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c7282-ffd8-4d8f-99d3-19ddacaafafd None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:55.894325 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 84/175] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:04:55.899238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c7282-ffd8-4d8f-99d3-19ddacaafafd None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:55.954144 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c059d689-3915-4eda-b055-d9851d2045a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:55.956175 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c059d689-3915-4eda-b055-d9851d2045a9 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:55.967979 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:55.975917 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:56.025403 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c7282-ffd8-4d8f-99d3-19ddacaafafd None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:56.062786 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b67fa9-fa8e-4b3f-88e6-d228f55c53bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:56.063783 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b67fa9-fa8e-4b3f-88e6-d228f55c53bc None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:56.064278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b67fa9-fa8e-4b3f-88e6-d228f55c53bc None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:56.064784 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b67fa9-fa8e-4b3f-88e6-d228f55c53bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:56.139513 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b67fa9-fa8e-4b3f-88e6-d228f55c53bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:56.142265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b67fa9-fa8e-4b3f-88e6-d228f55c53bc None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:56.151950 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 92/176] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:04:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:04:56.158309 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845a709-ccad-47bb-975e-71c3613af7d4 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:56.158572 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845a709-ccad-47bb-975e-71c3613af7d4 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:56.158830 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845a709-ccad-47bb-975e-71c3613af7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:56.180243 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-8845a709-ccad-47bb-975e-71c3613af7d4 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:56.182152 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-8845a709-ccad-47bb-975e-71c3613af7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:56.211643 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:56.255172 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 93/177] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:04:56.256446 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49623134-5901-4b31-a77c-4d77caee36b0 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:56.256734 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49623134-5901-4b31-a77c-4d77caee36b0 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:56.257010 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49623134-5901-4b31-a77c-4d77caee36b0 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:56.258167 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 85/178] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:04:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:04:56.258275 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 94/179] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:04:56.258846 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b67fa9-fa8e-4b3f-88e6-d228f55c53bc None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:56.259321 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943030a8-24b0-4b34-b81a-2d98edf22d21 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:56.259646 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943030a8-24b0-4b34-b81a-2d98edf22d21 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:56.259891 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943030a8-24b0-4b34-b81a-2d98edf22d21 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:56.265149 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 95/180] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:04:56.267169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943030a8-24b0-4b34-b81a-2d98edf22d21 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:56.309474 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:56.371239 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b67fa9-fa8e-4b3f-88e6-d228f55c53bc None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:56.382931 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943030a8-24b0-4b34-b81a-2d98edf22d21 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:56.410316 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045b55f-35d1-4c07-94d1-f6ab064e4a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:56.411181 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045b55f-35d1-4c07-94d1-f6ab064e4a04 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:56.411727 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045b55f-35d1-4c07-94d1-f6ab064e4a04 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:56.412226 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045b55f-35d1-4c07-94d1-f6ab064e4a04 None admin] PATH_INFO: `/v3/projects/3371d174840948c183eab2505d3b2776` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:56.413518 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045b55f-35d1-4c07-94d1-f6ab064e4a04 None admin] RBAC: Authorizing `identity:get_project(project_id=3371d174840948c183eab2505d3b2776)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:56.415334 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045b55f-35d1-4c07-94d1-f6ab064e4a04 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:56.417203 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 86/181] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:04:56 2022] GET /identity/v3/projects/3371d174840948c183eab2505d3b2776 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:56.422452 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d01c1-353b-4b42-bc4e-8b83bd0e6172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:56.422452 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d01c1-353b-4b42-bc4e-8b83bd0e6172 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:56.422452 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d01c1-353b-4b42-bc4e-8b83bd0e6172 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:56.422452 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d01c1-353b-4b42-bc4e-8b83bd0e6172 None admin] PATH_INFO: `/v3/projects/9dc57ab50a454ffd926916aec30dcc11` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:56.423404 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d01c1-353b-4b42-bc4e-8b83bd0e6172 None admin] RBAC: Authorizing `identity:get_project(project_id=9dc57ab50a454ffd926916aec30dcc11)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:56.423771 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706b3a3-305b-434b-8ccd-55a1872ca96b None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:56.424196 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706b3a3-305b-434b-8ccd-55a1872ca96b None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:56.424681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706b3a3-305b-434b-8ccd-55a1872ca96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:56.425157 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d01c1-353b-4b42-bc4e-8b83bd0e6172 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:56.427074 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 96/182] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:04:56 2022] GET /identity/v3/projects/9dc57ab50a454ffd926916aec30dcc11 => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:56.428210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8374b2-9721-4225-b5d1-0b83b8fd2486 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:56.428565 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8374b2-9721-4225-b5d1-0b83b8fd2486 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:56.428910 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8374b2-9721-4225-b5d1-0b83b8fd2486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:56.444971 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-8706b3a3-305b-434b-8ccd-55a1872ca96b None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:56.446438 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-8706b3a3-305b-434b-8ccd-55a1872ca96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:56.448406 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-eb8374b2-9721-4225-b5d1-0b83b8fd2486 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:56.449759 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-eb8374b2-9721-4225-b5d1-0b83b8fd2486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:56.466120 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:56.520381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 87/183] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:04:56.521602 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706b3a3-305b-434b-8ccd-55a1872ca96b None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:56.533887 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 97/184] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:04:56.534757 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8374b2-9721-4225-b5d1-0b83b8fd2486 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:56.593372 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:56.627587 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706b3a3-305b-434b-8ccd-55a1872ca96b None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:56.664987 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8061a-f4fc-44ce-915d-7254ca098cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:56.666030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8061a-f4fc-44ce-915d-7254ca098cfb None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:56.666549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8061a-f4fc-44ce-915d-7254ca098cfb None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:56.667138 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8061a-f4fc-44ce-915d-7254ca098cfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:56.668069 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8061a-f4fc-44ce-915d-7254ca098cfb None admin] RBAC: Adding query filter params (role.id=255d9e4004c54505a7cda1b8af74e5f1, scope.project.id=3371d174840948c183eab2505d3b2776, user.id=54d7bb4b588246d59feaf1dfc8886cde) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:56.668686 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8061a-f4fc-44ce-915d-7254ca098cfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:56.670439 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8061a-f4fc-44ce-915d-7254ca098cfb None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:56.676822 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 88/185] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:04:56 2022] GET /identity/v3/role_assignments?user.id=54d7bb4b588246d59feaf1dfc8886cde&scope.project.id=3371d174840948c183eab2505d3b2776&role.id=255d9e4004c54505a7cda1b8af74e5f1 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:56.683007 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8061a-f4fc-44ce-915d-7254ca098cfb None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:56.709796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:56.711019 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8374b2-9721-4225-b5d1-0b83b8fd2486 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:56.750907 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189afe93-31a4-4deb-bf36-1f494f50591c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:56.751452 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189afe93-31a4-4deb-bf36-1f494f50591c None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:56.751736 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189afe93-31a4-4deb-bf36-1f494f50591c None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:56.752041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189afe93-31a4-4deb-bf36-1f494f50591c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:56.752946 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189afe93-31a4-4deb-bf36-1f494f50591c None admin] RBAC: Adding query filter params (role.id=b28fe6f1db4c4738862acb96ff94007c, scope.project.id=9dc57ab50a454ffd926916aec30dcc11, user.id=93456d60ff574c9a8ee4661d1bbe9633) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:56.753287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189afe93-31a4-4deb-bf36-1f494f50591c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:56.754744 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189afe93-31a4-4deb-bf36-1f494f50591c None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:56.767731 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 98/186] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:04:56 2022] GET /identity/v3/role_assignments?user.id=93456d60ff574c9a8ee4661d1bbe9633&scope.project.id=9dc57ab50a454ffd926916aec30dcc11&role.id=b28fe6f1db4c4738862acb96ff94007c => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:56.767731 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8851a-a30b-4261-9046-ea9f1ccf316c None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:56.767731 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8851a-a30b-4261-9046-ea9f1ccf316c None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:56.767731 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8851a-a30b-4261-9046-ea9f1ccf316c None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:56.769460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 99/187] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:04:56.771419 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee50068-41ae-4e4c-b873-888689f4958b None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:56.771714 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee50068-41ae-4e4c-b873-888689f4958b None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:56.771993 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee50068-41ae-4e4c-b873-888689f4958b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:56.791702 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-fee50068-41ae-4e4c-b873-888689f4958b None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:04:56.792953 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-fee50068-41ae-4e4c-b873-888689f4958b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:04:56.879048 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 100/188] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:04:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 04:04:56.884189 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee50068-41ae-4e4c-b873-888689f4958b None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:56.899361 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8061a-f4fc-44ce-915d-7254ca098cfb None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:56.923141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:56.991223 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09599b-7fc4-4d01-b4a5-2cd8fa743124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:56.991887 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09599b-7fc4-4d01-b4a5-2cd8fa743124 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:56.992172 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09599b-7fc4-4d01-b4a5-2cd8fa743124 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:56.992451 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09599b-7fc4-4d01-b4a5-2cd8fa743124 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:57.011645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad09599b-7fc4-4d01-b4a5-2cd8fa743124 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:04:57.019907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-ad09599b-7fc4-4d01-b4a5-2cd8fa743124 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 04:04:57.019907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:04:57.019907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:04:57.019907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:04:57.019907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:04:57.019907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:04:57.019907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:04:57.019907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:04:57.019907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:04:57.019907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:04:57.019907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:04:57.019907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:04:57.019907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:04:57.019907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:04:57.019907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:04:57.019907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:04:57.020828 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:04:57.020828 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:04:57.020828 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:04:57.020828 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:04:57.020828 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:04:57.020828 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:04:57.020828 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:04:57.020828 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:04:57.020828 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:04:57.020828 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:04:57.020828 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:04:57.020828 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:04:57.020828 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:04:57.020828 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:04:57.020828 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:04:57.020828 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:04:57.021681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:04:57.021681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:04:57.021681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:04:57.021681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:04:57.021681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:04:57.021681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:04:57.021681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:04:57.021681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:04:57.021681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:04:57.021681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:04:57.021681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 04:04:57.021681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:04:57.022283 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee50068-41ae-4e4c-b873-888689f4958b None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:57.022663 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 89/189] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:04:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:04:57.022663 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09599b-7fc4-4d01-b4a5-2cd8fa743124 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:57.068405 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594e7d6-e5fc-4a2f-b593-a743fc121d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:57.069135 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594e7d6-e5fc-4a2f-b593-a743fc121d37 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:57.070333 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594e7d6-e5fc-4a2f-b593-a743fc121d37 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:57.070619 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594e7d6-e5fc-4a2f-b593-a743fc121d37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:57.085623 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9594e7d6-e5fc-4a2f-b593-a743fc121d37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:04:57.092245 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-9594e7d6-e5fc-4a2f-b593-a743fc121d37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:04:57.092245 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:04:57.092245 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:04:57.092245 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:04:57.092245 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:04:57.092245 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:04:57.092245 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:04:57.092245 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:04:57.092245 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:04:57.092245 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:04:57.092245 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:04:57.092245 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:04:57.092245 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:04:57.092245 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:04:57.092245 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:04:57.092245 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:04:57.093398 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:04:57.093398 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:04:57.093398 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:04:57.093398 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:04:57.093398 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:04:57.093398 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:04:57.093398 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:04:57.093398 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:04:57.093398 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:04:57.093398 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:04:57.093398 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:04:57.093398 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:04:57.093398 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:04:57.093398 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:04:57.093398 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:04:57.093398 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:04:57.094220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:04:57.094220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:04:57.094220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:04:57.094220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:04:57.094220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:04:57.094220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:04:57.094220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:04:57.094220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:04:57.094220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:04:57.094220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:04:57.094220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:04:57.094220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:04:57.094220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 101/190] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:04:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:04:57.094220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594e7d6-e5fc-4a2f-b593-a743fc121d37 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:57.122495 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:57.150465 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09599b-7fc4-4d01-b4a5-2cd8fa743124 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:57.193064 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c9b48-946e-4249-9982-0224d48abea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:57.194136 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c9b48-946e-4249-9982-0224d48abea1 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:57.194425 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c9b48-946e-4249-9982-0224d48abea1 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:57.195026 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c9b48-946e-4249-9982-0224d48abea1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:57.204673 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:57.205710 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c9b48-946e-4249-9982-0224d48abea1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:04:57.211185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-458c9b48-946e-4249-9982-0224d48abea1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 04:04:57.211185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:04:57.211185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:04:57.211185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:04:57.211185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:04:57.211185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:04:57.211185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:04:57.211185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:04:57.211185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:04:57.211185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:04:57.211185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:04:57.211185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:04:57.211185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:04:57.211185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:04:57.211185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:04:57.211185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:04:57.217931 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:04:57.217931 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:04:57.217931 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:04:57.217931 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:04:57.217931 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:04:57.217931 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:04:57.217931 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:04:57.217931 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:04:57.217931 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:04:57.217931 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:04:57.217931 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:04:57.217931 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:04:57.217931 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:04:57.217931 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:04:57.217931 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:04:57.217931 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:04:57.218738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:04:57.218738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:04:57.218738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:04:57.218738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:04:57.218738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:04:57.218738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:04:57.218738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:04:57.218738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:04:57.218738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:04:57.218738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:04:57.218738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 04:04:57.218738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:04:57.218738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 90/191] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 23 04:04:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:04:57.218738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c9b48-946e-4249-9982-0224d48abea1 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:57.219456 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594e7d6-e5fc-4a2f-b593-a743fc121d37 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:57.252946 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aef39e-90ad-4693-baad-79e78b1da380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:57.253827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aef39e-90ad-4693-baad-79e78b1da380 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:57.254110 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aef39e-90ad-4693-baad-79e78b1da380 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:57.254387 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aef39e-90ad-4693-baad-79e78b1da380 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:57.255064 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aef39e-90ad-4693-baad-79e78b1da380 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:57.255371 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aef39e-90ad-4693-baad-79e78b1da380 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:57.256772 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aef39e-90ad-4693-baad-79e78b1da380 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:57.264838 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 102/192] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 23 04:04:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:57.265593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aef39e-90ad-4693-baad-79e78b1da380 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:57.316204 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c9b48-946e-4249-9982-0224d48abea1 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:57.348607 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2be6c-6aae-457f-ae87-27cbdb535d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:57.349254 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2be6c-6aae-457f-ae87-27cbdb535d2d None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:57.349538 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2be6c-6aae-457f-ae87-27cbdb535d2d None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:57.349814 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2be6c-6aae-457f-ae87-27cbdb535d2d None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:57.350482 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2be6c-6aae-457f-ae87-27cbdb535d2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:57.350787 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2be6c-6aae-457f-ae87-27cbdb535d2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:57.352183 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2be6c-6aae-457f-ae87-27cbdb535d2d None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:57.354972 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:57.361669 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 91/193] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:04:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:57.364763 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2be6c-6aae-457f-ae87-27cbdb535d2d None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:57.368537 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aef39e-90ad-4693-baad-79e78b1da380 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:57.402098 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f60af8-c07e-4bc8-b050-5176f916b063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:57.402725 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f60af8-c07e-4bc8-b050-5176f916b063 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:57.403030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f60af8-c07e-4bc8-b050-5176f916b063 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:57.403287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f60af8-c07e-4bc8-b050-5176f916b063 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:57.403960 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f60af8-c07e-4bc8-b050-5176f916b063 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:57.404267 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f60af8-c07e-4bc8-b050-5176f916b063 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:57.405688 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f60af8-c07e-4bc8-b050-5176f916b063 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:57.413976 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 103/194] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:04:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:57.419825 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f60af8-c07e-4bc8-b050-5176f916b063 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:57.434753 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:57.459424 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2be6c-6aae-457f-ae87-27cbdb535d2d None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:57.493895 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da2fdd-8909-4d16-878b-1f55d271d725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:57.494553 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da2fdd-8909-4d16-878b-1f55d271d725 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:57.494837 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da2fdd-8909-4d16-878b-1f55d271d725 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:57.495122 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da2fdd-8909-4d16-878b-1f55d271d725 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:57.496228 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da2fdd-8909-4d16-878b-1f55d271d725 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:57.497739 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da2fdd-8909-4d16-878b-1f55d271d725 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:57.499301 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 92/195] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:04:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:57.500064 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da2fdd-8909-4d16-878b-1f55d271d725 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:57.520279 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f60af8-c07e-4bc8-b050-5176f916b063 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:57.553977 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d98e7-4990-4681-ac9e-023b27ce6e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:57.554612 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d98e7-4990-4681-ac9e-023b27ce6e39 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:57.554980 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d98e7-4990-4681-ac9e-023b27ce6e39 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:57.555262 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d98e7-4990-4681-ac9e-023b27ce6e39 None admin] PATH_INFO: `/v3/users/b5a3de6a55f042c2bfc387c162cfeec8` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:57.556401 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d98e7-4990-4681-ac9e-023b27ce6e39 None admin] RBAC: Authorizing `identity:get_user(user_id=b5a3de6a55f042c2bfc387c162cfeec8)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:57.558108 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d98e7-4990-4681-ac9e-023b27ce6e39 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:57.564196 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 104/196] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:04:57 2022] GET /identity/v3/users/b5a3de6a55f042c2bfc387c162cfeec8 => generated 289 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:57.564196 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d98e7-4990-4681-ac9e-023b27ce6e39 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:57.567606 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:57.601113 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da2fdd-8909-4d16-878b-1f55d271d725 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:57.636517 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f0f47-eacb-44ec-988c-f86ac7b3a2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:57.637175 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f0f47-eacb-44ec-988c-f86ac7b3a2ef None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:57.637719 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f0f47-eacb-44ec-988c-f86ac7b3a2ef None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:57.637719 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f0f47-eacb-44ec-988c-f86ac7b3a2ef None admin] PATH_INFO: `/v3/users/8d692ed579b6420d88f0627c232b0006` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:57.640045 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:57.653191 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f0f47-eacb-44ec-988c-f86ac7b3a2ef None admin] RBAC: Authorizing `identity:get_user(user_id=8d692ed579b6420d88f0627c232b0006)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:57.654656 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f0f47-eacb-44ec-988c-f86ac7b3a2ef None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:57.656432 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 93/197] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:04:57 2022] GET /identity/v3/users/8d692ed579b6420d88f0627c232b0006 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:57.657155 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f0f47-eacb-44ec-988c-f86ac7b3a2ef None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:57.659945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d98e7-4990-4681-ac9e-023b27ce6e39 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:57.695564 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a58b7f-2a70-45f7-9f6a-2eb3003c358a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:57.696198 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a58b7f-2a70-45f7-9f6a-2eb3003c358a None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:57.696489 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a58b7f-2a70-45f7-9f6a-2eb3003c358a None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:57.696764 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a58b7f-2a70-45f7-9f6a-2eb3003c358a None admin] PATH_INFO: `/v3/users/8d692ed579b6420d88f0627c232b0006` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:57.698450 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a58b7f-2a70-45f7-9f6a-2eb3003c358a None admin] RBAC: Authorizing `identity:get_user(user_id=8d692ed579b6420d88f0627c232b0006)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:57.699910 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a58b7f-2a70-45f7-9f6a-2eb3003c358a None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:57.701535 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 105/198] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:04:57 2022] GET /identity/v3/users/8d692ed579b6420d88f0627c232b0006 => generated 283 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:57.702304 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a58b7f-2a70-45f7-9f6a-2eb3003c358a None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:57.756443 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f0f47-eacb-44ec-988c-f86ac7b3a2ef None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:57.781008 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:57.791230 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eecd60d-3045-44e8-94a5-509e475949b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:57.791870 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecd60d-3045-44e8-94a5-509e475949b3 None admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:57.792153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecd60d-3045-44e8-94a5-509e475949b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:57.792939 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecd60d-3045-44e8-94a5-509e475949b3 None admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:57.793066 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eecd60d-3045-44e8-94a5-509e475949b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:57.794525 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eecd60d-3045-44e8-94a5-509e475949b3 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:57.804678 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a58b7f-2a70-45f7-9f6a-2eb3003c358a None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:57.838005 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab2c80e-fe38-4b94-af42-18a833d3e9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:57.839270 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2c80e-fe38-4b94-af42-18a833d3e9f1 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:57.839550 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2c80e-fe38-4b94-af42-18a833d3e9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:57.839825 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2c80e-fe38-4b94-af42-18a833d3e9f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:57.856783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:57.905363 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab2c80e-fe38-4b94-af42-18a833d3e9f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:57.906826 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab2c80e-fe38-4b94-af42-18a833d3e9f1 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:57.955001 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 94/199] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 23 04:04:57 2022] POST /identity/v3/users => generated 297 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:04:57.966955 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eecd60d-3045-44e8-94a5-509e475949b3 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:58.011192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 106/200] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:04:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:04:58.012077 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab2c80e-fe38-4b94-af42-18a833d3e9f1 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:58.068858 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:58.090918 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eecd60d-3045-44e8-94a5-509e475949b3 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:58.130563 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ac709-00a8-4c9d-a979-92c164ea9beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:58.131431 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ac709-00a8-4c9d-a979-92c164ea9beb None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:58.131718 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ac709-00a8-4c9d-a979-92c164ea9beb None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:58.131994 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ac709-00a8-4c9d-a979-92c164ea9beb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:58.134852 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab2c80e-fe38-4b94-af42-18a833d3e9f1 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:58.174411 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ad45d-9008-47a0-ae3c-df059c6c0a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:58.175032 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ad45d-9008-47a0-ae3c-df059c6c0a54 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:58.175313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ad45d-9008-47a0-ae3c-df059c6c0a54 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:58.175582 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ad45d-9008-47a0-ae3c-df059c6c0a54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:58.194315 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:58.217392 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ac709-00a8-4c9d-a979-92c164ea9beb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:58.218880 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ac709-00a8-4c9d-a979-92c164ea9beb None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:58.266926 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ad45d-9008-47a0-ae3c-df059c6c0a54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:58.268808 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ad45d-9008-47a0-ae3c-df059c6c0a54 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:58.325670 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:58.341829 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 95/201] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:04:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:04:58.342759 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ac709-00a8-4c9d-a979-92c164ea9beb None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:58.386627 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 107/202] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:04:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:04:58.387769 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ad45d-9008-47a0-ae3c-df059c6c0a54 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:58.447284 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:58.468546 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ac709-00a8-4c9d-a979-92c164ea9beb None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:58.504724 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1089858-a589-4797-b89f-484b8f8df023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:58.507496 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1089858-a589-4797-b89f-484b8f8df023 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:58.507630 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1089858-a589-4797-b89f-484b8f8df023 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:58.507860 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1089858-a589-4797-b89f-484b8f8df023 None admin] PATH_INFO: `/v3/projects/3371d174840948c183eab2505d3b2776` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:58.509065 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1089858-a589-4797-b89f-484b8f8df023 None admin] RBAC: Authorizing `identity:get_project(project_id=3371d174840948c183eab2505d3b2776)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:58.511174 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1089858-a589-4797-b89f-484b8f8df023 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:58.511781 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ad45d-9008-47a0-ae3c-df059c6c0a54 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:58.513034 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 96/203] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:04:58 2022] GET /identity/v3/projects/3371d174840948c183eab2505d3b2776 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:58.517808 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1089858-a589-4797-b89f-484b8f8df023 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:58.555339 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdaebee-3479-475a-83ca-30542ac122bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:58.556371 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdaebee-3479-475a-83ca-30542ac122bf None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:58.557330 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdaebee-3479-475a-83ca-30542ac122bf None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:58.558030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdaebee-3479-475a-83ca-30542ac122bf None admin] PATH_INFO: `/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:58.559533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdaebee-3479-475a-83ca-30542ac122bf None admin] RBAC: Authorizing `identity:get_project(project_id=8ad529e44aa842e4a9ae1e4cf2872a25)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:58.561239 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdaebee-3479-475a-83ca-30542ac122bf None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:58.563109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 108/204] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:04:58 2022] GET /identity/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:58.564147 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdaebee-3479-475a-83ca-30542ac122bf None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:58.583614 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:58.633620 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1089858-a589-4797-b89f-484b8f8df023 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:58.684043 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7055df9-9a1f-4161-a762-4655bcdbd8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:58.684683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7055df9-9a1f-4161-a762-4655bcdbd8df None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:58.685606 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7055df9-9a1f-4161-a762-4655bcdbd8df None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:58.685884 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7055df9-9a1f-4161-a762-4655bcdbd8df None admin] PATH_INFO: `/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:58.688324 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdaebee-3479-475a-83ca-30542ac122bf None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:58.690057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7055df9-9a1f-4161-a762-4655bcdbd8df None admin] RBAC: Authorizing `identity:get_project(project_id=8ad529e44aa842e4a9ae1e4cf2872a25)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:58.692700 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7055df9-9a1f-4161-a762-4655bcdbd8df None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:58.694606 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 97/205] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:04:58 2022] GET /identity/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:58.695672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7055df9-9a1f-4161-a762-4655bcdbd8df None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:58.722322 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:58.725519 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a1726-ee8b-401f-9de8-797b580410c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:58.726213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a1726-ee8b-401f-9de8-797b580410c5 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:58.726561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a1726-ee8b-401f-9de8-797b580410c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:58.726902 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a1726-ee8b-401f-9de8-797b580410c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:58.727734 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a1726-ee8b-401f-9de8-797b580410c5 None admin] RBAC: Adding query filter params (role.id=7fc47a10f402467489b6123c3cb7e260, scope.project.id=3371d174840948c183eab2505d3b2776, user.id=b5a3de6a55f042c2bfc387c162cfeec8) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:58.728110 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a1726-ee8b-401f-9de8-797b580410c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:58.730342 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a1726-ee8b-401f-9de8-797b580410c5 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:58.736433 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 109/206] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:04:58 2022] GET /identity/v3/role_assignments?user.id=b5a3de6a55f042c2bfc387c162cfeec8&scope.project.id=3371d174840948c183eab2505d3b2776&role.id=7fc47a10f402467489b6123c3cb7e260 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:58.737449 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a1726-ee8b-401f-9de8-797b580410c5 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:04:58.830722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:04:58.852075 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7055df9-9a1f-4161-a762-4655bcdbd8df None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:58.852314 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a1726-ee8b-401f-9de8-797b580410c5 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:04:58.889725 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0333fe-3f97-47c8-8408-e9c1d2071050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:58.890559 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0333fe-3f97-47c8-8408-e9c1d2071050 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:58.890908 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0333fe-3f97-47c8-8408-e9c1d2071050 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:58.891253 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0333fe-3f97-47c8-8408-e9c1d2071050 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:58.892071 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0333fe-3f97-47c8-8408-e9c1d2071050 None admin] RBAC: Adding query filter params (role.id=5434f93251a0417c890b94b90b40ab71, scope.project.id=8ad529e44aa842e4a9ae1e4cf2872a25, user.id=8d692ed579b6420d88f0627c232b0006) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:58.892449 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0333fe-3f97-47c8-8408-e9c1d2071050 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:58.894047 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0333fe-3f97-47c8-8408-e9c1d2071050 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:58.895776 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a87db-1035-486b-a6c2-2eeab5af10bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:04:58.896760 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a87db-1035-486b-a6c2-2eeab5af10bb None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:04:58.897043 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a87db-1035-486b-a6c2-2eeab5af10bb None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:04:58.897343 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a87db-1035-486b-a6c2-2eeab5af10bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:04:58.898945 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a87db-1035-486b-a6c2-2eeab5af10bb None admin] RBAC: Adding query filter params (role.id=255d9e4004c54505a7cda1b8af74e5f1, scope.project.id=8ad529e44aa842e4a9ae1e4cf2872a25, user.id=8d692ed579b6420d88f0627c232b0006) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:04:58.899396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a87db-1035-486b-a6c2-2eeab5af10bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:04:58.901432 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a87db-1035-486b-a6c2-2eeab5af10bb None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:04:58.901551 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 110/207] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:04:58 2022] GET /identity/v3/role_assignments?user.id=8d692ed579b6420d88f0627c232b0006&scope.project.id=8ad529e44aa842e4a9ae1e4cf2872a25&role.id=5434f93251a0417c890b94b90b40ab71 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:04:58.908100 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 98/208] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:04:58 2022] GET /identity/v3/role_assignments?user.id=8d692ed579b6420d88f0627c232b0006&scope.project.id=8ad529e44aa842e4a9ae1e4cf2872a25&role.id=255d9e4004c54505a7cda1b8af74e5f1 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:00.110258 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371b804-96a6-4850-9d2b-9af2d6edf425 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:00.110760 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371b804-96a6-4850-9d2b-9af2d6edf425 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:00.110835 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371b804-96a6-4850-9d2b-9af2d6edf425 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:00.112218 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 111/209] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:00.118364 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ff884-27c2-46d3-b888-58010f3e949e None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:00.118364 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ff884-27c2-46d3-b888-58010f3e949e None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:00.118364 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ff884-27c2-46d3-b888-58010f3e949e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:00.139362 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-2f4ff884-27c2-46d3-b888-58010f3e949e None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:00.140914 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-2f4ff884-27c2-46d3-b888-58010f3e949e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:00.181894 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc48fca-572a-46d7-9756-d720c74ba686 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:00.182267 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc48fca-572a-46d7-9756-d720c74ba686 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:00.182451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc48fca-572a-46d7-9756-d720c74ba686 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:00.183967 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 112/210] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:00.188904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698f443-003b-45ee-8a43-0675c544ec6b None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:00.189212 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698f443-003b-45ee-8a43-0675c544ec6b None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:00.189486 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698f443-003b-45ee-8a43-0675c544ec6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:00.209687 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-7698f443-003b-45ee-8a43-0675c544ec6b None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:00.211261 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-7698f443-003b-45ee-8a43-0675c544ec6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:00.212160 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 99/211] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 04:05:00.281324 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 113/212] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 04:05:00.480036 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ff884-27c2-46d3-b888-58010f3e949e None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:00.491754 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:00.561872 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698f443-003b-45ee-8a43-0675c544ec6b None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:00.583158 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ff884-27c2-46d3-b888-58010f3e949e None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:00.629140 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa37557-fe4a-48ca-aa68-01826947fce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:00.630122 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa37557-fe4a-48ca-aa68-01826947fce7 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:00.630628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa37557-fe4a-48ca-aa68-01826947fce7 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:00.631108 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa37557-fe4a-48ca-aa68-01826947fce7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:00.632595 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa37557-fe4a-48ca-aa68-01826947fce7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:00.634278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa37557-fe4a-48ca-aa68-01826947fce7 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:00.636126 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 100/213] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:00.642427 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa37557-fe4a-48ca-aa68-01826947fce7 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:00.658701 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:00.693274 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698f443-003b-45ee-8a43-0675c544ec6b None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:00.734396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:00.740674 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71ef01-abd9-4355-a1db-3a31683b37c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:00.741421 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71ef01-abd9-4355-a1db-3a31683b37c7 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:00.747030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71ef01-abd9-4355-a1db-3a31683b37c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:00.747030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71ef01-abd9-4355-a1db-3a31683b37c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:00.756192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71ef01-abd9-4355-a1db-3a31683b37c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:00.758294 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa37557-fe4a-48ca-aa68-01826947fce7 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:00.762739 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-2c71ef01-abd9-4355-a1db-3a31683b37c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:05:00.762739 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:00.762739 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:00.762739 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:00.762739 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:00.762739 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:00.762739 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:00.762739 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:00.762739 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:00.762739 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:00.762739 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:00.762739 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:00.762739 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:00.762739 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:00.762739 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:00.762739 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:00.763667 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:00.763667 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:00.763667 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:00.763667 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:00.763667 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:00.763667 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:00.763667 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:00.763667 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:00.763667 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:00.763667 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:00.763667 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:00.763667 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:00.763667 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:00.763667 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:00.763667 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:00.763667 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:00.764505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:00.764505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:00.764505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:00.764505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:00.764505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:00.764505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:00.764505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:00.764505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:00.764505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:00.764505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:00.764505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:05:00.764505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:00.764505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 114/214] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:05:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:00.771665 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71ef01-abd9-4355-a1db-3a31683b37c7 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:00.805009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab57bf4-4c80-4c42-b388-49ecd4d5d5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:00.805985 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab57bf4-4c80-4c42-b388-49ecd4d5d5d0 None admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:00.806431 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab57bf4-4c80-4c42-b388-49ecd4d5d5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:00.807171 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab57bf4-4c80-4c42-b388-49ecd4d5d5d0 None admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:00.808037 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab57bf4-4c80-4c42-b388-49ecd4d5d5d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:00.809788 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab57bf4-4c80-4c42-b388-49ecd4d5d5d0 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:00.893043 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71ef01-abd9-4355-a1db-3a31683b37c7 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:00.928214 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54daa871-7c1a-4498-9097-4dc40f2e3348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:00.928861 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54daa871-7c1a-4498-9097-4dc40f2e3348 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:00.929175 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54daa871-7c1a-4498-9097-4dc40f2e3348 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:00.929702 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54daa871-7c1a-4498-9097-4dc40f2e3348 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:00.930384 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54daa871-7c1a-4498-9097-4dc40f2e3348 None admin] RBAC: Adding query filter params (name=member) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:00.930689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54daa871-7c1a-4498-9097-4dc40f2e3348 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:00.932451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54daa871-7c1a-4498-9097-4dc40f2e3348 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:00.933844 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:00.940986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 115/215] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 23 04:05:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:00.943236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 101/216] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 23 04:05:00 2022] POST /identity/v3/users => generated 297 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:05:00.946844 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c5c2c-22f4-4c40-9a7f-f37833ffe25a None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:00.947091 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c5c2c-22f4-4c40-9a7f-f37833ffe25a None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:00.947861 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c5c2c-22f4-4c40-9a7f-f37833ffe25a None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:00.952304 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 116/217] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:00.952304 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c5c2c-22f4-4c40-9a7f-f37833ffe25a None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:00.952578 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef64176-f70e-4609-be4c-e7364f735e37 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:00.952578 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef64176-f70e-4609-be4c-e7364f735e37 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:00.952578 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef64176-f70e-4609-be4c-e7364f735e37 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:00.957144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 102/218] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:00.959227 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b565b8a-082b-49c2-915b-8a56167ce95f None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:00.961244 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b565b8a-082b-49c2-915b-8a56167ce95f None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:00.961951 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b565b8a-082b-49c2-915b-8a56167ce95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:00.982511 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-8b565b8a-082b-49c2-915b-8a56167ce95f None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:00.983732 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-8b565b8a-082b-49c2-915b-8a56167ce95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:01.055447 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 103/219] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:01.057341 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c9f10-aac2-4fcc-898e-7e367920f991 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:01.057632 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c9f10-aac2-4fcc-898e-7e367920f991 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:01.057905 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c9f10-aac2-4fcc-898e-7e367920f991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:01.082318 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-548c9f10-aac2-4fcc-898e-7e367920f991 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:01.083518 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-548c9f10-aac2-4fcc-898e-7e367920f991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:01.091859 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c5c2c-22f4-4c40-9a7f-f37833ffe25a None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:01.136533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6abdf2-5971-4038-ae1d-5781952925fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:01.137245 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6abdf2-5971-4038-ae1d-5781952925fe None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:01.137482 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6abdf2-5971-4038-ae1d-5781952925fe None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:01.137754 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6abdf2-5971-4038-ae1d-5781952925fe None admin] PATH_INFO: `/v3/users/f19c6d8ab2a5457c81ab2241f506cd6f` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:01.162660 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6abdf2-5971-4038-ae1d-5781952925fe None admin] RBAC: Authorizing `identity:get_user(user_id=f19c6d8ab2a5457c81ab2241f506cd6f)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:01.165221 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6abdf2-5971-4038-ae1d-5781952925fe None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:01.165849 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:01.169290 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 117/220] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:05:00 2022] GET /identity/v3/users/f19c6d8ab2a5457c81ab2241f506cd6f => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:01.174717 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6abdf2-5971-4038-ae1d-5781952925fe None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:01.188978 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 104/221] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:01.240543 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:01.291002 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6abdf2-5971-4038-ae1d-5781952925fe None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:01.326916 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2932f2-ce31-412c-be58-6ee4d7b06e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:01.327461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2932f2-ce31-412c-be58-6ee4d7b06e1b None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:01.327805 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2932f2-ce31-412c-be58-6ee4d7b06e1b None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:01.328014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2932f2-ce31-412c-be58-6ee4d7b06e1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:01.331310 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c9f10-aac2-4fcc-898e-7e367920f991 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:01.409427 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2932f2-ce31-412c-be58-6ee4d7b06e1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:01.410961 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2932f2-ce31-412c-be58-6ee4d7b06e1b None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:01.471807 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c9f10-aac2-4fcc-898e-7e367920f991 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:01.485449 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:01.509447 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc3367-779f-4e6b-8edd-be2d009032ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:01.510628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc3367-779f-4e6b-8edd-be2d009032ef None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:01.510912 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc3367-779f-4e6b-8edd-be2d009032ef None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:01.511184 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc3367-779f-4e6b-8edd-be2d009032ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:01.523773 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc3367-779f-4e6b-8edd-be2d009032ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:01.529119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-6adc3367-779f-4e6b-8edd-be2d009032ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 04:05:01.529119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:01.529119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:01.529119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:01.529119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:01.529119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:01.529119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:01.529119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:01.529119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:01.529119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:01.529119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:01.529119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:01.529119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:01.529119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:01.529119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:01.529119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:01.530186 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:01.530186 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:01.530186 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:01.530186 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:01.530186 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:01.530186 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:01.530186 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:01.530186 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:01.530186 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:01.530186 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:01.530186 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:01.530186 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:01.530186 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:01.530186 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:01.530186 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:01.530186 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:01.533936 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:01.533936 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:01.533936 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:01.533936 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:01.533936 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:01.533936 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:01.533936 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:01.533936 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:01.533936 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:01.533936 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:01.533936 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 04:05:01.533936 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:01.533936 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 105/222] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 23 04:05:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:01.533936 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc3367-779f-4e6b-8edd-be2d009032ef None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:01.550601 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 118/223] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:05:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 04:05:01.552013 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2932f2-ce31-412c-be58-6ee4d7b06e1b None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:01.594126 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:01.642548 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc3367-779f-4e6b-8edd-be2d009032ef None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:01.679057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29a8c1-8cd7-45c2-b684-5fed672ae062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:01.679827 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29a8c1-8cd7-45c2-b684-5fed672ae062 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:01.680190 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29a8c1-8cd7-45c2-b684-5fed672ae062 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:01.680569 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29a8c1-8cd7-45c2-b684-5fed672ae062 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:01.681015 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2932f2-ce31-412c-be58-6ee4d7b06e1b None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:01.691684 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc29a8c1-8cd7-45c2-b684-5fed672ae062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:01.696966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-dc29a8c1-8cd7-45c2-b684-5fed672ae062 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:05:01.696966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:01.696966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:01.696966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:01.696966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:01.696966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:01.696966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:01.696966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:01.696966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:01.696966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:01.696966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:01.696966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:01.696966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:01.696966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:01.696966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:01.696966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:01.698453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:01.698453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:01.698453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:01.698453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:01.698453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:01.698453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:01.698453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:01.698453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:01.698453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:01.698453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:01.698453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:01.698453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:01.698453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:01.698453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:01.698453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:01.698453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:01.699265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:01.699265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:01.699265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:01.699265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:01.699265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:01.699265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:01.699265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:01.699265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:01.699265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:01.699265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:01.699265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:05:01.699265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:01.699265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 106/224] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:05:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:01.699958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29a8c1-8cd7-45c2-b684-5fed672ae062 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:01.723774 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a492c9-e2b9-4aa7-a3ad-aa168c579c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:01.724645 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a492c9-e2b9-4aa7-a3ad-aa168c579c46 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:01.724926 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a492c9-e2b9-4aa7-a3ad-aa168c579c46 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:01.725627 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a492c9-e2b9-4aa7-a3ad-aa168c579c46 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:01.726313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a492c9-e2b9-4aa7-a3ad-aa168c579c46 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:01.726617 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a492c9-e2b9-4aa7-a3ad-aa168c579c46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:01.728007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a492c9-e2b9-4aa7-a3ad-aa168c579c46 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:01.739954 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 119/225] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:05:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:01.740937 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a492c9-e2b9-4aa7-a3ad-aa168c579c46 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:01.764569 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:01.819259 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29a8c1-8cd7-45c2-b684-5fed672ae062 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:01.835298 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:01.857612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab709d3-0491-485a-9793-e702a556f8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:01.858178 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab709d3-0491-485a-9793-e702a556f8ed None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:01.858463 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab709d3-0491-485a-9793-e702a556f8ed None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:01.858739 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab709d3-0491-485a-9793-e702a556f8ed None admin] PATH_INFO: `/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:01.860216 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab709d3-0491-485a-9793-e702a556f8ed None admin] RBAC: Authorizing `identity:get_project(project_id=8ad529e44aa842e4a9ae1e4cf2872a25)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:01.861550 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab709d3-0491-485a-9793-e702a556f8ed None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:01.863650 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 107/226] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:05:01 2022] GET /identity/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:01.864415 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab709d3-0491-485a-9793-e702a556f8ed None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:01.871268 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a492c9-e2b9-4aa7-a3ad-aa168c579c46 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:01.907693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402d3ac-b40d-4ee0-b21c-456802db76f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:01.909637 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402d3ac-b40d-4ee0-b21c-456802db76f9 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:01.910088 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402d3ac-b40d-4ee0-b21c-456802db76f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:01.910505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402d3ac-b40d-4ee0-b21c-456802db76f9 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:01.911332 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402d3ac-b40d-4ee0-b21c-456802db76f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:01.911790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402d3ac-b40d-4ee0-b21c-456802db76f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:01.913359 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402d3ac-b40d-4ee0-b21c-456802db76f9 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:01.925017 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 120/227] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:05:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:01.926162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402d3ac-b40d-4ee0-b21c-456802db76f9 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:02.004958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab709d3-0491-485a-9793-e702a556f8ed None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:02.032443 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:02.047373 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85589eac-625b-4c52-97ae-f2ff97903104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:02.049783 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85589eac-625b-4c52-97ae-f2ff97903104 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:02.049783 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85589eac-625b-4c52-97ae-f2ff97903104 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:02.049783 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85589eac-625b-4c52-97ae-f2ff97903104 None admin] PATH_INFO: `/v3/users/8d692ed579b6420d88f0627c232b0006` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:02.050639 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85589eac-625b-4c52-97ae-f2ff97903104 None admin] RBAC: Authorizing `identity:get_user(user_id=8d692ed579b6420d88f0627c232b0006)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:02.052652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85589eac-625b-4c52-97ae-f2ff97903104 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:02.054770 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 108/228] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:05:01 2022] GET /identity/v3/users/8d692ed579b6420d88f0627c232b0006 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:02.061263 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85589eac-625b-4c52-97ae-f2ff97903104 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:02.064148 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402d3ac-b40d-4ee0-b21c-456802db76f9 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:02.110560 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43861d-9d7d-471e-8920-1b66abece98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:02.111088 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43861d-9d7d-471e-8920-1b66abece98a None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:02.111365 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43861d-9d7d-471e-8920-1b66abece98a None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:02.111634 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43861d-9d7d-471e-8920-1b66abece98a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:02.112372 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43861d-9d7d-471e-8920-1b66abece98a None admin] RBAC: Adding query filter params (role.id=b28fe6f1db4c4738862acb96ff94007c, scope.project.id=8ad529e44aa842e4a9ae1e4cf2872a25, user.id=f19c6d8ab2a5457c81ab2241f506cd6f) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:02.112677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43861d-9d7d-471e-8920-1b66abece98a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:02.114744 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43861d-9d7d-471e-8920-1b66abece98a None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:02.122453 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 121/229] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:05:01 2022] GET /identity/v3/role_assignments?user.id=f19c6d8ab2a5457c81ab2241f506cd6f&scope.project.id=8ad529e44aa842e4a9ae1e4cf2872a25&role.id=b28fe6f1db4c4738862acb96ff94007c => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:02.124036 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43861d-9d7d-471e-8920-1b66abece98a None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:02.127259 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:02.206440 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85589eac-625b-4c52-97ae-f2ff97903104 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:02.286501 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748a048-fef8-4b8b-8f42-c41e4bc7b22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:02.287156 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748a048-fef8-4b8b-8f42-c41e4bc7b22f None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:02.287436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748a048-fef8-4b8b-8f42-c41e4bc7b22f None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:02.287707 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748a048-fef8-4b8b-8f42-c41e4bc7b22f None admin] PATH_INFO: `/v3/users/8d692ed579b6420d88f0627c232b0006` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:02.292946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748a048-fef8-4b8b-8f42-c41e4bc7b22f None admin] RBAC: Authorizing `identity:get_user(user_id=8d692ed579b6420d88f0627c232b0006)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:02.294492 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748a048-fef8-4b8b-8f42-c41e4bc7b22f None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:02.300295 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 109/230] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:05:02 2022] GET /identity/v3/users/8d692ed579b6420d88f0627c232b0006 => generated 283 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:02.307745 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748a048-fef8-4b8b-8f42-c41e4bc7b22f None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:02.322702 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43861d-9d7d-471e-8920-1b66abece98a None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:02.374887 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9525f81-aa23-40bb-bbc8-b15a365350e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:02.375951 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9525f81-aa23-40bb-bbc8-b15a365350e9 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:02.376452 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9525f81-aa23-40bb-bbc8-b15a365350e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:02.376940 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9525f81-aa23-40bb-bbc8-b15a365350e9 None admin] PATH_INFO: `/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:02.378470 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9525f81-aa23-40bb-bbc8-b15a365350e9 None admin] RBAC: Authorizing `identity:get_project(project_id=8ad529e44aa842e4a9ae1e4cf2872a25)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:02.380228 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9525f81-aa23-40bb-bbc8-b15a365350e9 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:02.389122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 122/231] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:05:02 2022] GET /identity/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25 => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:02.390631 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9525f81-aa23-40bb-bbc8-b15a365350e9 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:02.413945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:02.429251 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748a048-fef8-4b8b-8f42-c41e4bc7b22f None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:02.445661 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:02.468653 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac147a-4c1c-4916-ae93-ed9de69777b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:02.469337 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac147a-4c1c-4916-ae93-ed9de69777b0 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:02.469620 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac147a-4c1c-4916-ae93-ed9de69777b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:02.469890 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac147a-4c1c-4916-ae93-ed9de69777b0 None admin] PATH_INFO: `/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:02.472902 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac147a-4c1c-4916-ae93-ed9de69777b0 None admin] RBAC: Authorizing `identity:get_project(project_id=8ad529e44aa842e4a9ae1e4cf2872a25)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:02.474643 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac147a-4c1c-4916-ae93-ed9de69777b0 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:02.476452 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 110/232] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:05:02 2022] GET /identity/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:02.483706 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac147a-4c1c-4916-ae93-ed9de69777b0 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:02.584235 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9525f81-aa23-40bb-bbc8-b15a365350e9 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:02.647768 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ede2c-3d8c-49bc-a68b-d8c22c1fd029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:02.648449 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ede2c-3d8c-49bc-a68b-d8c22c1fd029 None admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:02.648727 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ede2c-3d8c-49bc-a68b-d8c22c1fd029 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:02.649000 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ede2c-3d8c-49bc-a68b-d8c22c1fd029 None admin] PATH_INFO: `/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25/users/8d692ed579b6420d88f0627c232b0006/roles/5434f93251a0417c890b94b90b40ab71` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:02.652777 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ede2c-3d8c-49bc-a68b-d8c22c1fd029 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ad529e44aa842e4a9ae1e4cf2872a25, user_id=8d692ed579b6420d88f0627c232b0006, role_id=5434f93251a0417c890b94b90b40ab71)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:02.655498 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ede2c-3d8c-49bc-a68b-d8c22c1fd029 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:02.668420 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac147a-4c1c-4916-ae93-ed9de69777b0 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:02.704545 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf4f4f-ffcc-41e2-8c50-8732025ed503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:02.705271 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf4f4f-ffcc-41e2-8c50-8732025ed503 None admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:02.705553 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf4f4f-ffcc-41e2-8c50-8732025ed503 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:02.705887 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf4f4f-ffcc-41e2-8c50-8732025ed503 None admin] PATH_INFO: `/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25/users/8d692ed579b6420d88f0627c232b0006/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:02.707897 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf4f4f-ffcc-41e2-8c50-8732025ed503 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ad529e44aa842e4a9ae1e4cf2872a25, user_id=8d692ed579b6420d88f0627c232b0006, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:02.709572 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf4f4f-ffcc-41e2-8c50-8732025ed503 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:02.737843 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 123/233] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 23 04:05:02 2022] PUT /identity/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25/users/8d692ed579b6420d88f0627c232b0006/roles/5434f93251a0417c890b94b90b40ab71 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:05:02.796460 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 111/234] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 23 04:05:02 2022] PUT /identity/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25/users/8d692ed579b6420d88f0627c232b0006/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:05:03.258406 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c1667-4fc9-4389-912e-bb41609e94ed None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:03.258746 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c1667-4fc9-4389-912e-bb41609e94ed None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:03.258919 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c1667-4fc9-4389-912e-bb41609e94ed None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:03.261000 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 124/235] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:03.266452 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdf933-b3f1-482c-a6ce-e74d7c2289af None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:03.266904 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdf933-b3f1-482c-a6ce-e74d7c2289af None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:03.267070 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdf933-b3f1-482c-a6ce-e74d7c2289af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:03.294095 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-01fdf933-b3f1-482c-a6ce-e74d7c2289af None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:03.295299 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-01fdf933-b3f1-482c-a6ce-e74d7c2289af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:03.356806 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:03.399302 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 112/236] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:03.457187 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26408dce-9ae5-40f4-82c8-b58c5a5d976f None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:03.457729 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26408dce-9ae5-40f4-82c8-b58c5a5d976f None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:03.457729 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26408dce-9ae5-40f4-82c8-b58c5a5d976f None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:03.459410 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 125/237] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:03.466100 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e33074-1fbb-464b-9c9f-0bc7dfd803fc None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:03.466426 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e33074-1fbb-464b-9c9f-0bc7dfd803fc None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:03.466663 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e33074-1fbb-464b-9c9f-0bc7dfd803fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:03.485867 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-03e33074-1fbb-464b-9c9f-0bc7dfd803fc None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:03.487056 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-03e33074-1fbb-464b-9c9f-0bc7dfd803fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:03.571768 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 113/238] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 04:05:03.768447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26408dce-9ae5-40f4-82c8-b58c5a5d976f None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:03.855684 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:03.904674 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26408dce-9ae5-40f4-82c8-b58c5a5d976f None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:03.958723 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a93277-f89e-4250-bf4d-4fe86c345fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:03.959375 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a93277-f89e-4250-bf4d-4fe86c345fb5 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:03.959656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a93277-f89e-4250-bf4d-4fe86c345fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:03.959930 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a93277-f89e-4250-bf4d-4fe86c345fb5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:03.979979 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a93277-f89e-4250-bf4d-4fe86c345fb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:03.985311 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-95a93277-f89e-4250-bf4d-4fe86c345fb5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 04:05:03.985311 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:03.985311 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:03.985311 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:03.985311 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:03.985311 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:03.985311 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:03.985311 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:03.985311 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:03.985311 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:03.985311 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:03.985311 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:03.985311 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:03.985311 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:03.985311 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:03.985311 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:03.986208 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:03.986208 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:03.986208 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:03.986208 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:03.986208 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:03.986208 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:03.986208 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:03.986208 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:03.986208 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:03.986208 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:03.986208 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:03.986208 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:03.986208 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:03.986208 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:03.986208 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:03.986208 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:03.987005 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:03.987005 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:03.987005 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:03.987005 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:03.987005 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:03.987005 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:03.987005 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:03.987005 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:03.987005 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:03.987005 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:03.987005 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 04:05:03.987005 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:03.987005 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 126/239] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:05:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:03.992227 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e33074-1fbb-464b-9c9f-0bc7dfd803fc None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:03.999625 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a93277-f89e-4250-bf4d-4fe86c345fb5 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:04.149713 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a93277-f89e-4250-bf4d-4fe86c345fb5 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:04.179438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:04.183545 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e33074-1fbb-464b-9c9f-0bc7dfd803fc None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:04.191334 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f0289-088c-4c74-b2e3-f6ec26af8a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:04.193715 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f0289-088c-4c74-b2e3-f6ec26af8a3f None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:04.193715 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f0289-088c-4c74-b2e3-f6ec26af8a3f None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:04.193715 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f0289-088c-4c74-b2e3-f6ec26af8a3f None admin] PATH_INFO: `/v3/domains/default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:04.196894 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f0289-088c-4c74-b2e3-f6ec26af8a3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:04.200145 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f0289-088c-4c74-b2e3-f6ec26af8a3f None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:04.203611 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:04.211267 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 127/240] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:04.212170 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f0289-088c-4c74-b2e3-f6ec26af8a3f None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:04.273329 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f58fc8-6131-40f6-9ff1-6e98b77a2012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:04.274685 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f58fc8-6131-40f6-9ff1-6e98b77a2012 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:04.275197 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f58fc8-6131-40f6-9ff1-6e98b77a2012 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:04.275670 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f58fc8-6131-40f6-9ff1-6e98b77a2012 None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:04.276552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f58fc8-6131-40f6-9ff1-6e98b77a2012 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:04.277458 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f58fc8-6131-40f6-9ff1-6e98b77a2012 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:04.279064 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f58fc8-6131-40f6-9ff1-6e98b77a2012 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:04.298713 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 114/241] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 23 04:05:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:04.302926 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f58fc8-6131-40f6-9ff1-6e98b77a2012 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:04.419888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f0289-088c-4c74-b2e3-f6ec26af8a3f None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:04.458072 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f58fc8-6131-40f6-9ff1-6e98b77a2012 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:04.486181 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfc7b9-ed45-4934-b6d9-d489e175824f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:04.487470 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfc7b9-ed45-4934-b6d9-d489e175824f None admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:04.487949 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfc7b9-ed45-4934-b6d9-d489e175824f None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:04.488418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfc7b9-ed45-4934-b6d9-d489e175824f None admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:04.489617 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dfc7b9-ed45-4934-b6d9-d489e175824f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:04.491763 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dfc7b9-ed45-4934-b6d9-d489e175824f None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:04.510217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285be57-ad06-4ef0-88be-ef6b281b22ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:04.510880 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285be57-ad06-4ef0-88be-ef6b281b22ee None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:04.511162 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285be57-ad06-4ef0-88be-ef6b281b22ee None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:04.511500 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285be57-ad06-4ef0-88be-ef6b281b22ee None admin] PATH_INFO: `/v3/users/f08a1cec6c884fab9c08d8774fc22716` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:04.525764 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285be57-ad06-4ef0-88be-ef6b281b22ee None admin] RBAC: Authorizing `identity:get_user(user_id=f08a1cec6c884fab9c08d8774fc22716)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:04.527251 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285be57-ad06-4ef0-88be-ef6b281b22ee None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:04.529078 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 115/242] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:05:04 2022] GET /identity/v3/users/f08a1cec6c884fab9c08d8774fc22716 => generated 297 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:04.530093 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f765afe-b6b5-476b-99d6-68a61e77f1a3 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:04.530384 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f765afe-b6b5-476b-99d6-68a61e77f1a3 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:04.530653 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f765afe-b6b5-476b-99d6-68a61e77f1a3 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:04.532027 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 116/243] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:04.536572 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f765afe-b6b5-476b-99d6-68a61e77f1a3 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:04.582860 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:04.595610 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 128/244] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 23 04:05:04 2022] POST /identity/v3/users => generated 293 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:05:04.597306 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2796cf7-d315-466e-93c1-a14fb415c9e0 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:04.597929 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2796cf7-d315-466e-93c1-a14fb415c9e0 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:04.598554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2796cf7-d315-466e-93c1-a14fb415c9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:04.623396 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-c2796cf7-d315-466e-93c1-a14fb415c9e0 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:04.625048 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-c2796cf7-d315-466e-93c1-a14fb415c9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:04.693576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:04.708645 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 129/245] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:04.830726 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f765afe-b6b5-476b-99d6-68a61e77f1a3 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:04.869063 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522c45c-1947-48e7-b81f-7d4c63af9e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:04.870090 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522c45c-1947-48e7-b81f-7d4c63af9e86 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:04.870680 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522c45c-1947-48e7-b81f-7d4c63af9e86 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:04.871205 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522c45c-1947-48e7-b81f-7d4c63af9e86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:04.963483 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522c45c-1947-48e7-b81f-7d4c63af9e86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:04.965267 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522c45c-1947-48e7-b81f-7d4c63af9e86 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:05.005942 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:05.077766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 117/246] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:05:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:05:05.083621 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2796cf7-d315-466e-93c1-a14fb415c9e0 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:05.112426 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f188a65-6c7a-42dc-96f0-8aff442e9241 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:05.112426 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f188a65-6c7a-42dc-96f0-8aff442e9241 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:05.112426 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f188a65-6c7a-42dc-96f0-8aff442e9241 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:05.113188 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 118/247] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:05.119048 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514e783-7547-4e50-9b90-4c7164ce37eb None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:05.119334 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514e783-7547-4e50-9b90-4c7164ce37eb None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:05.119602 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514e783-7547-4e50-9b90-4c7164ce37eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:05.146675 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-b514e783-7547-4e50-9b90-4c7164ce37eb None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:05.147885 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-b514e783-7547-4e50-9b90-4c7164ce37eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:05.216488 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2796cf7-d315-466e-93c1-a14fb415c9e0 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:05.249543 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 119/248] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:05.250221 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514e783-7547-4e50-9b90-4c7164ce37eb None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:05.256316 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e1f92-0ac1-43b0-a297-2586681ed32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:05.257239 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e1f92-0ac1-43b0-a297-2586681ed32d None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:05.257702 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e1f92-0ac1-43b0-a297-2586681ed32d None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:05.258153 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e1f92-0ac1-43b0-a297-2586681ed32d None admin] PATH_INFO: `/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:05.260021 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e1f92-0ac1-43b0-a297-2586681ed32d None admin] RBAC: Authorizing `identity:get_project(project_id=8ad529e44aa842e4a9ae1e4cf2872a25)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:05.261765 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e1f92-0ac1-43b0-a297-2586681ed32d None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:05.263985 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 130/249] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:05:05 2022] GET /identity/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:05.265336 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbd058-6df8-4b69-95c1-ab067b6ad958 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:05.265818 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbd058-6df8-4b69-95c1-ab067b6ad958 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:05.266279 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbd058-6df8-4b69-95c1-ab067b6ad958 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:05.267704 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 131/250] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:05.269902 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbd058-6df8-4b69-95c1-ab067b6ad958 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:05.325165 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:05.346614 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:05.379063 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514e783-7547-4e50-9b90-4c7164ce37eb None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:05.412332 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbd058-6df8-4b69-95c1-ab067b6ad958 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:05.445873 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0db11a-02cb-4736-973d-c2377a5b4829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:05.447575 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0db11a-02cb-4736-973d-c2377a5b4829 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:05.448060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0db11a-02cb-4736-973d-c2377a5b4829 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:05.448539 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0db11a-02cb-4736-973d-c2377a5b4829 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:05.467205 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0db11a-02cb-4736-973d-c2377a5b4829 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:05.470739 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becde02-35e7-4b87-a947-2c41c5dbf225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:05.471367 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becde02-35e7-4b87-a947-2c41c5dbf225 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:05.471641 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becde02-35e7-4b87-a947-2c41c5dbf225 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:05.471912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becde02-35e7-4b87-a947-2c41c5dbf225 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:05.472659 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0becde02-35e7-4b87-a947-2c41c5dbf225 None admin] RBAC: Adding query filter params (role.id=7fc47a10f402467489b6123c3cb7e260, scope.project.id=8ad529e44aa842e4a9ae1e4cf2872a25, user.id=f08a1cec6c884fab9c08d8774fc22716) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:05.472968 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0becde02-35e7-4b87-a947-2c41c5dbf225 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:05.473958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-da0db11a-02cb-4736-973d-c2377a5b4829 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:05:05.473958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:05.473958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:05.473958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:05.473958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:05.473958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:05.473958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:05.473958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:05.473958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:05.473958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:05.473958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:05.473958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:05.473958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:05.473958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:05.473958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:05.473958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:05.474854 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:05.474854 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:05.474854 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:05.474854 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:05.474854 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:05.474854 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:05.474854 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:05.474854 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:05.474854 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:05.474854 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:05.474854 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:05.474854 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:05.474854 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:05.474854 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:05.474854 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:05.474854 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:05.475658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:05.475658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:05.475658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:05.475658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:05.475658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:05.475658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:05.475658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:05.475658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:05.475658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:05.475658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:05.475658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:05:05.475658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:05.476260 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0becde02-35e7-4b87-a947-2c41c5dbf225 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:05.478132 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 120/251] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:05:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:05.479573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1678053-322d-4db0-8f98-c40099451b3a None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:05.480079 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1678053-322d-4db0-8f98-c40099451b3a None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:05.480552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1678053-322d-4db0-8f98-c40099451b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:05.491516 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 132/252] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:05:05 2022] GET /identity/v3/role_assignments?user.id=f08a1cec6c884fab9c08d8774fc22716&scope.project.id=8ad529e44aa842e4a9ae1e4cf2872a25&role.id=7fc47a10f402467489b6123c3cb7e260 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:05.495712 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becde02-35e7-4b87-a947-2c41c5dbf225 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:05.512070 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-e1678053-322d-4db0-8f98-c40099451b3a None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:05.513748 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-e1678053-322d-4db0-8f98-c40099451b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:05.606810 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 121/253] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:05.628647 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becde02-35e7-4b87-a947-2c41c5dbf225 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:05.632531 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1678053-322d-4db0-8f98-c40099451b3a None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:05.650688 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:05.665441 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25422d9-a496-4655-84af-8374578f69d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:05.666632 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25422d9-a496-4655-84af-8374578f69d9 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:05.666920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25422d9-a496-4655-84af-8374578f69d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:05.667193 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25422d9-a496-4655-84af-8374578f69d9 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:05.667878 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25422d9-a496-4655-84af-8374578f69d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:05.668182 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25422d9-a496-4655-84af-8374578f69d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:05.669608 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25422d9-a496-4655-84af-8374578f69d9 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:05.679076 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 133/254] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 23 04:05:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:05.686475 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25422d9-a496-4655-84af-8374578f69d9 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:05.732430 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:05.809062 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1678053-322d-4db0-8f98-c40099451b3a None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:05.846974 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89142690-4d8a-4922-b7be-0bfd42f6e5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:05.847620 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89142690-4d8a-4922-b7be-0bfd42f6e5ec None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:05.847908 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89142690-4d8a-4922-b7be-0bfd42f6e5ec None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:05.848188 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89142690-4d8a-4922-b7be-0bfd42f6e5ec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:05.859672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89142690-4d8a-4922-b7be-0bfd42f6e5ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:05.864873 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-89142690-4d8a-4922-b7be-0bfd42f6e5ec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 04:05:05.864873 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:05.864873 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:05.864873 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:05.864873 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:05.864873 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:05.864873 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:05.864873 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:05.864873 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:05.864873 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:05.864873 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:05.864873 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:05.864873 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:05.864873 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:05.864873 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:05.864873 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:05.865796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:05.865796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:05.865796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:05.865796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:05.865796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:05.865796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:05.865796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:05.865796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:05.865796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:05.865796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:05.865796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:05.865796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:05.865796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:05.865796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:05.865796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:05.865796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:05.866635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:05.866635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:05.866635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:05.866635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:05.866635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:05.866635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:05.866635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:05.866635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:05.866635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:05.866635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:05.866635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 04:05:05.866635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:05.866635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 122/255] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 23 04:05:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:05:05.871690 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89142690-4d8a-4922-b7be-0bfd42f6e5ec None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:05.892848 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25422d9-a496-4655-84af-8374578f69d9 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:05.979167 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89142690-4d8a-4922-b7be-0bfd42f6e5ec None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:05.986714 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:05.993298 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6048e90-a4c4-4ace-a808-100e60f6403e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:05.996590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6048e90-a4c4-4ace-a808-100e60f6403e None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:05.996590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6048e90-a4c4-4ace-a808-100e60f6403e None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:05.996590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6048e90-a4c4-4ace-a808-100e60f6403e None admin] PATH_INFO: `/v3/users/f19c6d8ab2a5457c81ab2241f506cd6f` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:05.996590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6048e90-a4c4-4ace-a808-100e60f6403e None admin] RBAC: Authorizing `identity:get_user(user_id=f19c6d8ab2a5457c81ab2241f506cd6f)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:05.997707 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6048e90-a4c4-4ace-a808-100e60f6403e None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:05.999327 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 134/256] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:05:05 2022] GET /identity/v3/users/f19c6d8ab2a5457c81ab2241f506cd6f => generated 297 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:06.008051 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6048e90-a4c4-4ace-a808-100e60f6403e None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:06.020326 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8e7b7-bdea-438c-b9d2-5af2a2bd6287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:06.020945 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8e7b7-bdea-438c-b9d2-5af2a2bd6287 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:06.022252 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8e7b7-bdea-438c-b9d2-5af2a2bd6287 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:06.022559 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8e7b7-bdea-438c-b9d2-5af2a2bd6287 None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:06.023255 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8e7b7-bdea-438c-b9d2-5af2a2bd6287 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:06.023567 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8e7b7-bdea-438c-b9d2-5af2a2bd6287 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:06.025005 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8e7b7-bdea-438c-b9d2-5af2a2bd6287 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:06.034051 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 123/257] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:05:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:05:06.039295 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8e7b7-bdea-438c-b9d2-5af2a2bd6287 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:06.123320 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:06.148693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8e7b7-bdea-438c-b9d2-5af2a2bd6287 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:06.184771 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f79a86-f0c5-49d0-8978-745d83e82a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:06.185449 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f79a86-f0c5-49d0-8978-745d83e82a57 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:06.185740 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f79a86-f0c5-49d0-8978-745d83e82a57 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:06.186016 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f79a86-f0c5-49d0-8978-745d83e82a57 None admin] PATH_INFO: `/v3/users/8d692ed579b6420d88f0627c232b0006` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:06.187185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f79a86-f0c5-49d0-8978-745d83e82a57 None admin] RBAC: Authorizing `identity:get_user(user_id=8d692ed579b6420d88f0627c232b0006)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:06.188644 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f79a86-f0c5-49d0-8978-745d83e82a57 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:06.190589 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 124/258] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:05:06 2022] GET /identity/v3/users/8d692ed579b6420d88f0627c232b0006 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:06.191372 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f79a86-f0c5-49d0-8978-745d83e82a57 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:06.216870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6048e90-a4c4-4ace-a808-100e60f6403e None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:06.233891 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:06.256330 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379b092-9abc-489c-8293-6446a1f2a6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:06.257677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379b092-9abc-489c-8293-6446a1f2a6d1 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:06.258142 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379b092-9abc-489c-8293-6446a1f2a6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:06.258860 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379b092-9abc-489c-8293-6446a1f2a6d1 None admin] PATH_INFO: `/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:06.260861 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379b092-9abc-489c-8293-6446a1f2a6d1 None admin] RBAC: Authorizing `identity:get_project(project_id=8ad529e44aa842e4a9ae1e4cf2872a25)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:06.263075 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379b092-9abc-489c-8293-6446a1f2a6d1 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:06.265709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 135/259] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:05:06 2022] GET /identity/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:05:06.266682 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379b092-9abc-489c-8293-6446a1f2a6d1 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:06.380541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379b092-9abc-489c-8293-6446a1f2a6d1 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:06.395758 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f79a86-f0c5-49d0-8978-745d83e82a57 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:06.396466 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:06.418748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433fbe3b-63f3-41d1-95cb-175007268dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:06.419477 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fbe3b-63f3-41d1-95cb-175007268dae None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:06.419768 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fbe3b-63f3-41d1-95cb-175007268dae None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:06.422675 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fbe3b-63f3-41d1-95cb-175007268dae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:06.467203 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b8eec-7aa2-4085-96b9-34057ac71a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:06.467845 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b8eec-7aa2-4085-96b9-34057ac71a01 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:06.468127 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b8eec-7aa2-4085-96b9-34057ac71a01 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:06.468399 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b8eec-7aa2-4085-96b9-34057ac71a01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:06.490192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b8eec-7aa2-4085-96b9-34057ac71a01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:06.492590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433fbe3b-63f3-41d1-95cb-175007268dae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:06.494730 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433fbe3b-63f3-41d1-95cb-175007268dae None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:06.506211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-eb7b8eec-7aa2-4085-96b9-34057ac71a01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:05:06.506211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:06.506211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:06.506211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:06.506211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:06.506211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:06.506211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:06.506211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:06.506211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:06.506211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:06.506211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:06.506211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:06.506211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:06.506211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:06.506211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:06.506211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:06.507191 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:06.507191 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:06.507191 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:06.507191 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:06.507191 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:06.507191 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:06.507191 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:06.507191 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:06.507191 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:06.507191 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:06.507191 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:06.507191 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:06.507191 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:06.507191 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:06.507191 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:06.507191 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:06.508664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:06.508664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:06.508664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:06.508664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:06.508664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:06.508664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:06.508664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:06.508664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:06.508664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:06.508664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:06.508664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:05:06.508664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:06.508664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 125/260] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:05:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:06.508664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b8eec-7aa2-4085-96b9-34057ac71a01 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:06.684626 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 136/261] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:05:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:05:06.685332 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433fbe3b-63f3-41d1-95cb-175007268dae None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:06.700506 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:06.709447 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b8eec-7aa2-4085-96b9-34057ac71a01 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:06.720460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:06.770462 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554514f4-bde8-42f2-afa2-e07807f14404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:06.771054 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554514f4-bde8-42f2-afa2-e07807f14404 None admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:06.771335 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554514f4-bde8-42f2-afa2-e07807f14404 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:06.771608 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554514f4-bde8-42f2-afa2-e07807f14404 None admin] PATH_INFO: `/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25/users/f19c6d8ab2a5457c81ab2241f506cd6f/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:06.774600 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554514f4-bde8-42f2-afa2-e07807f14404 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ad529e44aa842e4a9ae1e4cf2872a25, user_id=f19c6d8ab2a5457c81ab2241f506cd6f, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:06.776130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554514f4-bde8-42f2-afa2-e07807f14404 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:06.840652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 126/262] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 23 04:05:06 2022] PUT /identity/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25/users/f19c6d8ab2a5457c81ab2241f506cd6f/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:05:06.841625 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554514f4-bde8-42f2-afa2-e07807f14404 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:06.869900 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433fbe3b-63f3-41d1-95cb-175007268dae None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:06.936433 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae855232-ed8b-4fa6-8711-67f981cae81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:06.937141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae855232-ed8b-4fa6-8711-67f981cae81a None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:06.937431 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae855232-ed8b-4fa6-8711-67f981cae81a None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:06.937710 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae855232-ed8b-4fa6-8711-67f981cae81a None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:06.938399 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae855232-ed8b-4fa6-8711-67f981cae81a None admin] RBAC: Adding query filter params (name=admin) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:06.938706 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae855232-ed8b-4fa6-8711-67f981cae81a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:06.940236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae855232-ed8b-4fa6-8711-67f981cae81a None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:06.953660 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 137/263] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:05:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:06.963332 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae855232-ed8b-4fa6-8711-67f981cae81a None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:07.059254 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:07.091191 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae855232-ed8b-4fa6-8711-67f981cae81a None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:07.119319 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554514f4-bde8-42f2-afa2-e07807f14404 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:07.137356 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da14797-8aa6-4443-b099-405131f6d8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:07.138008 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da14797-8aa6-4443-b099-405131f6d8d0 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:07.138295 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da14797-8aa6-4443-b099-405131f6d8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:07.138573 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da14797-8aa6-4443-b099-405131f6d8d0 None admin] PATH_INFO: `/v3/users/8d692ed579b6420d88f0627c232b0006` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:07.139856 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da14797-8aa6-4443-b099-405131f6d8d0 None admin] RBAC: Authorizing `identity:get_user(user_id=8d692ed579b6420d88f0627c232b0006)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:07.141459 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da14797-8aa6-4443-b099-405131f6d8d0 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:07.143406 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 138/264] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:05:06 2022] GET /identity/v3/users/8d692ed579b6420d88f0627c232b0006 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:05:07.149350 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da14797-8aa6-4443-b099-405131f6d8d0 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:07.201952 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b067d4-15b2-478b-ab08-27d845c78aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:07.202981 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b067d4-15b2-478b-ab08-27d845c78aee None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:07.203467 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b067d4-15b2-478b-ab08-27d845c78aee None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:07.204016 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b067d4-15b2-478b-ab08-27d845c78aee None admin] PATH_INFO: `/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:07.205805 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b067d4-15b2-478b-ab08-27d845c78aee None admin] RBAC: Authorizing `identity:get_project(project_id=8ad529e44aa842e4a9ae1e4cf2872a25)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:07.207883 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b067d4-15b2-478b-ab08-27d845c78aee None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:07.209831 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 127/265] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:05:06 2022] GET /identity/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25 => generated 302 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:07.230959 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b067d4-15b2-478b-ab08-27d845c78aee None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:07.277972 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:07.354773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da14797-8aa6-4443-b099-405131f6d8d0 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:07.429201 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b067d4-15b2-478b-ab08-27d845c78aee None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:07.453821 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98706a-1ea8-48fa-96c9-5e7135746125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:07.454715 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98706a-1ea8-48fa-96c9-5e7135746125 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:07.455206 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98706a-1ea8-48fa-96c9-5e7135746125 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:07.455622 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98706a-1ea8-48fa-96c9-5e7135746125 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:07.495285 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:07.499933 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfffaed-0a01-4a9e-b665-bd9ac7553f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:07.500669 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfffaed-0a01-4a9e-b665-bd9ac7553f42 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:07.509620 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfffaed-0a01-4a9e-b665-bd9ac7553f42 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:07.509620 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfffaed-0a01-4a9e-b665-bd9ac7553f42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:07.509620 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfffaed-0a01-4a9e-b665-bd9ac7553f42 None admin] RBAC: Adding query filter params (role.id=5434f93251a0417c890b94b90b40ab71, scope.project.id=8ad529e44aa842e4a9ae1e4cf2872a25, user.id=8d692ed579b6420d88f0627c232b0006) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:07.509620 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfffaed-0a01-4a9e-b665-bd9ac7553f42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:07.509620 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfffaed-0a01-4a9e-b665-bd9ac7553f42 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:07.535502 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 128/266] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:05:07 2022] GET /identity/v3/role_assignments?user.id=8d692ed579b6420d88f0627c232b0006&scope.project.id=8ad529e44aa842e4a9ae1e4cf2872a25&role.id=5434f93251a0417c890b94b90b40ab71 => generated 608 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:07.616916 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98706a-1ea8-48fa-96c9-5e7135746125 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:07.617703 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98706a-1ea8-48fa-96c9-5e7135746125 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:07.843188 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 139/267] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:05:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:05:07.855677 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfffaed-0a01-4a9e-b665-bd9ac7553f42 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:07.868716 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077117d-5269-49f6-915b-c12a8a88fc65 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:07.868985 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077117d-5269-49f6-915b-c12a8a88fc65 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:07.869229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077117d-5269-49f6-915b-c12a8a88fc65 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:07.870741 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 140/268] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:07.875886 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a5775-0e9d-480a-93d4-76f02714c697 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:07.876172 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a5775-0e9d-480a-93d4-76f02714c697 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:07.876448 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a5775-0e9d-480a-93d4-76f02714c697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:07.898993 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-ae0a5775-0e9d-480a-93d4-76f02714c697 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:07.900785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-ae0a5775-0e9d-480a-93d4-76f02714c697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:07.945793 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:07.979515 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 141/269] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 04:05:07.980825 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:07.981935 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fccc0-d459-4175-a0a3-e0b84bef32ed None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:07.982488 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fccc0-d459-4175-a0a3-e0b84bef32ed None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:07.982910 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fccc0-d459-4175-a0a3-e0b84bef32ed None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:07.984609 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 142/270] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:07.990199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde36041-af5e-455b-ace2-4bba4b198483 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:07.990706 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde36041-af5e-455b-ace2-4bba4b198483 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:07.991259 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde36041-af5e-455b-ace2-4bba4b198483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:07.995083 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfffaed-0a01-4a9e-b665-bd9ac7553f42 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:08.011157 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-fde36041-af5e-455b-ace2-4bba4b198483 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:08.012873 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-fde36041-af5e-455b-ace2-4bba4b198483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:08.035251 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5fb799-83d0-4e31-8301-a078798aafb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:08.035911 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fb799-83d0-4e31-8301-a078798aafb7 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:08.036194 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fb799-83d0-4e31-8301-a078798aafb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:08.036469 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fb799-83d0-4e31-8301-a078798aafb7 None admin] PATH_INFO: `/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:08.037712 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5fb799-83d0-4e31-8301-a078798aafb7 None admin] RBAC: Authorizing `identity:get_project(project_id=8ad529e44aa842e4a9ae1e4cf2872a25)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:08.039164 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5fb799-83d0-4e31-8301-a078798aafb7 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:08.042416 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 129/271] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:05:07 2022] GET /identity/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:08.050376 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5fb799-83d0-4e31-8301-a078798aafb7 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:08.162079 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 143/272] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 04:05:08.170334 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2acda9-ca82-4fc7-bc47-a723a731d3f2 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:08.170621 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2acda9-ca82-4fc7-bc47-a723a731d3f2 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:08.170805 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5fb799-83d0-4e31-8301-a078798aafb7 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:08.170903 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2acda9-ca82-4fc7-bc47-a723a731d3f2 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:08.172201 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 144/273] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 04:05:08.178201 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb9a6c-624a-4d7c-9fd3-d4b2d5d4f110 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:08.178489 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb9a6c-624a-4d7c-9fd3-d4b2d5d4f110 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:08.178770 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb9a6c-624a-4d7c-9fd3-d4b2d5d4f110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:08.202678 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-9cfb9a6c-624a-4d7c-9fd3-d4b2d5d4f110 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:08.203875 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-9cfb9a6c-624a-4d7c-9fd3-d4b2d5d4f110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:08.210509 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8d495-49ef-4c8e-8e69-787ca738aaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:08.211140 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8d495-49ef-4c8e-8e69-787ca738aaa4 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:08.211426 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8d495-49ef-4c8e-8e69-787ca738aaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:08.211709 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8d495-49ef-4c8e-8e69-787ca738aaa4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:08.212612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8d495-49ef-4c8e-8e69-787ca738aaa4 None admin] RBAC: Adding query filter params (role.id=255d9e4004c54505a7cda1b8af74e5f1, scope.project.id=8ad529e44aa842e4a9ae1e4cf2872a25, user.id=8d692ed579b6420d88f0627c232b0006) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:08.212926 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8d495-49ef-4c8e-8e69-787ca738aaa4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:08.214672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8d495-49ef-4c8e-8e69-787ca738aaa4 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:08.221550 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 130/274] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:05:08 2022] GET /identity/v3/role_assignments?user.id=8d692ed579b6420d88f0627c232b0006&scope.project.id=8ad529e44aa842e4a9ae1e4cf2872a25&role.id=255d9e4004c54505a7cda1b8af74e5f1 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:08.278893 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 145/275] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 04:05:08.342378 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8d495-49ef-4c8e-8e69-787ca738aaa4 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:08.371718 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:08.469539 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8d495-49ef-4c8e-8e69-787ca738aaa4 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:08.504283 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9c4a3-cd59-45bd-987c-455d1fb2e541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:08.505310 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9c4a3-cd59-45bd-987c-455d1fb2e541 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:08.505793 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9c4a3-cd59-45bd-987c-455d1fb2e541 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:08.506264 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9c4a3-cd59-45bd-987c-455d1fb2e541 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:08.517785 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9c4a3-cd59-45bd-987c-455d1fb2e541 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:08.523577 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-67c9c4a3-cd59-45bd-987c-455d1fb2e541 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:05:08.523577 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:08.523577 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:08.523577 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:08.523577 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:08.523577 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:08.523577 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:08.523577 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:08.523577 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:08.523577 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:08.523577 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:08.523577 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:08.523577 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:08.523577 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:08.523577 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:08.523577 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:08.524462 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:08.524462 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:08.524462 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:08.524462 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:08.524462 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:08.524462 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:08.524462 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:08.524462 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:08.524462 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:08.524462 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:08.524462 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:08.524462 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:08.524462 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:08.524462 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:08.524462 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:08.524462 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:08.525926 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:08.525926 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:08.525926 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:08.525926 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:08.525926 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:08.525926 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:08.525926 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:08.525926 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:08.525926 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:08.525926 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:08.525926 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:05:08.525926 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:08.527884 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 131/276] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:05:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:08.534178 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb9a6c-624a-4d7c-9fd3-d4b2d5d4f110 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:08.559952 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9c4a3-cd59-45bd-987c-455d1fb2e541 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:08.576099 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:08.654579 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb9a6c-624a-4d7c-9fd3-d4b2d5d4f110 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:08.659249 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:08.680864 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9c4a3-cd59-45bd-987c-455d1fb2e541 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:08.690377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d49fa-d241-4d6e-a047-3eacd734f4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:08.691001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d49fa-d241-4d6e-a047-3eacd734f4e5 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:08.691287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d49fa-d241-4d6e-a047-3eacd734f4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:08.691560 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d49fa-d241-4d6e-a047-3eacd734f4e5 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:08.692238 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d49fa-d241-4d6e-a047-3eacd734f4e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:08.692575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d49fa-d241-4d6e-a047-3eacd734f4e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:08.693986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d49fa-d241-4d6e-a047-3eacd734f4e5 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:08.702697 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 146/277] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 23 04:05:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:08.703489 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d49fa-d241-4d6e-a047-3eacd734f4e5 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:08.722476 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0c989-a1d9-4de6-857a-fce7a922d6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:08.723442 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0c989-a1d9-4de6-857a-fce7a922d6aa None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:08.723954 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0c989-a1d9-4de6-857a-fce7a922d6aa None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:08.724432 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0c989-a1d9-4de6-857a-fce7a922d6aa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:08.735960 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe0c989-a1d9-4de6-857a-fce7a922d6aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:08.741693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-bbe0c989-a1d9-4de6-857a-fce7a922d6aa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 04:05:08.741693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:08.741693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:08.741693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:08.741693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:08.741693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:08.741693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:08.741693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:08.741693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:08.741693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:08.741693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:08.741693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:08.741693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:08.741693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:08.741693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:08.741693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:08.742586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:08.742586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:08.742586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:08.742586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:08.742586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:08.742586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:08.742586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:08.742586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:08.742586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:08.742586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:08.742586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:08.742586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:08.742586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:08.742586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:08.742586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:08.742586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:08.743954 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:08.743954 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:08.743954 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:08.743954 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:08.743954 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:08.743954 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:08.743954 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:08.743954 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:08.743954 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:08.743954 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:08.743954 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 04:05:08.743954 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:08.745939 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 132/278] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:05:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:05:08.746885 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0c989-a1d9-4de6-857a-fce7a922d6aa None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:08.805755 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:08.812629 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d49fa-d241-4d6e-a047-3eacd734f4e5 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:08.850122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4639c-24fb-4c23-86df-3780eedaf437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:08.850904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4639c-24fb-4c23-86df-3780eedaf437 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:08.851052 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4639c-24fb-4c23-86df-3780eedaf437 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:08.851328 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4639c-24fb-4c23-86df-3780eedaf437 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:08.852458 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4639c-24fb-4c23-86df-3780eedaf437 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:08.853998 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4639c-24fb-4c23-86df-3780eedaf437 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:08.855583 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 147/279] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:08.857854 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0c989-a1d9-4de6-857a-fce7a922d6aa None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:08.857989 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4639c-24fb-4c23-86df-3780eedaf437 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:08.894956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32219608-5bd5-4055-bc66-adaf65c01d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:08.895586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32219608-5bd5-4055-bc66-adaf65c01d71 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:08.895872 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32219608-5bd5-4055-bc66-adaf65c01d71 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:08.896147 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32219608-5bd5-4055-bc66-adaf65c01d71 None admin] PATH_INFO: `/v3/users/591ad46840ce4a9cae901ab4b4edbfa4` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:08.906994 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:08.910382 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32219608-5bd5-4055-bc66-adaf65c01d71 None admin] RBAC: Authorizing `identity:get_user(user_id=591ad46840ce4a9cae901ab4b4edbfa4)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:08.911864 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32219608-5bd5-4055-bc66-adaf65c01d71 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:08.913686 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 133/280] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:05:08 2022] GET /identity/v3/users/591ad46840ce4a9cae901ab4b4edbfa4 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:08.913686 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32219608-5bd5-4055-bc66-adaf65c01d71 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:08.970579 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4639c-24fb-4c23-86df-3780eedaf437 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:09.005988 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389d8b8-a97b-4b80-9e61-d2190d70e2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:09.006533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389d8b8-a97b-4b80-9e61-d2190d70e2a3 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:09.006808 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389d8b8-a97b-4b80-9e61-d2190d70e2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:09.007083 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389d8b8-a97b-4b80-9e61-d2190d70e2a3 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:09.007758 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389d8b8-a97b-4b80-9e61-d2190d70e2a3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:09.008062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389d8b8-a97b-4b80-9e61-d2190d70e2a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:09.009974 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389d8b8-a97b-4b80-9e61-d2190d70e2a3 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:09.018256 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 148/281] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 23 04:05:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:09.022844 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389d8b8-a97b-4b80-9e61-d2190d70e2a3 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:09.040531 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32219608-5bd5-4055-bc66-adaf65c01d71 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:09.047509 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:09.077808 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd3a3c-2982-46ad-9168-0fb919d1e6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:09.078420 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd3a3c-2982-46ad-9168-0fb919d1e6d8 None admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:09.078715 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd3a3c-2982-46ad-9168-0fb919d1e6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:09.078965 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd3a3c-2982-46ad-9168-0fb919d1e6d8 None admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:09.079657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd3a3c-2982-46ad-9168-0fb919d1e6d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:09.081103 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd3a3c-2982-46ad-9168-0fb919d1e6d8 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:09.126003 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389d8b8-a97b-4b80-9e61-d2190d70e2a3 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:09.160326 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7812b-368e-41bc-9752-e98f6eac5a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:09.160943 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7812b-368e-41bc-9752-e98f6eac5a83 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:09.161262 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7812b-368e-41bc-9752-e98f6eac5a83 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:09.161537 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7812b-368e-41bc-9752-e98f6eac5a83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:09.162277 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7812b-368e-41bc-9752-e98f6eac5a83 None admin] RBAC: Adding query filter params (role.id=b28fe6f1db4c4738862acb96ff94007c, user.id=591ad46840ce4a9cae901ab4b4edbfa4, scope.system=all) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:09.162584 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7812b-368e-41bc-9752-e98f6eac5a83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:09.164023 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7812b-368e-41bc-9752-e98f6eac5a83 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:09.168933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 149/282] 10.222.0.42 () {56 vars in 1308 bytes} [Tue Aug 23 04:05:09 2022] GET /identity/v3/role_assignments?user.id=591ad46840ce4a9cae901ab4b4edbfa4&scope.system=all&role.id=b28fe6f1db4c4738862acb96ff94007c => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:09.170740 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7812b-368e-41bc-9752-e98f6eac5a83 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:09.201346 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 134/283] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 23 04:05:08 2022] POST /identity/v3/users => generated 293 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:05:09.301037 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:09.316586 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7812b-368e-41bc-9752-e98f6eac5a83 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:09.358690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913b88f-7535-475d-93f8-3a20dddef0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:09.359355 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913b88f-7535-475d-93f8-3a20dddef0f3 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:09.359639 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913b88f-7535-475d-93f8-3a20dddef0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:09.359915 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913b88f-7535-475d-93f8-3a20dddef0f3 None admin] PATH_INFO: `/v3/users/f08a1cec6c884fab9c08d8774fc22716` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:09.361149 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913b88f-7535-475d-93f8-3a20dddef0f3 None admin] RBAC: Authorizing `identity:get_user(user_id=f08a1cec6c884fab9c08d8774fc22716)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:09.362639 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913b88f-7535-475d-93f8-3a20dddef0f3 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:09.364617 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 150/284] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:05:09 2022] GET /identity/v3/users/f08a1cec6c884fab9c08d8774fc22716 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:09.370728 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd3a3c-2982-46ad-9168-0fb919d1e6d8 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:09.436064 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:09.475732 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76f246-0581-4892-a4a6-5d29c115f584 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:09.476081 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76f246-0581-4892-a4a6-5d29c115f584 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:09.476302 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76f246-0581-4892-a4a6-5d29c115f584 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:09.477708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 151/285] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:09.484356 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd3a3c-2982-46ad-9168-0fb919d1e6d8 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:09.486365 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a4cc7-a78d-40bf-b15c-cf82b5ddf67f None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:09.486659 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a4cc7-a78d-40bf-b15c-cf82b5ddf67f None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:09.486935 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a4cc7-a78d-40bf-b15c-cf82b5ddf67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:09.510823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-cc6a4cc7-a78d-40bf-b15c-cf82b5ddf67f None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:09.512107 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-cc6a4cc7-a78d-40bf-b15c-cf82b5ddf67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:09.526447 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254941e9-cfab-42ce-b674-4a4dc96e3756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:09.527343 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254941e9-cfab-42ce-b674-4a4dc96e3756 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:09.528203 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254941e9-cfab-42ce-b674-4a4dc96e3756 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:09.528650 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254941e9-cfab-42ce-b674-4a4dc96e3756 None admin] PATH_INFO: `/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:09.530485 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254941e9-cfab-42ce-b674-4a4dc96e3756 None admin] RBAC: Authorizing `identity:get_project(project_id=8ad529e44aa842e4a9ae1e4cf2872a25)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:09.532258 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254941e9-cfab-42ce-b674-4a4dc96e3756 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:09.534685 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 135/286] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:05:09 2022] GET /identity/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:09.541348 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254941e9-cfab-42ce-b674-4a4dc96e3756 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:09.612236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 152/287] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:09.662572 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254941e9-cfab-42ce-b674-4a4dc96e3756 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:09.686616 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:09.699147 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784a145-1799-4074-9351-85fa3359c100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:09.699821 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784a145-1799-4074-9351-85fa3359c100 None admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:09.700158 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784a145-1799-4074-9351-85fa3359c100 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:09.700440 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784a145-1799-4074-9351-85fa3359c100 None admin] PATH_INFO: `/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25/users/f08a1cec6c884fab9c08d8774fc22716/roles/7fc47a10f402467489b6123c3cb7e260` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:09.702478 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784a145-1799-4074-9351-85fa3359c100 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ad529e44aa842e4a9ae1e4cf2872a25, user_id=f08a1cec6c884fab9c08d8774fc22716, role_id=7fc47a10f402467489b6123c3cb7e260)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:09.703963 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784a145-1799-4074-9351-85fa3359c100 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:09.794886 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 136/288] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 23 04:05:09 2022] PUT /identity/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25/users/f08a1cec6c884fab9c08d8774fc22716/roles/7fc47a10f402467489b6123c3cb7e260 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:05:09.984855 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a4cc7-a78d-40bf-b15c-cf82b5ddf67f None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:10.089445 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:10.101877 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a4cc7-a78d-40bf-b15c-cf82b5ddf67f None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:10.143325 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67472b2-5ba7-4e7e-b208-02339fd760bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:10.143977 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67472b2-5ba7-4e7e-b208-02339fd760bb None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:10.144259 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67472b2-5ba7-4e7e-b208-02339fd760bb None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:10.144530 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67472b2-5ba7-4e7e-b208-02339fd760bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:10.158427 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67472b2-5ba7-4e7e-b208-02339fd760bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:10.163269 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-e67472b2-5ba7-4e7e-b208-02339fd760bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:05:10.163269 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:10.163269 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:10.163269 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:10.163269 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:10.163269 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:10.163269 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:10.163269 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:10.163269 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:10.163269 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:10.163269 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:10.163269 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:10.163269 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:10.163269 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:10.163269 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:10.163269 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:10.164142 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:10.164142 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:10.164142 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:10.164142 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:10.164142 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:10.164142 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:10.164142 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:10.164142 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:10.164142 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:10.164142 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:10.164142 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:10.164142 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:10.164142 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:10.164142 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:10.164142 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:10.164142 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:10.164974 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:10.164974 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:10.164974 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:10.164974 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:10.164974 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:10.164974 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:10.164974 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:10.164974 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:10.164974 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:10.164974 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:10.164974 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:05:10.164974 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:10.164974 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 153/289] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:05:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:10.171538 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784a145-1799-4074-9351-85fa3359c100 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:10.322670 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784a145-1799-4074-9351-85fa3359c100 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:10.370184 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828a4e7-bacb-4a8f-9c48-5644521e8118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:10.370801 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828a4e7-bacb-4a8f-9c48-5644521e8118 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:10.371081 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828a4e7-bacb-4a8f-9c48-5644521e8118 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:10.371354 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828a4e7-bacb-4a8f-9c48-5644521e8118 None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:10.372029 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5828a4e7-bacb-4a8f-9c48-5644521e8118 None admin] RBAC: Adding query filter params (name=member) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:10.372331 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5828a4e7-bacb-4a8f-9c48-5644521e8118 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:10.373790 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5828a4e7-bacb-4a8f-9c48-5644521e8118 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:10.387158 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 137/290] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 23 04:05:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:10.392519 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67472b2-5ba7-4e7e-b208-02339fd760bb None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:10.520348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67472b2-5ba7-4e7e-b208-02339fd760bb None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:10.560103 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b030e2a-764c-4df6-91ca-a1a434572937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:10.560742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b030e2a-764c-4df6-91ca-a1a434572937 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:10.561027 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b030e2a-764c-4df6-91ca-a1a434572937 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:10.561325 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b030e2a-764c-4df6-91ca-a1a434572937 None admin] PATH_INFO: `/v3/users/f19c6d8ab2a5457c81ab2241f506cd6f` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:10.562482 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b030e2a-764c-4df6-91ca-a1a434572937 None admin] RBAC: Authorizing `identity:get_user(user_id=f19c6d8ab2a5457c81ab2241f506cd6f)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:10.563922 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b030e2a-764c-4df6-91ca-a1a434572937 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:10.565538 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 154/291] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:05:10 2022] GET /identity/v3/users/f19c6d8ab2a5457c81ab2241f506cd6f => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:10.571914 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828a4e7-bacb-4a8f-9c48-5644521e8118 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:10.641328 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:10.716098 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828a4e7-bacb-4a8f-9c48-5644521e8118 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:10.754506 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f41f4-8ef1-48cc-a199-ab81ad3391d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:10.755131 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f41f4-8ef1-48cc-a199-ab81ad3391d2 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:10.755414 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f41f4-8ef1-48cc-a199-ab81ad3391d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:10.755689 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f41f4-8ef1-48cc-a199-ab81ad3391d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:10.855640 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f41f4-8ef1-48cc-a199-ab81ad3391d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:10.857147 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f41f4-8ef1-48cc-a199-ab81ad3391d2 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:10.918078 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:10.995634 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 138/292] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:05:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:05:11.001196 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b030e2a-764c-4df6-91ca-a1a434572937 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:11.020354 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:11.128668 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b030e2a-764c-4df6-91ca-a1a434572937 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:11.169138 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973e0c9-80ff-40e8-9f9b-78b9ab449794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:11.169699 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973e0c9-80ff-40e8-9f9b-78b9ab449794 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:11.169981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973e0c9-80ff-40e8-9f9b-78b9ab449794 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:11.170252 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973e0c9-80ff-40e8-9f9b-78b9ab449794 None admin] PATH_INFO: `/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:11.171402 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973e0c9-80ff-40e8-9f9b-78b9ab449794 None admin] RBAC: Authorizing `identity:get_project(project_id=8ad529e44aa842e4a9ae1e4cf2872a25)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:11.172865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973e0c9-80ff-40e8-9f9b-78b9ab449794 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:11.174702 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 155/293] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:05:11 2022] GET /identity/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:11.180503 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f41f4-8ef1-48cc-a199-ab81ad3391d2 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:11.229620 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e28f9c-b873-46b4-a89e-7bbec38ef467 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:11.229923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e28f9c-b873-46b4-a89e-7bbec38ef467 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:11.230165 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e28f9c-b873-46b4-a89e-7bbec38ef467 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:11.231526 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 156/294] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 04:05:11.238517 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58531079-8581-425b-af98-3ffa9f0e500b None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:11.238798 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58531079-8581-425b-af98-3ffa9f0e500b None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:11.239320 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58531079-8581-425b-af98-3ffa9f0e500b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:11.260729 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-58531079-8581-425b-af98-3ffa9f0e500b None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:11.262583 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-58531079-8581-425b-af98-3ffa9f0e500b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:11.354450 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f41f4-8ef1-48cc-a199-ab81ad3391d2 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:11.394694 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 157/295] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:11.435302 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2bbaf5-be8d-4afb-b1dc-e315c2caba5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:11.435853 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bbaf5-be8d-4afb-b1dc-e315c2caba5e None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:11.436140 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bbaf5-be8d-4afb-b1dc-e315c2caba5e None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:11.436419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bbaf5-be8d-4afb-b1dc-e315c2caba5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:11.437189 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2bbaf5-be8d-4afb-b1dc-e315c2caba5e None admin] RBAC: Adding query filter params (role.id=b28fe6f1db4c4738862acb96ff94007c, scope.project.id=8ad529e44aa842e4a9ae1e4cf2872a25, user.id=f19c6d8ab2a5457c81ab2241f506cd6f) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:11.437508 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2bbaf5-be8d-4afb-b1dc-e315c2caba5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:11.438956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2bbaf5-be8d-4afb-b1dc-e315c2caba5e None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:11.450627 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 139/296] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:05:11 2022] GET /identity/v3/role_assignments?user.id=f19c6d8ab2a5457c81ab2241f506cd6f&scope.project.id=8ad529e44aa842e4a9ae1e4cf2872a25&role.id=b28fe6f1db4c4738862acb96ff94007c => generated 608 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:11.706815 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58531079-8581-425b-af98-3ffa9f0e500b None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:11.729187 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:11.756231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc0061-d9ed-4b5b-a121-a08be1708156 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:11.757220 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc0061-d9ed-4b5b-a121-a08be1708156 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:11.757703 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc0061-d9ed-4b5b-a121-a08be1708156 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:11.760131 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 140/297] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:11.765327 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232468ae-a538-4b35-82ea-9598f2e2e9ea None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:11.765889 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232468ae-a538-4b35-82ea-9598f2e2e9ea None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:11.766368 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232468ae-a538-4b35-82ea-9598f2e2e9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:11.797407 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-232468ae-a538-4b35-82ea-9598f2e2e9ea None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:11.798930 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-232468ae-a538-4b35-82ea-9598f2e2e9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:11.803053 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:11.835276 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58531079-8581-425b-af98-3ffa9f0e500b None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:11.885915 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 141/298] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:11.886921 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f69742-76e6-4169-9b75-16cc4b1f14a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:11.887578 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f69742-76e6-4169-9b75-16cc4b1f14a2 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:11.887859 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f69742-76e6-4169-9b75-16cc4b1f14a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:11.888135 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f69742-76e6-4169-9b75-16cc4b1f14a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:11.899118 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f69742-76e6-4169-9b75-16cc4b1f14a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:11.904918 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-03f69742-76e6-4169-9b75-16cc4b1f14a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:05:11.904918 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:11.904918 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:11.904918 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:11.904918 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:11.904918 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:11.904918 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:11.904918 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:11.904918 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:11.904918 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:11.904918 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:11.904918 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:11.904918 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:11.904918 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:11.904918 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:11.904918 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:11.905863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:11.905863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:11.905863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:11.905863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:11.905863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:11.905863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:11.905863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:11.905863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:11.905863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:11.905863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:11.905863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:11.905863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:11.905863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:11.905863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:11.905863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:11.905863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:11.906661 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:11.906661 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:11.906661 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:11.906661 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:11.906661 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:11.906661 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:11.906661 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:11.906661 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:11.906661 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:11.906661 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:11.906661 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:05:11.906661 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:11.906661 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 158/299] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:05:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:11.910033 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2020c-e328-4424-ac60-d60048554d6a None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:11.910033 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2020c-e328-4424-ac60-d60048554d6a None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:11.910234 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2020c-e328-4424-ac60-d60048554d6a None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:11.911680 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 142/300] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:11.913326 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f69742-76e6-4169-9b75-16cc4b1f14a2 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:11.919034 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e9e19-1fc4-49a1-9ec8-9011567e3e36 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:11.919320 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e9e19-1fc4-49a1-9ec8-9011567e3e36 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:11.919600 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e9e19-1fc4-49a1-9ec8-9011567e3e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:11.954259 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-a16e9e19-1fc4-49a1-9ec8-9011567e3e36 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:11.961678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-a16e9e19-1fc4-49a1-9ec8-9011567e3e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:12.016377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:12.051255 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 143/301] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 04:05:12.054483 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f69742-76e6-4169-9b75-16cc4b1f14a2 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:12.091627 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe82b4-7e02-4659-9fda-32260e0dbda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:12.092577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe82b4-7e02-4659-9fda-32260e0dbda8 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:12.093107 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe82b4-7e02-4659-9fda-32260e0dbda8 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:12.093581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe82b4-7e02-4659-9fda-32260e0dbda8 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:12.094452 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe82b4-7e02-4659-9fda-32260e0dbda8 None admin] RBAC: Adding query filter params (name=member) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:12.094951 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe82b4-7e02-4659-9fda-32260e0dbda8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:12.096548 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe82b4-7e02-4659-9fda-32260e0dbda8 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:12.105877 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 159/302] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 23 04:05:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:05:12.114213 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e9e19-1fc4-49a1-9ec8-9011567e3e36 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:12.184035 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe82b4-7e02-4659-9fda-32260e0dbda8 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:12.192225 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:12.240119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e9e19-1fc4-49a1-9ec8-9011567e3e36 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:12.288299 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ae372-adb4-4c6a-a0e2-62b1cdf10243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:12.289119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ae372-adb4-4c6a-a0e2-62b1cdf10243 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:12.289543 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ae372-adb4-4c6a-a0e2-62b1cdf10243 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:12.289832 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ae372-adb4-4c6a-a0e2-62b1cdf10243 None admin] PATH_INFO: `/v3/users/591ad46840ce4a9cae901ab4b4edbfa4` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:12.291298 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ae372-adb4-4c6a-a0e2-62b1cdf10243 None admin] RBAC: Authorizing `identity:get_user(user_id=591ad46840ce4a9cae901ab4b4edbfa4)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:12.293640 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ae372-adb4-4c6a-a0e2-62b1cdf10243 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:12.297121 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 144/303] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:05:12 2022] GET /identity/v3/users/591ad46840ce4a9cae901ab4b4edbfa4 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:12.301292 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ae372-adb4-4c6a-a0e2-62b1cdf10243 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:12.307522 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe82b4-7e02-4659-9fda-32260e0dbda8 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:12.350791 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1dce7b-badc-4b1d-8f5b-70e09120d6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:12.351435 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dce7b-badc-4b1d-8f5b-70e09120d6db None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:12.351719 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dce7b-badc-4b1d-8f5b-70e09120d6db None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:12.351995 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dce7b-badc-4b1d-8f5b-70e09120d6db None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:12.354970 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:12.364458 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1dce7b-badc-4b1d-8f5b-70e09120d6db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:12.370197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-1c1dce7b-badc-4b1d-8f5b-70e09120d6db None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 04:05:12.370197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:12.370197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:12.370197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:12.370197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:12.370197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:12.370197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:12.370197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:12.370197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:12.370197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:12.370197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:12.370197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:12.370197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:12.370197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:12.370197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:12.370197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:12.371327 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:12.371327 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:12.371327 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:12.371327 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:12.371327 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:12.371327 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:12.371327 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:12.371327 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:12.371327 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:12.371327 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:12.371327 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:12.371327 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:12.371327 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:12.371327 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:12.371327 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:12.371327 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:12.372353 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:12.372353 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:12.372353 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:12.372353 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:12.372353 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:12.372353 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:12.372353 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:12.372353 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:12.372353 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:12.372353 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:12.372353 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 04:05:12.372353 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:12.374483 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 160/304] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:05:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:05:12.379924 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1dce7b-badc-4b1d-8f5b-70e09120d6db None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:12.420448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ae372-adb4-4c6a-a0e2-62b1cdf10243 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:12.455195 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63563b95-be14-4ce4-917f-abec2e0829ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:12.455854 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63563b95-be14-4ce4-917f-abec2e0829ef None admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:12.456138 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63563b95-be14-4ce4-917f-abec2e0829ef None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:12.456414 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63563b95-be14-4ce4-917f-abec2e0829ef None admin] PATH_INFO: `/v3/system/users/591ad46840ce4a9cae901ab4b4edbfa4/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:12.457878 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63563b95-be14-4ce4-917f-abec2e0829ef None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=591ad46840ce4a9cae901ab4b4edbfa4, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:12.459252 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63563b95-be14-4ce4-917f-abec2e0829ef None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:12.463788 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:12.483446 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1dce7b-badc-4b1d-8f5b-70e09120d6db None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:12.517770 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809faffe-d36c-4c7d-981d-9393423489e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:12.518562 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809faffe-d36c-4c7d-981d-9393423489e4 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:12.518972 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809faffe-d36c-4c7d-981d-9393423489e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:12.519368 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809faffe-d36c-4c7d-981d-9393423489e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:12.520623 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809faffe-d36c-4c7d-981d-9393423489e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:12.522152 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809faffe-d36c-4c7d-981d-9393423489e4 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:12.523697 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 161/305] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:12.525403 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809faffe-d36c-4c7d-981d-9393423489e4 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:12.565689 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 145/306] 10.222.0.42 () {58 vars in 1334 bytes} [Tue Aug 23 04:05:12 2022] PUT /identity/v3/system/users/591ad46840ce4a9cae901ab4b4edbfa4/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:05:12.566972 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b5c38-b5d3-4548-b14d-44fabfa47030 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:12.567258 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b5c38-b5d3-4548-b14d-44fabfa47030 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:12.567534 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b5c38-b5d3-4548-b14d-44fabfa47030 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:12.568815 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 146/307] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:12.569608 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b5c38-b5d3-4548-b14d-44fabfa47030 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:12.593933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:12.637916 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809faffe-d36c-4c7d-981d-9393423489e4 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:12.676393 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e5d40c-5889-4b1e-a8c7-8fae28934b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:12.677023 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5d40c-5889-4b1e-a8c7-8fae28934b18 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:12.677332 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5d40c-5889-4b1e-a8c7-8fae28934b18 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:12.677604 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5d40c-5889-4b1e-a8c7-8fae28934b18 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:12.678298 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e5d40c-5889-4b1e-a8c7-8fae28934b18 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:12.678600 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e5d40c-5889-4b1e-a8c7-8fae28934b18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:12.680006 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e5d40c-5889-4b1e-a8c7-8fae28934b18 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:12.693901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 162/308] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 23 04:05:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:12.693901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1a6d1-728d-4dd5-ba3b-a76090a04677 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:12.693901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1a6d1-728d-4dd5-ba3b-a76090a04677 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:12.693901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1a6d1-728d-4dd5-ba3b-a76090a04677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:12.707173 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b5c38-b5d3-4548-b14d-44fabfa47030 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:12.711471 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-84b1a6d1-728d-4dd5-ba3b-a76090a04677 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:12.713666 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-84b1a6d1-728d-4dd5-ba3b-a76090a04677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:12.746629 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e5f36-2757-4c35-b852-b2758095b89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:12.747357 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e5f36-2757-4c35-b852-b2758095b89e None admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:12.747637 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e5f36-2757-4c35-b852-b2758095b89e None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:12.747936 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e5f36-2757-4c35-b852-b2758095b89e None admin] PATH_INFO: `/v3/groups` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:12.748527 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e5f36-2757-4c35-b852-b2758095b89e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:12.750367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e5f36-2757-4c35-b852-b2758095b89e None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:12.787246 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 163/309] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:12.788021 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1a6d1-728d-4dd5-ba3b-a76090a04677 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:12.825658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 147/310] 10.222.0.42 () {60 vars in 1134 bytes} [Tue Aug 23 04:05:12 2022] POST /identity/v3/groups => generated 229 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:05:12.916413 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:12.966934 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1a6d1-728d-4dd5-ba3b-a76090a04677 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:13.002431 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56eaee-f4a0-469c-80e6-f69f951234ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:13.003374 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56eaee-f4a0-469c-80e6-f69f951234ae None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:13.003659 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56eaee-f4a0-469c-80e6-f69f951234ae None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:13.003931 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56eaee-f4a0-469c-80e6-f69f951234ae None admin] PATH_INFO: `/v3/users/4bb5fe02aa274536968497803273d48d` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:13.018401 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c56eaee-f4a0-469c-80e6-f69f951234ae None admin] RBAC: Authorizing `identity:get_user(user_id=4bb5fe02aa274536968497803273d48d)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:13.019867 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c56eaee-f4a0-469c-80e6-f69f951234ae None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:13.021747 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 164/311] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:05:12 2022] GET /identity/v3/users/4bb5fe02aa274536968497803273d48d => generated 293 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:13.028105 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e5f36-2757-4c35-b852-b2758095b89e None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:13.075116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56eaee-f4a0-469c-80e6-f69f951234ae None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:13.093186 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:13.138103 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e5f36-2757-4c35-b852-b2758095b89e None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:13.175653 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a529d-37bc-4f45-b244-f3acd0d1a891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:13.176274 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a529d-37bc-4f45-b244-f3acd0d1a891 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:13.176554 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a529d-37bc-4f45-b244-f3acd0d1a891 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:13.176829 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a529d-37bc-4f45-b244-f3acd0d1a891 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:13.177604 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a529d-37bc-4f45-b244-f3acd0d1a891 None admin] RBAC: Adding query filter params (role.id=7fc47a10f402467489b6123c3cb7e260, user.id=4bb5fe02aa274536968497803273d48d, scope.system=all) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:13.177919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a529d-37bc-4f45-b244-f3acd0d1a891 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:13.179377 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a529d-37bc-4f45-b244-f3acd0d1a891 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:13.185697 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 148/312] 10.222.0.42 () {56 vars in 1308 bytes} [Tue Aug 23 04:05:13 2022] GET /identity/v3/role_assignments?user.id=4bb5fe02aa274536968497803273d48d&scope.system=all&role.id=7fc47a10f402467489b6123c3cb7e260 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:13.206549 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56eaee-f4a0-469c-80e6-f69f951234ae None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:13.230351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:13.250794 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0afbd7-d7d3-4abb-a1eb-2f43d309fc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:13.251459 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0afbd7-d7d3-4abb-a1eb-2f43d309fc89 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:13.251739 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0afbd7-d7d3-4abb-a1eb-2f43d309fc89 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:13.252012 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0afbd7-d7d3-4abb-a1eb-2f43d309fc89 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:13.263796 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0afbd7-d7d3-4abb-a1eb-2f43d309fc89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:13.268775 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-7b0afbd7-d7d3-4abb-a1eb-2f43d309fc89 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 04:05:13.268775 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:13.268775 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:13.268775 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:13.268775 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:13.268775 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:13.268775 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:13.268775 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:13.268775 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:13.268775 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:13.268775 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:13.268775 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:13.268775 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:13.268775 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:13.268775 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:13.268775 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:13.269807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:13.269807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:13.269807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:13.269807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:13.269807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:13.269807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:13.269807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:13.269807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:13.269807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:13.269807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:13.269807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:13.269807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:13.269807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:13.269807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:13.269807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:13.269807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:13.270597 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:13.270597 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:13.270597 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:13.270597 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:13.270597 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:13.270597 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:13.270597 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:13.270597 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:13.270597 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:13.270597 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:13.270597 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 04:05:13.270597 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:13.273676 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 165/313] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:05:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:05:13.279694 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a529d-37bc-4f45-b244-f3acd0d1a891 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:13.398827 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a529d-37bc-4f45-b244-f3acd0d1a891 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:13.428922 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:13.440362 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a726fb9-65c0-4b5a-90e7-dbcb6c0fa441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:13.440980 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a726fb9-65c0-4b5a-90e7-dbcb6c0fa441 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:13.441300 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a726fb9-65c0-4b5a-90e7-dbcb6c0fa441 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:13.441577 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a726fb9-65c0-4b5a-90e7-dbcb6c0fa441 None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:13.442245 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a726fb9-65c0-4b5a-90e7-dbcb6c0fa441 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:13.442551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a726fb9-65c0-4b5a-90e7-dbcb6c0fa441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:13.443930 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a726fb9-65c0-4b5a-90e7-dbcb6c0fa441 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:13.453500 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 149/314] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 23 04:05:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:13.459056 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0afbd7-d7d3-4abb-a1eb-2f43d309fc89 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:13.566656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0afbd7-d7d3-4abb-a1eb-2f43d309fc89 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:13.601364 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b1449-3cc3-4449-ba29-c85491372c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:13.602002 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b1449-3cc3-4449-ba29-c85491372c5e None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:13.602277 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b1449-3cc3-4449-ba29-c85491372c5e None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:13.603065 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b1449-3cc3-4449-ba29-c85491372c5e None admin] PATH_INFO: `/v3/users/f08a1cec6c884fab9c08d8774fc22716` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:13.604199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b1449-3cc3-4449-ba29-c85491372c5e None admin] RBAC: Authorizing `identity:get_user(user_id=f08a1cec6c884fab9c08d8774fc22716)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:13.605685 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b1449-3cc3-4449-ba29-c85491372c5e None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:13.607628 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 166/315] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:05:13 2022] GET /identity/v3/users/f08a1cec6c884fab9c08d8774fc22716 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:05:13.612970 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a726fb9-65c0-4b5a-90e7-dbcb6c0fa441 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:13.721571 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a726fb9-65c0-4b5a-90e7-dbcb6c0fa441 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:13.755691 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3571bee-9a9c-4c09-96dd-dec06194743b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:13.756304 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3571bee-9a9c-4c09-96dd-dec06194743b None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:13.756584 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3571bee-9a9c-4c09-96dd-dec06194743b None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:13.756857 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3571bee-9a9c-4c09-96dd-dec06194743b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:13.813659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:13.827325 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3571bee-9a9c-4c09-96dd-dec06194743b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:13.828789 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3571bee-9a9c-4c09-96dd-dec06194743b None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:13.935257 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 150/316] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:05:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:05:13.941210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b1449-3cc3-4449-ba29-c85491372c5e None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:13.989524 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:14.046011 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b1449-3cc3-4449-ba29-c85491372c5e None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:14.081591 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27714063-a22f-42cb-939c-9ff96e612e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:14.082324 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27714063-a22f-42cb-939c-9ff96e612e55 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:14.082603 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27714063-a22f-42cb-939c-9ff96e612e55 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:14.082873 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27714063-a22f-42cb-939c-9ff96e612e55 None admin] PATH_INFO: `/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:14.084045 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27714063-a22f-42cb-939c-9ff96e612e55 None admin] RBAC: Authorizing `identity:get_project(project_id=8ad529e44aa842e4a9ae1e4cf2872a25)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:14.085576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27714063-a22f-42cb-939c-9ff96e612e55 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:14.092106 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 167/317] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:05:13 2022] GET /identity/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:14.093480 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3571bee-9a9c-4c09-96dd-dec06194743b None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:14.183386 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:14.198051 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3571bee-9a9c-4c09-96dd-dec06194743b None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:14.233555 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707bf871-10b7-4331-9ca4-e1dde4069cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:14.234855 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bf871-10b7-4331-9ca4-e1dde4069cc0 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:14.235133 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bf871-10b7-4331-9ca4-e1dde4069cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:14.235406 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bf871-10b7-4331-9ca4-e1dde4069cc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:14.236133 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707bf871-10b7-4331-9ca4-e1dde4069cc0 None admin] RBAC: Adding query filter params (role.id=7fc47a10f402467489b6123c3cb7e260, scope.project.id=8ad529e44aa842e4a9ae1e4cf2872a25, user.id=f08a1cec6c884fab9c08d8774fc22716) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:14.236438 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707bf871-10b7-4331-9ca4-e1dde4069cc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:14.237900 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707bf871-10b7-4331-9ca4-e1dde4069cc0 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:14.249360 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 151/318] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:05:14 2022] GET /identity/v3/role_assignments?user.id=f08a1cec6c884fab9c08d8774fc22716&scope.project.id=8ad529e44aa842e4a9ae1e4cf2872a25&role.id=7fc47a10f402467489b6123c3cb7e260 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:14.518049 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba4f12-58c9-449d-8d18-e6938ba65432 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:14.518384 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba4f12-58c9-449d-8d18-e6938ba65432 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:14.518559 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba4f12-58c9-449d-8d18-e6938ba65432 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:14.520047 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 168/319] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:14.525630 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f1c2f-0071-4885-b043-66b0b33d582b None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:14.525924 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f1c2f-0071-4885-b043-66b0b33d582b None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:14.526202 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f1c2f-0071-4885-b043-66b0b33d582b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:14.544336 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-f91f1c2f-0071-4885-b043-66b0b33d582b None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:14.545563 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-f91f1c2f-0071-4885-b043-66b0b33d582b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:14.615215 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 152/320] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:14.877841 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840001a-9ec1-44b3-9cf7-1b28f31573a6 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:14.878175 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840001a-9ec1-44b3-9cf7-1b28f31573a6 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:14.878349 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840001a-9ec1-44b3-9cf7-1b28f31573a6 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:14.879693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 169/321] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:14.884984 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525a506-4bfc-491f-bc2a-df0bbf9845ed None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:14.885440 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525a506-4bfc-491f-bc2a-df0bbf9845ed None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:14.885599 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525a506-4bfc-491f-bc2a-df0bbf9845ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:14.890701 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840001a-9ec1-44b3-9cf7-1b28f31573a6 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:14.904284 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-b525a506-4bfc-491f-bc2a-df0bbf9845ed None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:14.905494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-b525a506-4bfc-491f-bc2a-df0bbf9845ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:14.984297 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 153/322] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:15.002241 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840001a-9ec1-44b3-9cf7-1b28f31573a6 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:15.014042 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:15.037234 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2d679-920e-4910-a86e-87b0b0eddc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:15.037870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2d679-920e-4910-a86e-87b0b0eddc2e None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:15.038201 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2d679-920e-4910-a86e-87b0b0eddc2e None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:15.038499 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2d679-920e-4910-a86e-87b0b0eddc2e None admin] PATH_INFO: `/v3/roles/member` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:15.050686 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d2d679-920e-4910-a86e-87b0b0eddc2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:15.055418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-20d2d679-920e-4910-a86e-87b0b0eddc2e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:05:15.055418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:15.055418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:15.055418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:15.055418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:15.055418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:15.055418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:15.055418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:15.055418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:15.055418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:15.055418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:15.055418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:15.055418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:15.055418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:15.055418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:15.055418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:15.056560 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:15.056560 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:15.056560 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:15.056560 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:15.056560 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:15.056560 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:15.056560 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:15.056560 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:15.056560 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:15.056560 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:15.056560 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:15.056560 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:15.056560 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:15.056560 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:15.056560 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:15.056560 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:15.061913 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:15.061913 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:15.061913 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:15.061913 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:15.061913 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:15.061913 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:15.061913 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:15.061913 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:15.061913 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:15.061913 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:15.061913 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:05:15.061913 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:15.061913 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 170/323] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:05:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:05:15.062567 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525a506-4bfc-491f-bc2a-df0bbf9845ed None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:15.075916 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:15.162320 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c3a25-30e1-4770-9e6e-35c04bbb1440 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:15.162605 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c3a25-30e1-4770-9e6e-35c04bbb1440 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:15.162883 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c3a25-30e1-4770-9e6e-35c04bbb1440 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:15.164227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 171/324] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 04:05:15.169081 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e6fea-cbcb-4632-b0fc-61777e2840cb None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:15.169392 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e6fea-cbcb-4632-b0fc-61777e2840cb None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:15.169667 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e6fea-cbcb-4632-b0fc-61777e2840cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:15.170732 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525a506-4bfc-491f-bc2a-df0bbf9845ed None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:15.189518 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-c13e6fea-cbcb-4632-b0fc-61777e2840cb None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:15.190866 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-c13e6fea-cbcb-4632-b0fc-61777e2840cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:15.213280 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f6921-5f24-4a66-b3d7-ccd83b6ac23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:15.214049 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f6921-5f24-4a66-b3d7-ccd83b6ac23d None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:15.214331 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f6921-5f24-4a66-b3d7-ccd83b6ac23d None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:15.214603 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f6921-5f24-4a66-b3d7-ccd83b6ac23d None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:15.215362 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f6921-5f24-4a66-b3d7-ccd83b6ac23d None admin] RBAC: Adding query filter params (name=member) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:15.215671 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f6921-5f24-4a66-b3d7-ccd83b6ac23d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:15.217051 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f6921-5f24-4a66-b3d7-ccd83b6ac23d None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:15.225959 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 154/325] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 23 04:05:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:15.231209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f6921-5f24-4a66-b3d7-ccd83b6ac23d None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:15.264498 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 172/326] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 04:05:15.265425 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e6fea-cbcb-4632-b0fc-61777e2840cb None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:15.306935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:15.338386 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f6921-5f24-4a66-b3d7-ccd83b6ac23d None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:15.371120 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:15.373523 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e6fea-cbcb-4632-b0fc-61777e2840cb None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:15.375159 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530d6ec-843c-40e0-aa59-a27f9cdba9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:15.375821 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530d6ec-843c-40e0-aa59-a27f9cdba9d0 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:15.376098 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530d6ec-843c-40e0-aa59-a27f9cdba9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:15.376372 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530d6ec-843c-40e0-aa59-a27f9cdba9d0 None admin] PATH_INFO: `/v3/users/591ad46840ce4a9cae901ab4b4edbfa4` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:15.377529 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530d6ec-843c-40e0-aa59-a27f9cdba9d0 None admin] RBAC: Authorizing `identity:get_user(user_id=591ad46840ce4a9cae901ab4b4edbfa4)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:15.378965 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530d6ec-843c-40e0-aa59-a27f9cdba9d0 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:15.380880 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 155/327] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:05:15 2022] GET /identity/v3/users/591ad46840ce4a9cae901ab4b4edbfa4 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:05:15.387085 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530d6ec-843c-40e0-aa59-a27f9cdba9d0 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:15.408343 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24484748-897d-4428-b600-dbb1d85b16ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:15.408970 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24484748-897d-4428-b600-dbb1d85b16ce None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:15.409276 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24484748-897d-4428-b600-dbb1d85b16ce None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:15.409548 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24484748-897d-4428-b600-dbb1d85b16ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:15.410636 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24484748-897d-4428-b600-dbb1d85b16ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:15.412069 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24484748-897d-4428-b600-dbb1d85b16ce None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:15.413872 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 173/328] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:15.418938 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24484748-897d-4428-b600-dbb1d85b16ce None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:15.496983 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530d6ec-843c-40e0-aa59-a27f9cdba9d0 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:15.528776 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24484748-897d-4428-b600-dbb1d85b16ce None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:15.531383 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00425def-a754-485d-a8c6-dffba93348ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:15.531988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00425def-a754-485d-a8c6-dffba93348ec None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:15.532271 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00425def-a754-485d-a8c6-dffba93348ec None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:15.532544 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00425def-a754-485d-a8c6-dffba93348ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:15.533297 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00425def-a754-485d-a8c6-dffba93348ec None admin] RBAC: Adding query filter params (role.id=b28fe6f1db4c4738862acb96ff94007c, user.id=591ad46840ce4a9cae901ab4b4edbfa4, scope.system=all) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:15.533606 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00425def-a754-485d-a8c6-dffba93348ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:15.535033 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00425def-a754-485d-a8c6-dffba93348ec None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:15.540737 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:15.547376 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 156/329] 10.222.0.42 () {56 vars in 1308 bytes} [Tue Aug 23 04:05:15 2022] GET /identity/v3/role_assignments?user.id=591ad46840ce4a9cae901ab4b4edbfa4&scope.system=all&role.id=b28fe6f1db4c4738862acb96ff94007c => generated 510 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:05:15.553280 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00425def-a754-485d-a8c6-dffba93348ec None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:15.580898 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64361d0-7d7f-4805-94fd-c18045a0120e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:15.581819 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64361d0-7d7f-4805-94fd-c18045a0120e None admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:15.582100 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64361d0-7d7f-4805-94fd-c18045a0120e None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:15.582387 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64361d0-7d7f-4805-94fd-c18045a0120e None admin] PATH_INFO: `/v3/groups` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:15.583044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64361d0-7d7f-4805-94fd-c18045a0120e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:15.584542 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64361d0-7d7f-4805-94fd-c18045a0120e None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:15.656606 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00425def-a754-485d-a8c6-dffba93348ec None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:15.670099 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 174/330] 10.222.0.42 () {60 vars in 1134 bytes} [Tue Aug 23 04:05:15 2022] POST /identity/v3/groups => generated 226 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:05:15.706839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2352c08-6a6f-438f-bfdc-2e57a73f13b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:15.707502 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2352c08-6a6f-438f-bfdc-2e57a73f13b4 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:15.707784 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2352c08-6a6f-438f-bfdc-2e57a73f13b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:15.708060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2352c08-6a6f-438f-bfdc-2e57a73f13b4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:15.724608 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2352c08-6a6f-438f-bfdc-2e57a73f13b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:15.730236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-c2352c08-6a6f-438f-bfdc-2e57a73f13b4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 04:05:15.730236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:15.730236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:15.730236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:15.730236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:15.730236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:15.730236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:15.730236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:15.730236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:15.730236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:15.730236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:15.730236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:15.730236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:15.730236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:15.730236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:15.730236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:15.731209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:15.731209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:15.731209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:15.731209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:15.731209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:15.731209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:15.731209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:15.731209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:15.731209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:15.731209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:15.731209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:15.731209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:15.731209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:15.731209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:15.731209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:15.731209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:15.732228 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:15.732228 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:15.732228 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:15.732228 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:15.732228 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:15.732228 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:15.732228 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:15.732228 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:15.732228 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:15.732228 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:15.732228 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 04:05:15.732228 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:15.732228 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 157/331] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:05:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:15.737538 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64361d0-7d7f-4805-94fd-c18045a0120e None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:15.770578 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:15.848285 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64361d0-7d7f-4805-94fd-c18045a0120e None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:15.881757 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc9b9b-b830-43f2-85cb-87e9139a7bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:15.882372 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc9b9b-b830-43f2-85cb-87e9139a7bc5 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:15.882664 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc9b9b-b830-43f2-85cb-87e9139a7bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:15.882938 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc9b9b-b830-43f2-85cb-87e9139a7bc5 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:15.884154 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc9b9b-b830-43f2-85cb-87e9139a7bc5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:15.884463 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc9b9b-b830-43f2-85cb-87e9139a7bc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:15.885887 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc9b9b-b830-43f2-85cb-87e9139a7bc5 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:15.894014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 175/332] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 23 04:05:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:15.900430 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2352c08-6a6f-438f-bfdc-2e57a73f13b4 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:15.967454 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:16.011431 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2352c08-6a6f-438f-bfdc-2e57a73f13b4 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:16.048113 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f9f7f-2f02-4916-a054-67ca52deaa7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:16.048891 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f9f7f-2f02-4916-a054-67ca52deaa7b None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:16.049274 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f9f7f-2f02-4916-a054-67ca52deaa7b None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:16.049555 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f9f7f-2f02-4916-a054-67ca52deaa7b None admin] PATH_INFO: `/v3/users/4bb5fe02aa274536968497803273d48d` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:16.050704 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f9f7f-2f02-4916-a054-67ca52deaa7b None admin] RBAC: Authorizing `identity:get_user(user_id=4bb5fe02aa274536968497803273d48d)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:16.052150 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f9f7f-2f02-4916-a054-67ca52deaa7b None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:16.054639 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 158/333] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:05:15 2022] GET /identity/v3/users/4bb5fe02aa274536968497803273d48d => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:16.060412 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc9b9b-b830-43f2-85cb-87e9139a7bc5 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:16.162922 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:16.173483 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc9b9b-b830-43f2-85cb-87e9139a7bc5 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:16.208701 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc579d6-8520-41c8-9c52-eda6f4d94309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:16.209736 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc579d6-8520-41c8-9c52-eda6f4d94309 None admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:16.210271 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc579d6-8520-41c8-9c52-eda6f4d94309 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:16.210721 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc579d6-8520-41c8-9c52-eda6f4d94309 None admin] PATH_INFO: `/v3/system/users/4bb5fe02aa274536968497803273d48d/roles/7fc47a10f402467489b6123c3cb7e260` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:16.212968 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc579d6-8520-41c8-9c52-eda6f4d94309 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4bb5fe02aa274536968497803273d48d, role_id=7fc47a10f402467489b6123c3cb7e260)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:16.214751 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc579d6-8520-41c8-9c52-eda6f4d94309 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:16.285915 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 176/334] 10.222.0.42 () {58 vars in 1334 bytes} [Tue Aug 23 04:05:16 2022] PUT /identity/v3/system/users/4bb5fe02aa274536968497803273d48d/roles/7fc47a10f402467489b6123c3cb7e260 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:05:17.875977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1fc40-933b-477b-a120-cfd92a7f07f7 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:17.877214 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1fc40-933b-477b-a120-cfd92a7f07f7 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:17.877763 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1fc40-933b-477b-a120-cfd92a7f07f7 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:17.879612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 159/335] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:17.885589 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664adca4-bc6c-4dc5-8896-ae390b4f4e88 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:17.886456 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664adca4-bc6c-4dc5-8896-ae390b4f4e88 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:17.886951 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664adca4-bc6c-4dc5-8896-ae390b4f4e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:17.912032 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-664adca4-bc6c-4dc5-8896-ae390b4f4e88 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:17.913572 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-664adca4-bc6c-4dc5-8896-ae390b4f4e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:18.005020 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 177/336] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:18.044114 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfb58a-3525-4c2e-b4b3-88e4399979a2 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:18.044444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfb58a-3525-4c2e-b4b3-88e4399979a2 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:18.044692 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfb58a-3525-4c2e-b4b3-88e4399979a2 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:18.046504 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 160/337] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:18.051390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d4feb-43ea-46b4-9a0b-08ad778f346d None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:18.051684 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d4feb-43ea-46b4-9a0b-08ad778f346d None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:18.051954 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d4feb-43ea-46b4-9a0b-08ad778f346d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:18.086155 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-af7d4feb-43ea-46b4-9a0b-08ad778f346d None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:18.087938 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-af7d4feb-43ea-46b4-9a0b-08ad778f346d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:18.170359 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692e899-31be-4ff9-ae5b-6eceaadc52ee None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:18.170664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692e899-31be-4ff9-ae5b-6eceaadc52ee None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:18.170910 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692e899-31be-4ff9-ae5b-6eceaadc52ee None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:18.172254 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 161/338] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:18.178919 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 178/339] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 04:05:18.180476 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e81afe-87be-4ff7-b965-1b2f420150ca None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:18.181017 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e81afe-87be-4ff7-b965-1b2f420150ca None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:18.181315 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e81afe-87be-4ff7-b965-1b2f420150ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:18.215782 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-14e81afe-87be-4ff7-b965-1b2f420150ca None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:18.217294 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-14e81afe-87be-4ff7-b965-1b2f420150ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:18.311753 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 162/340] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:18.462952 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d4feb-43ea-46b4-9a0b-08ad778f346d None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:18.482649 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:18.484479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e81afe-87be-4ff7-b965-1b2f420150ca None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:18.578940 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:18.643824 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d4feb-43ea-46b4-9a0b-08ad778f346d None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:18.659767 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e81afe-87be-4ff7-b965-1b2f420150ca None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:18.703407 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfa724-0713-4043-a0e9-8ad3505bf23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:18.704862 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfa724-0713-4043-a0e9-8ad3505bf23d None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:18.705409 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfa724-0713-4043-a0e9-8ad3505bf23d None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:18.705886 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfa724-0713-4043-a0e9-8ad3505bf23d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:18.719026 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dfa724-0713-4043-a0e9-8ad3505bf23d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:18.724681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-25dfa724-0713-4043-a0e9-8ad3505bf23d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 04:05:18.724681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:18.724681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:18.724681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:18.724681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:18.724681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:18.724681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:18.724681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:18.724681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:18.724681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:18.724681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:18.724681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:18.724681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:18.724681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:18.724681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:18.724681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:18.725645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:18.725645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:18.725645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:18.725645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:18.725645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:18.725645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:18.725645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:18.725645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:18.725645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:18.725645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:18.725645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:18.725645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:18.725645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:18.725645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:18.725645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:18.725645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:18.726453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:18.726453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:18.726453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:18.726453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:18.726453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:18.726453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:18.726453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:18.726453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:18.726453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:18.726453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:18.726453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 04:05:18.726453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:18.729236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 163/341] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 23 04:05:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:18.730430 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfa724-0713-4043-a0e9-8ad3505bf23d None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:18.739176 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18278c1f-2a1a-4f5e-9612-34bf9ddbd5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:18.739840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18278c1f-2a1a-4f5e-9612-34bf9ddbd5d4 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:18.740122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18278c1f-2a1a-4f5e-9612-34bf9ddbd5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:18.740393 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18278c1f-2a1a-4f5e-9612-34bf9ddbd5d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:18.777158 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18278c1f-2a1a-4f5e-9612-34bf9ddbd5d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:18.782144 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-18278c1f-2a1a-4f5e-9612-34bf9ddbd5d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:05:18.782144 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:18.782144 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:18.782144 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:18.782144 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:18.782144 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:18.782144 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:18.782144 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:18.782144 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:18.782144 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:18.782144 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:18.782144 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:18.782144 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:18.782144 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:18.782144 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:18.782144 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:18.783132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:18.783132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:18.783132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:18.783132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:18.783132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:18.783132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:18.783132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:18.783132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:18.783132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:18.783132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:18.783132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:18.783132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:18.783132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:18.783132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:18.783132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:18.783132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:18.783954 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:18.783954 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:18.783954 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:18.783954 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:18.783954 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:18.783954 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:18.783954 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:18.783954 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:18.783954 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:18.783954 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:18.783954 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:05:18.783954 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:18.788315 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 179/342] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:05:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:18.794431 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18278c1f-2a1a-4f5e-9612-34bf9ddbd5d4 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:18.858270 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfa724-0713-4043-a0e9-8ad3505bf23d None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:18.878446 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:18.900478 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cadb06-ae9d-4bae-a68b-2c6047c21f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:18.901378 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cadb06-ae9d-4bae-a68b-2c6047c21f86 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:18.901833 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cadb06-ae9d-4bae-a68b-2c6047c21f86 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:18.902510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cadb06-ae9d-4bae-a68b-2c6047c21f86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:18.914200 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cadb06-ae9d-4bae-a68b-2c6047c21f86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:18.919780 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-47cadb06-ae9d-4bae-a68b-2c6047c21f86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:05:18.919780 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:18.919780 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:18.919780 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:18.919780 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:18.919780 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:18.919780 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:18.919780 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:18.919780 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:18.919780 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:18.919780 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:18.919780 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:18.919780 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:18.919780 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:18.919780 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:18.919780 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:18.922672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:18.922672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:18.922672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:18.922672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:18.922672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:18.922672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:18.922672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:18.922672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:18.922672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:18.922672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:18.922672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:18.922672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:18.922672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:18.922672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:18.922672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:18.922672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:18.923513 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:18.923513 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:18.923513 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:18.923513 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:18.923513 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:18.923513 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:18.923513 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:18.923513 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:18.923513 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:18.923513 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:18.923513 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:05:18.923513 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:18.923513 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 164/343] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:05:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:18.923513 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cadb06-ae9d-4bae-a68b-2c6047c21f86 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:18.969582 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:19.034214 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18278c1f-2a1a-4f5e-9612-34bf9ddbd5d4 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:19.045314 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cadb06-ae9d-4bae-a68b-2c6047c21f86 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:19.074201 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abe43b-8894-40c9-b4bb-19b75cdf3b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:19.075057 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abe43b-8894-40c9-b4bb-19b75cdf3b13 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:19.075513 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abe43b-8894-40c9-b4bb-19b75cdf3b13 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:19.075930 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abe43b-8894-40c9-b4bb-19b75cdf3b13 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:19.076836 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abe43b-8894-40c9-b4bb-19b75cdf3b13 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:19.077349 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abe43b-8894-40c9-b4bb-19b75cdf3b13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:19.078898 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abe43b-8894-40c9-b4bb-19b75cdf3b13 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:19.089452 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 180/344] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:05:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:19.090690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abe43b-8894-40c9-b4bb-19b75cdf3b13 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:19.099077 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cd2ec-90d4-4708-a1ec-d588a0d3dc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:19.099717 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cd2ec-90d4-4708-a1ec-d588a0d3dc2f None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:19.099996 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cd2ec-90d4-4708-a1ec-d588a0d3dc2f None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:19.100513 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cd2ec-90d4-4708-a1ec-d588a0d3dc2f None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:19.101370 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6cd2ec-90d4-4708-a1ec-d588a0d3dc2f None admin] RBAC: Adding query filter params (name=member) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:19.101896 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6cd2ec-90d4-4708-a1ec-d588a0d3dc2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:19.103424 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6cd2ec-90d4-4708-a1ec-d588a0d3dc2f None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:19.114121 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 165/345] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 23 04:05:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:19.115200 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cd2ec-90d4-4708-a1ec-d588a0d3dc2f None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:19.157653 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:19.204978 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abe43b-8894-40c9-b4bb-19b75cdf3b13 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:19.253866 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cd2ec-90d4-4708-a1ec-d588a0d3dc2f None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:19.257398 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d0f54-9a88-4b43-8972-6e1554809d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:19.258044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d0f54-9a88-4b43-8972-6e1554809d95 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:19.258905 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d0f54-9a88-4b43-8972-6e1554809d95 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:19.259178 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d0f54-9a88-4b43-8972-6e1554809d95 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:19.259861 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d0f54-9a88-4b43-8972-6e1554809d95 None admin] RBAC: Adding query filter params (name=member) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:19.260167 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d0f54-9a88-4b43-8972-6e1554809d95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:19.261587 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d0f54-9a88-4b43-8972-6e1554809d95 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:19.264129 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:19.272052 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 181/346] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 23 04:05:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:19.272970 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d0f54-9a88-4b43-8972-6e1554809d95 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:19.300020 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b76431-7eab-48d6-977e-0460d0895773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:19.301603 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b76431-7eab-48d6-977e-0460d0895773 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:19.302102 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b76431-7eab-48d6-977e-0460d0895773 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:19.302527 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b76431-7eab-48d6-977e-0460d0895773 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:19.394370 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d0f54-9a88-4b43-8972-6e1554809d95 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:19.404977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b76431-7eab-48d6-977e-0460d0895773 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:19.406686 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b76431-7eab-48d6-977e-0460d0895773 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:19.443360 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aab707-1d02-4b17-ab03-003d842818b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:19.444633 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aab707-1d02-4b17-ab03-003d842818b1 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:19.445355 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aab707-1d02-4b17-ab03-003d842818b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:19.446303 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aab707-1d02-4b17-ab03-003d842818b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:19.457412 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:19.529629 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 166/347] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:05:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:05:19.530123 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:19.531392 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c534d1-a9ef-4e3d-918e-31e53b74e088 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:19.531827 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c534d1-a9ef-4e3d-918e-31e53b74e088 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:19.532308 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c534d1-a9ef-4e3d-918e-31e53b74e088 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:19.533730 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 167/348] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:19.534718 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c534d1-a9ef-4e3d-918e-31e53b74e088 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:19.542502 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aab707-1d02-4b17-ab03-003d842818b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:19.544203 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aab707-1d02-4b17-ab03-003d842818b1 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:19.657891 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c534d1-a9ef-4e3d-918e-31e53b74e088 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:19.678484 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 182/349] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:05:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:05:19.679876 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd11a9-7c5e-4e84-861e-49e116c2e0a4 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:19.680175 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd11a9-7c5e-4e84-861e-49e116c2e0a4 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:19.680454 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd11a9-7c5e-4e84-861e-49e116c2e0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:19.700257 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb713ba-99fd-42eb-a0ca-418f3000240a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:19.701213 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb713ba-99fd-42eb-a0ca-418f3000240a None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:19.701663 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb713ba-99fd-42eb-a0ca-418f3000240a None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:19.702076 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb713ba-99fd-42eb-a0ca-418f3000240a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:19.702766 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-85cd11a9-7c5e-4e84-861e-49e116c2e0a4 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:19.704024 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-85cd11a9-7c5e-4e84-861e-49e116c2e0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:19.712353 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:19.781870 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb713ba-99fd-42eb-a0ca-418f3000240a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:19.785485 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb713ba-99fd-42eb-a0ca-418f3000240a None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:19.790864 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 183/350] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:19.791965 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd11a9-7c5e-4e84-861e-49e116c2e0a4 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:19.841299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:19.931306 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd11a9-7c5e-4e84-861e-49e116c2e0a4 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:19.953733 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 168/351] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:05:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:05:19.955340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb713ba-99fd-42eb-a0ca-418f3000240a None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:19.980393 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c506410-c15e-4b1f-b8a2-665516c186f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:19.981014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c506410-c15e-4b1f-b8a2-665516c186f4 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:19.981196 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c506410-c15e-4b1f-b8a2-665516c186f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:19.981473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c506410-c15e-4b1f-b8a2-665516c186f4 None admin] PATH_INFO: `/v3/projects/3371d174840948c183eab2505d3b2776` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:19.982744 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c506410-c15e-4b1f-b8a2-665516c186f4 None admin] RBAC: Authorizing `identity:get_project(project_id=3371d174840948c183eab2505d3b2776)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:19.984318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c506410-c15e-4b1f-b8a2-665516c186f4 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:19.987286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 184/352] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:05:19 2022] GET /identity/v3/projects/3371d174840948c183eab2505d3b2776 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:19.987646 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351a085-f6cd-41e2-aca8-99e59965182c None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:19.987923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351a085-f6cd-41e2-aca8-99e59965182c None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:19.988190 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351a085-f6cd-41e2-aca8-99e59965182c None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:19.995070 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 185/353] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:19.995070 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351a085-f6cd-41e2-aca8-99e59965182c None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:20.031154 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:20.098947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb713ba-99fd-42eb-a0ca-418f3000240a None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:20.106082 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:20.113394 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351a085-f6cd-41e2-aca8-99e59965182c None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:20.136409 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5ba5b-3b3a-4263-8016-2e2bd8df9fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:20.137078 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5ba5b-3b3a-4263-8016-2e2bd8df9fdf None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:20.137375 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5ba5b-3b3a-4263-8016-2e2bd8df9fdf None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:20.137648 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5ba5b-3b3a-4263-8016-2e2bd8df9fdf None admin] PATH_INFO: `/v3/projects/3371d174840948c183eab2505d3b2776` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:20.138836 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5ba5b-3b3a-4263-8016-2e2bd8df9fdf None admin] RBAC: Authorizing `identity:get_project(project_id=3371d174840948c183eab2505d3b2776)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:20.140290 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5ba5b-3b3a-4263-8016-2e2bd8df9fdf None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:20.145165 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 169/354] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:05:19 2022] GET /identity/v3/projects/3371d174840948c183eab2505d3b2776 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:20.145165 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5ba5b-3b3a-4263-8016-2e2bd8df9fdf None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:20.156629 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8ea9f-8d50-4afd-9d70-3ce242e64112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:20.157833 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8ea9f-8d50-4afd-9d70-3ce242e64112 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:20.158128 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8ea9f-8d50-4afd-9d70-3ce242e64112 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:20.158405 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8ea9f-8d50-4afd-9d70-3ce242e64112 None admin] PATH_INFO: `/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:20.159702 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8ea9f-8d50-4afd-9d70-3ce242e64112 None admin] RBAC: Authorizing `identity:get_project(project_id=8ad529e44aa842e4a9ae1e4cf2872a25)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:20.161174 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8ea9f-8d50-4afd-9d70-3ce242e64112 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:20.162988 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 186/355] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:05:19 2022] GET /identity/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:20.164068 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb9824-83ef-465a-be6d-66744d355b05 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:20.164906 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb9824-83ef-465a-be6d-66744d355b05 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:20.165225 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb9824-83ef-465a-be6d-66744d355b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:20.185747 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-ffeb9824-83ef-465a-be6d-66744d355b05 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:20.186924 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-ffeb9824-83ef-465a-be6d-66744d355b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:20.265717 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 187/356] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:20.266398 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb9824-83ef-465a-be6d-66744d355b05 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:20.279917 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5ba5b-3b3a-4263-8016-2e2bd8df9fdf None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:20.290351 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:20.322694 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04eeb9-e623-486c-90db-eba072fdf2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:20.323461 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04eeb9-e623-486c-90db-eba072fdf2ed None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:20.323643 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04eeb9-e623-486c-90db-eba072fdf2ed None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:20.323890 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04eeb9-e623-486c-90db-eba072fdf2ed None admin] PATH_INFO: `/v3/groups/bb03563be2cb4a998da81229f24b27a0` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:20.334277 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04eeb9-e623-486c-90db-eba072fdf2ed None admin] RBAC: Authorizing `identity:get_group(group_id=bb03563be2cb4a998da81229f24b27a0)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:20.335774 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04eeb9-e623-486c-90db-eba072fdf2ed None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:20.338676 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 170/357] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 23 04:05:20 2022] GET /identity/v3/groups/bb03563be2cb4a998da81229f24b27a0 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:20.343970 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04eeb9-e623-486c-90db-eba072fdf2ed None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:20.395942 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:20.404735 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb9824-83ef-465a-be6d-66744d355b05 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:20.450542 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c137209-c1c1-4a83-bdef-30247ecb77d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:20.451619 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c137209-c1c1-4a83-bdef-30247ecb77d6 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:20.452098 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c137209-c1c1-4a83-bdef-30247ecb77d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:20.452566 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c137209-c1c1-4a83-bdef-30247ecb77d6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:20.467504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c137209-c1c1-4a83-bdef-30247ecb77d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:20.470299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-1c137209-c1c1-4a83-bdef-30247ecb77d6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 04:05:20.470299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:20.470299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:20.470299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:20.470299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:20.470299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:20.470299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:20.470299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:20.470299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:20.470299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:20.470299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:20.470299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:20.470299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:20.470299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:20.470299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:20.470299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:20.471412 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:20.471412 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:20.471412 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:20.471412 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:20.471412 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:20.471412 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:20.471412 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:20.471412 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:20.471412 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:20.471412 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:20.471412 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:20.471412 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:20.471412 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:20.471412 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:20.471412 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:20.471412 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:20.472434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:20.472434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:20.472434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:20.472434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:20.472434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:20.472434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:20.472434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:20.472434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:20.472434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:20.472434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:20.472434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 04:05:20.472434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:20.472434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 188/358] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:05:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:20.477919 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c137209-c1c1-4a83-bdef-30247ecb77d6 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:20.480583 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04eeb9-e623-486c-90db-eba072fdf2ed None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:20.528803 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a5703-7de1-4847-8937-f666e7219272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:20.529883 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a5703-7de1-4847-8937-f666e7219272 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:20.530365 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a5703-7de1-4847-8937-f666e7219272 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:20.530839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a5703-7de1-4847-8937-f666e7219272 None admin] PATH_INFO: `/v3/groups/bb03563be2cb4a998da81229f24b27a0` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:20.532232 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a5703-7de1-4847-8937-f666e7219272 None admin] RBAC: Authorizing `identity:get_group(group_id=bb03563be2cb4a998da81229f24b27a0)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:20.534416 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a5703-7de1-4847-8937-f666e7219272 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:20.537223 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 171/359] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 23 04:05:20 2022] GET /identity/v3/groups/bb03563be2cb4a998da81229f24b27a0 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:20.538782 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98977e1-43b7-4621-8601-46b225eb5796 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:20.539210 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98977e1-43b7-4621-8601-46b225eb5796 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:20.539576 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98977e1-43b7-4621-8601-46b225eb5796 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:20.542433 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 172/360] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:20.542433 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98977e1-43b7-4621-8601-46b225eb5796 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:20.590003 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:20.615049 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c137209-c1c1-4a83-bdef-30247ecb77d6 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:20.660235 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deef38c-716b-4937-9fa3-c52417f05e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:20.661166 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deef38c-716b-4937-9fa3-c52417f05e46 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:20.661166 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deef38c-716b-4937-9fa3-c52417f05e46 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:20.661413 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deef38c-716b-4937-9fa3-c52417f05e46 None admin] PATH_INFO: `/v3/groups/bb03563be2cb4a998da81229f24b27a0` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:20.662506 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deef38c-716b-4937-9fa3-c52417f05e46 None admin] RBAC: Authorizing `identity:get_group(group_id=bb03563be2cb4a998da81229f24b27a0)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:20.664219 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deef38c-716b-4937-9fa3-c52417f05e46 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:20.665598 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 189/361] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 23 04:05:20 2022] GET /identity/v3/groups/bb03563be2cb4a998da81229f24b27a0 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:20.666436 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deef38c-716b-4937-9fa3-c52417f05e46 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:20.677364 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98977e1-43b7-4621-8601-46b225eb5796 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:20.696755 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:20.724461 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9a865-386b-44f9-93d0-841cd603e32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:20.725081 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9a865-386b-44f9-93d0-841cd603e32b None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:20.725391 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9a865-386b-44f9-93d0-841cd603e32b None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:20.725704 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9a865-386b-44f9-93d0-841cd603e32b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:20.726406 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f9a865-386b-44f9-93d0-841cd603e32b None admin] RBAC: Adding query filter params (group.id=bb03563be2cb4a998da81229f24b27a0, role.id=5434f93251a0417c890b94b90b40ab71, scope.project.id=3371d174840948c183eab2505d3b2776) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:20.726754 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f9a865-386b-44f9-93d0-841cd603e32b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:20.728196 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f9a865-386b-44f9-93d0-841cd603e32b None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:20.733948 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 173/362] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Aug 23 04:05:20 2022] GET /identity/v3/role_assignments?group.id=bb03563be2cb4a998da81229f24b27a0&scope.project.id=3371d174840948c183eab2505d3b2776&role.id=5434f93251a0417c890b94b90b40ab71 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:20.734834 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9a865-386b-44f9-93d0-841cd603e32b None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:20.803416 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deef38c-716b-4937-9fa3-c52417f05e46 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:20.851975 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b945017-7fe3-440c-8878-18221b5fcdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:20.853056 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b945017-7fe3-440c-8878-18221b5fcdc7 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:20.853407 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b945017-7fe3-440c-8878-18221b5fcdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:20.853686 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b945017-7fe3-440c-8878-18221b5fcdc7 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:20.854392 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b945017-7fe3-440c-8878-18221b5fcdc7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:20.854700 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b945017-7fe3-440c-8878-18221b5fcdc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:20.856834 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b945017-7fe3-440c-8878-18221b5fcdc7 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:20.870888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 190/363] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 23 04:05:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:20.871309 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183eab05-025f-4c6d-9477-c9fabe342503 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:20.871602 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183eab05-025f-4c6d-9477-c9fabe342503 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:20.871876 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183eab05-025f-4c6d-9477-c9fabe342503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:20.872754 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9a865-386b-44f9-93d0-841cd603e32b None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:20.881343 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:20.892445 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-183eab05-025f-4c6d-9477-c9fabe342503 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:20.893693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-183eab05-025f-4c6d-9477-c9fabe342503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:20.911729 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c84a14-e236-4daf-abec-fcd6801671c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:20.912240 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c84a14-e236-4daf-abec-fcd6801671c2 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:20.912579 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c84a14-e236-4daf-abec-fcd6801671c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:20.912808 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c84a14-e236-4daf-abec-fcd6801671c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:20.930953 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c84a14-e236-4daf-abec-fcd6801671c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:20.936629 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-89c84a14-e236-4daf-abec-fcd6801671c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 04:05:20.936629 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:20.936629 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:20.936629 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:20.936629 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:20.936629 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:20.936629 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:20.936629 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:20.936629 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:20.936629 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:20.936629 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:20.936629 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:20.936629 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:20.936629 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:20.936629 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:20.936629 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:20.937630 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:20.937630 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:20.937630 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:20.937630 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:20.937630 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:20.937630 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:20.937630 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:20.937630 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:20.937630 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:20.937630 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:20.937630 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:20.937630 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:20.937630 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:20.937630 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:20.937630 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:20.937630 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:20.938459 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:20.938459 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:20.938459 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:20.938459 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:20.938459 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:20.938459 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:20.938459 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:20.938459 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:20.938459 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:20.938459 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:20.938459 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 04:05:20.938459 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:20.939631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 174/364] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 23 04:05:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:20.939789 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c84a14-e236-4daf-abec-fcd6801671c2 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:20.981348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 191/365] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:20.982228 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183eab05-025f-4c6d-9477-c9fabe342503 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:21.013459 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:21.081657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c84a14-e236-4daf-abec-fcd6801671c2 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:21.097519 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183eab05-025f-4c6d-9477-c9fabe342503 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:21.125163 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc15859-1a71-4d8d-b7a1-227eabf3e33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:21.125876 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc15859-1a71-4d8d-b7a1-227eabf3e33d None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:21.126262 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc15859-1a71-4d8d-b7a1-227eabf3e33d None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:21.126604 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc15859-1a71-4d8d-b7a1-227eabf3e33d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:21.127404 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc15859-1a71-4d8d-b7a1-227eabf3e33d None admin] RBAC: Adding query filter params (group.id=bb03563be2cb4a998da81229f24b27a0, role.id=b28fe6f1db4c4738862acb96ff94007c, scope.project.id=3371d174840948c183eab2505d3b2776) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:21.127783 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc15859-1a71-4d8d-b7a1-227eabf3e33d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:21.129402 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc15859-1a71-4d8d-b7a1-227eabf3e33d None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:21.136149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 175/366] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Aug 23 04:05:20 2022] GET /identity/v3/role_assignments?group.id=bb03563be2cb4a998da81229f24b27a0&scope.project.id=3371d174840948c183eab2505d3b2776&role.id=b28fe6f1db4c4738862acb96ff94007c => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:21.137109 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc15859-1a71-4d8d-b7a1-227eabf3e33d None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:21.142392 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c7cd8-f492-48b8-8bcc-c6311cfacb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:21.144613 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c7cd8-f492-48b8-8bcc-c6311cfacb9f None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:21.144922 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c7cd8-f492-48b8-8bcc-c6311cfacb9f None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:21.145231 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c7cd8-f492-48b8-8bcc-c6311cfacb9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:21.146023 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c7cd8-f492-48b8-8bcc-c6311cfacb9f None admin] RBAC: Adding query filter params (group.id=bb03563be2cb4a998da81229f24b27a0, role.id=b28fe6f1db4c4738862acb96ff94007c, scope.project.id=8ad529e44aa842e4a9ae1e4cf2872a25) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:21.147283 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c7cd8-f492-48b8-8bcc-c6311cfacb9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:21.150446 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c7cd8-f492-48b8-8bcc-c6311cfacb9f None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:21.166767 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 192/367] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Aug 23 04:05:20 2022] GET /identity/v3/role_assignments?group.id=bb03563be2cb4a998da81229f24b27a0&scope.project.id=8ad529e44aa842e4a9ae1e4cf2872a25&role.id=b28fe6f1db4c4738862acb96ff94007c => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:21.167569 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c7cd8-f492-48b8-8bcc-c6311cfacb9f None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:21.197462 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:21.317025 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc15859-1a71-4d8d-b7a1-227eabf3e33d None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:21.336868 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:21.358182 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ae86b-0ef1-4717-b508-c438f6bb6aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:21.359147 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ae86b-0ef1-4717-b508-c438f6bb6aa7 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:21.359608 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ae86b-0ef1-4717-b508-c438f6bb6aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:21.360059 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ae86b-0ef1-4717-b508-c438f6bb6aa7 None admin] PATH_INFO: `/v3/users/4bb5fe02aa274536968497803273d48d` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:21.361526 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ae86b-0ef1-4717-b508-c438f6bb6aa7 None admin] RBAC: Authorizing `identity:get_user(user_id=4bb5fe02aa274536968497803273d48d)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:21.363207 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ae86b-0ef1-4717-b508-c438f6bb6aa7 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:21.365037 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 176/368] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:05:21 2022] GET /identity/v3/users/4bb5fe02aa274536968497803273d48d => generated 293 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:21.365655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c7cd8-f492-48b8-8bcc-c6311cfacb9f None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:21.366275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ae86b-0ef1-4717-b508-c438f6bb6aa7 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:21.406195 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62c1f6-1385-4c45-a481-d6e9feb802a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:21.407008 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62c1f6-1385-4c45-a481-d6e9feb802a8 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:21.407351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62c1f6-1385-4c45-a481-d6e9feb802a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:21.407691 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62c1f6-1385-4c45-a481-d6e9feb802a8 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:21.408440 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f62c1f6-1385-4c45-a481-d6e9feb802a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:21.408808 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f62c1f6-1385-4c45-a481-d6e9feb802a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:21.410307 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f62c1f6-1385-4c45-a481-d6e9feb802a8 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:21.425512 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 193/369] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:05:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:21.426231 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62c1f6-1385-4c45-a481-d6e9feb802a8 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:21.535376 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:21.545338 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ae86b-0ef1-4717-b508-c438f6bb6aa7 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:21.565866 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62c1f6-1385-4c45-a481-d6e9feb802a8 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:21.594960 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe71782-e58a-4227-9856-778a8255887a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:21.595609 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe71782-e58a-4227-9856-778a8255887a None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:21.595891 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe71782-e58a-4227-9856-778a8255887a None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:21.596163 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe71782-e58a-4227-9856-778a8255887a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:21.609119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe71782-e58a-4227-9856-778a8255887a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:21.611296 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bc6d1-c854-49e8-843c-8d114ebbcfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:21.612003 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bc6d1-c854-49e8-843c-8d114ebbcfb2 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:21.612352 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bc6d1-c854-49e8-843c-8d114ebbcfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:21.612693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bc6d1-c854-49e8-843c-8d114ebbcfb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:21.613529 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bc6d1-c854-49e8-843c-8d114ebbcfb2 None admin] RBAC: Adding query filter params (role.id=7fc47a10f402467489b6123c3cb7e260, user.id=4bb5fe02aa274536968497803273d48d, scope.system=all) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:21.613905 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bc6d1-c854-49e8-843c-8d114ebbcfb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:21.614223 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-3fe71782-e58a-4227-9856-778a8255887a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:05:21.614223 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:21.614223 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:21.614223 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:21.614223 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:21.614223 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:21.614223 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:21.614223 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:21.614223 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:21.614223 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:21.614223 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:21.614223 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:21.614223 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:21.614223 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:21.614223 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:21.614223 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:21.615101 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:21.615101 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:21.615101 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:21.615101 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:21.615101 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:21.615101 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:21.615101 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:21.615101 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:21.615101 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:21.615101 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:21.615101 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:21.615101 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:21.615101 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:21.615101 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:21.615101 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:21.615101 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:21.616352 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:21.616352 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:21.616352 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:21.616352 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:21.616352 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:21.616352 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:21.616352 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:21.616352 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:21.616352 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:21.616352 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:21.616352 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:05:21.616352 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:21.617047 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bc6d1-c854-49e8-843c-8d114ebbcfb2 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:21.617148 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 177/370] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:05:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:21.618541 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe71782-e58a-4227-9856-778a8255887a None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:21.623176 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:21.631868 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 194/371] 10.222.0.42 () {56 vars in 1308 bytes} [Tue Aug 23 04:05:21 2022] GET /identity/v3/role_assignments?user.id=4bb5fe02aa274536968497803273d48d&scope.system=all&role.id=7fc47a10f402467489b6123c3cb7e260 => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:21.632940 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bc6d1-c854-49e8-843c-8d114ebbcfb2 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:21.795839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe71782-e58a-4227-9856-778a8255887a None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:21.830193 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bc6d1-c854-49e8-843c-8d114ebbcfb2 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:21.869008 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc96b5f-3277-45ba-9580-eea55c8fe697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:21.870592 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc96b5f-3277-45ba-9580-eea55c8fe697 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:21.870874 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc96b5f-3277-45ba-9580-eea55c8fe697 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:21.871149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc96b5f-3277-45ba-9580-eea55c8fe697 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:21.902294 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:21.912336 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7bac9-2066-46cf-b64e-f16579da4956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:21.912970 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7bac9-2066-46cf-b64e-f16579da4956 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:21.913279 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7bac9-2066-46cf-b64e-f16579da4956 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:21.913556 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7bac9-2066-46cf-b64e-f16579da4956 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:21.914283 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7bac9-2066-46cf-b64e-f16579da4956 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:21.914590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7bac9-2066-46cf-b64e-f16579da4956 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:21.915970 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7bac9-2066-46cf-b64e-f16579da4956 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:21.935445 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 195/372] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:05:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:21.941878 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7bac9-2066-46cf-b64e-f16579da4956 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:21.971896 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc96b5f-3277-45ba-9580-eea55c8fe697 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:21.973421 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc96b5f-3277-45ba-9580-eea55c8fe697 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:22.063745 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:22.109148 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 178/373] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:05:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:05:22.116311 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc96b5f-3277-45ba-9580-eea55c8fe697 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:22.152292 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7bac9-2066-46cf-b64e-f16579da4956 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:22.229881 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86585ba1-0119-49ad-9d69-e32b35d67a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:22.230505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86585ba1-0119-49ad-9d69-e32b35d67a23 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:22.230789 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86585ba1-0119-49ad-9d69-e32b35d67a23 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:22.231064 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86585ba1-0119-49ad-9d69-e32b35d67a23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:22.253569 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:22.330015 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc96b5f-3277-45ba-9580-eea55c8fe697 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:22.377964 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86585ba1-0119-49ad-9d69-e32b35d67a23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:22.379458 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86585ba1-0119-49ad-9d69-e32b35d67a23 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:22.410614 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c32f3-5ca0-4cf4-9702-e6d4c5e1b556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:22.411259 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c32f3-5ca0-4cf4-9702-e6d4c5e1b556 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:22.411539 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c32f3-5ca0-4cf4-9702-e6d4c5e1b556 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:22.411814 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c32f3-5ca0-4cf4-9702-e6d4c5e1b556 None admin] PATH_INFO: `/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:22.420980 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c32f3-5ca0-4cf4-9702-e6d4c5e1b556 None admin] RBAC: Authorizing `identity:get_project(project_id=8ad529e44aa842e4a9ae1e4cf2872a25)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:22.420980 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c32f3-5ca0-4cf4-9702-e6d4c5e1b556 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:22.420980 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 179/374] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:05:22 2022] GET /identity/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25 => generated 302 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:22.426509 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c32f3-5ca0-4cf4-9702-e6d4c5e1b556 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:22.489888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:22.580957 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 196/375] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:05:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 04:05:22.587003 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86585ba1-0119-49ad-9d69-e32b35d67a23 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:22.591651 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c32f3-5ca0-4cf4-9702-e6d4c5e1b556 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:22.623217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:22.639123 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f68ed2-9f10-45ec-bd78-35da66b52dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:22.640151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f68ed2-9f10-45ec-bd78-35da66b52dfa None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:22.640612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f68ed2-9f10-45ec-bd78-35da66b52dfa None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:22.641316 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f68ed2-9f10-45ec-bd78-35da66b52dfa None admin] PATH_INFO: `/v3/groups/bb03563be2cb4a998da81229f24b27a0` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:22.643078 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f68ed2-9f10-45ec-bd78-35da66b52dfa None admin] RBAC: Authorizing `identity:get_group(group_id=bb03563be2cb4a998da81229f24b27a0)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:22.644999 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f68ed2-9f10-45ec-bd78-35da66b52dfa None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:22.647350 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 180/376] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 23 04:05:22 2022] GET /identity/v3/groups/bb03563be2cb4a998da81229f24b27a0 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:05:22.656401 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f68ed2-9f10-45ec-bd78-35da66b52dfa None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:22.798399 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86585ba1-0119-49ad-9d69-e32b35d67a23 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:22.860886 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f68ed2-9f10-45ec-bd78-35da66b52dfa None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:22.869789 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324fc76-8f70-497b-a8fe-e4c334f53e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:22.870449 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324fc76-8f70-497b-a8fe-e4c334f53e0d None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:22.870730 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324fc76-8f70-497b-a8fe-e4c334f53e0d None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:22.871002 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324fc76-8f70-497b-a8fe-e4c334f53e0d None admin] PATH_INFO: `/v3/projects/cb9c03cfd85c4ddcb76ee846b01a3645` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:22.872187 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324fc76-8f70-497b-a8fe-e4c334f53e0d None admin] RBAC: Authorizing `identity:get_project(project_id=cb9c03cfd85c4ddcb76ee846b01a3645)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:22.873658 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324fc76-8f70-497b-a8fe-e4c334f53e0d None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:22.875582 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 197/377] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:05:22 2022] GET /identity/v3/projects/cb9c03cfd85c4ddcb76ee846b01a3645 => generated 344 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:05:22.880812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324fc76-8f70-497b-a8fe-e4c334f53e0d None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:22.902341 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd740a-d4d6-46c6-b5ef-36303978ca6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:22.903185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd740a-d4d6-46c6-b5ef-36303978ca6c None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:22.903623 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd740a-d4d6-46c6-b5ef-36303978ca6c None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:22.904172 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd740a-d4d6-46c6-b5ef-36303978ca6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:22.905205 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd740a-d4d6-46c6-b5ef-36303978ca6c None admin] RBAC: Adding query filter params (group.id=bb03563be2cb4a998da81229f24b27a0, role.id=5434f93251a0417c890b94b90b40ab71, scope.project.id=8ad529e44aa842e4a9ae1e4cf2872a25) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:22.905666 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd740a-d4d6-46c6-b5ef-36303978ca6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:22.907255 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd740a-d4d6-46c6-b5ef-36303978ca6c None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:22.914671 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 181/378] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Aug 23 04:05:22 2022] GET /identity/v3/role_assignments?group.id=bb03563be2cb4a998da81229f24b27a0&scope.project.id=8ad529e44aa842e4a9ae1e4cf2872a25&role.id=5434f93251a0417c890b94b90b40ab71 => generated 260 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:22.937713 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:23.056255 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324fc76-8f70-497b-a8fe-e4c334f53e0d None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:23.108734 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37aecd-60a8-4b10-a3c9-bc31583f4dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:23.110116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37aecd-60a8-4b10-a3c9-bc31583f4dfb None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:23.110549 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37aecd-60a8-4b10-a3c9-bc31583f4dfb None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:23.111055 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37aecd-60a8-4b10-a3c9-bc31583f4dfb None admin] PATH_INFO: `/v3/groups/a3449354463645829a7d154c7bd49fee` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:23.118880 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37aecd-60a8-4b10-a3c9-bc31583f4dfb None admin] RBAC: Authorizing `identity:get_group(group_id=a3449354463645829a7d154c7bd49fee)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:23.120594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37aecd-60a8-4b10-a3c9-bc31583f4dfb None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:23.122504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 198/379] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 23 04:05:22 2022] GET /identity/v3/groups/a3449354463645829a7d154c7bd49fee => generated 229 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:23.128887 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd740a-d4d6-46c6-b5ef-36303978ca6c None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:23.194626 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:23.228178 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390bf4a-902d-48a4-8fff-c7408463c8d5 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:23.228690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390bf4a-902d-48a4-8fff-c7408463c8d5 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:23.229198 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390bf4a-902d-48a4-8fff-c7408463c8d5 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:23.230690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 199/380] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 04:05:23.236456 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7faed31-4cab-4cef-8cdf-c24e69fbf1b8 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:23.237029 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7faed31-4cab-4cef-8cdf-c24e69fbf1b8 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:23.237546 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7faed31-4cab-4cef-8cdf-c24e69fbf1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:23.254764 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd740a-d4d6-46c6-b5ef-36303978ca6c None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:23.256911 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-f7faed31-4cab-4cef-8cdf-c24e69fbf1b8 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:23.258906 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-f7faed31-4cab-4cef-8cdf-c24e69fbf1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:23.303624 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0aa88-4e8d-4cb4-8c89-767557e2d75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:23.304480 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0aa88-4e8d-4cb4-8c89-767557e2d75f None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:23.304945 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0aa88-4e8d-4cb4-8c89-767557e2d75f None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:23.305393 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0aa88-4e8d-4cb4-8c89-767557e2d75f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:23.306586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0aa88-4e8d-4cb4-8c89-767557e2d75f None admin] RBAC: Adding query filter params (group.id=a3449354463645829a7d154c7bd49fee, role.id=255d9e4004c54505a7cda1b8af74e5f1, scope.project.id=cb9c03cfd85c4ddcb76ee846b01a3645) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:23.307155 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0aa88-4e8d-4cb4-8c89-767557e2d75f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:23.308745 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0aa88-4e8d-4cb4-8c89-767557e2d75f None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:23.315584 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 182/381] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Aug 23 04:05:23 2022] GET /identity/v3/role_assignments?group.id=a3449354463645829a7d154c7bd49fee&scope.project.id=cb9c03cfd85c4ddcb76ee846b01a3645&role.id=255d9e4004c54505a7cda1b8af74e5f1 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:23.339863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 200/382] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 04:05:23.619622 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0aa88-4e8d-4cb4-8c89-767557e2d75f None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:23.740855 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0aa88-4e8d-4cb4-8c89-767557e2d75f None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:23.750890 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba2474-2462-4122-9a4a-113152111325 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:23.751287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba2474-2462-4122-9a4a-113152111325 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:23.751570 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba2474-2462-4122-9a4a-113152111325 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:23.752922 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 201/383] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 04:05:23.758583 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541767e1-3009-4d2a-9a52-adf98203aed3 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:23.759036 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541767e1-3009-4d2a-9a52-adf98203aed3 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:23.759460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541767e1-3009-4d2a-9a52-adf98203aed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:23.761221 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:23.778766 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-541767e1-3009-4d2a-9a52-adf98203aed3 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:23.780046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-541767e1-3009-4d2a-9a52-adf98203aed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:23.783892 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74fec1-854d-413c-85dc-d692c42143e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:23.783892 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74fec1-854d-413c-85dc-d692c42143e8 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:23.784162 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74fec1-854d-413c-85dc-d692c42143e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:23.784413 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74fec1-854d-413c-85dc-d692c42143e8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:23.802533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:23.825739 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74fec1-854d-413c-85dc-d692c42143e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:23.831289 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-ca74fec1-854d-413c-85dc-d692c42143e8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 04:05:23.831289 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:23.831289 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:23.831289 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:23.831289 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:23.831289 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:23.831289 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:23.831289 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:23.831289 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:23.831289 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:23.831289 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:23.831289 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:23.831289 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:23.831289 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:23.831289 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:23.831289 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:23.832208 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:23.832208 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:23.832208 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:23.832208 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:23.832208 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:23.832208 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:23.832208 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:23.832208 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:23.832208 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:23.832208 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:23.832208 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:23.832208 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:23.832208 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:23.832208 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:23.832208 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:23.832208 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:23.833028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:23.833028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:23.833028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:23.833028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:23.833028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:23.833028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:23.833028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:23.833028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:23.833028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:23.833028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:23.833028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 04:05:23.833028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:23.833028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 183/384] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 23 04:05:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:23.851019 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74fec1-854d-413c-85dc-d692c42143e8 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:23.863903 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 202/385] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 04:05:24.024256 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74fec1-854d-413c-85dc-d692c42143e8 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:24.071652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ab816-2589-45a4-aec0-9ee38b1180f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:24.072273 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ab816-2589-45a4-aec0-9ee38b1180f2 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:24.072560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ab816-2589-45a4-aec0-9ee38b1180f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:24.072835 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ab816-2589-45a4-aec0-9ee38b1180f2 None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:24.073615 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ab816-2589-45a4-aec0-9ee38b1180f2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:24.073925 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ab816-2589-45a4-aec0-9ee38b1180f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:24.075303 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ab816-2589-45a4-aec0-9ee38b1180f2 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:24.085683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 184/386] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:05:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:05:24.091717 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541767e1-3009-4d2a-9a52-adf98203aed3 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:24.095670 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a22103-18cc-464a-9f4f-711dd7c86223 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:24.096151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a22103-18cc-464a-9f4f-711dd7c86223 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:24.096663 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a22103-18cc-464a-9f4f-711dd7c86223 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:24.101418 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 185/387] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:24.104955 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949f60d-dc0e-4f2a-a0a0-602f65dbec3c None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:24.105463 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949f60d-dc0e-4f2a-a0a0-602f65dbec3c None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:24.105918 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949f60d-dc0e-4f2a-a0a0-602f65dbec3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:24.139266 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-1949f60d-dc0e-4f2a-a0a0-602f65dbec3c None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:24.142382 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-1949f60d-dc0e-4f2a-a0a0-602f65dbec3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:24.216612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:24.260386 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 186/388] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:24.261583 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949f60d-dc0e-4f2a-a0a0-602f65dbec3c None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:24.280651 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541767e1-3009-4d2a-9a52-adf98203aed3 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:24.349232 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e463510-41cf-40d1-9a66-f461617007e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:24.349847 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e463510-41cf-40d1-9a66-f461617007e4 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:24.350136 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e463510-41cf-40d1-9a66-f461617007e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:24.350405 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e463510-41cf-40d1-9a66-f461617007e4 None admin] PATH_INFO: `/v3/groups/bb03563be2cb4a998da81229f24b27a0` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:24.351661 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e463510-41cf-40d1-9a66-f461617007e4 None admin] RBAC: Authorizing `identity:get_group(group_id=bb03563be2cb4a998da81229f24b27a0)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:24.353143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e463510-41cf-40d1-9a66-f461617007e4 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:24.355290 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 203/389] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 23 04:05:24 2022] GET /identity/v3/groups/bb03563be2cb4a998da81229f24b27a0 => generated 226 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:24.360846 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e463510-41cf-40d1-9a66-f461617007e4 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:24.372042 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949f60d-dc0e-4f2a-a0a0-602f65dbec3c None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:24.413566 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:24.416268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bd62a-ea2e-4089-95ce-f6b5854778ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:24.416937 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bd62a-ea2e-4089-95ce-f6b5854778ae None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:24.417258 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bd62a-ea2e-4089-95ce-f6b5854778ae None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:24.417757 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bd62a-ea2e-4089-95ce-f6b5854778ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:24.458762 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200bd62a-ea2e-4089-95ce-f6b5854778ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:24.465034 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-200bd62a-ea2e-4089-95ce-f6b5854778ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:05:24.465034 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:24.465034 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:24.465034 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:24.465034 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:24.465034 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:24.465034 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:24.465034 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:24.465034 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:24.465034 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:24.465034 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:24.465034 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:24.465034 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:24.465034 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:24.465034 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:24.465034 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:24.465968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:24.465968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:24.465968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:24.465968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:24.465968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:24.465968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:24.465968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:24.465968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:24.465968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:24.465968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:24.465968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:24.465968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:24.465968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:24.465968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:24.465968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:24.465968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:24.466849 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:24.466849 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:24.466849 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:24.466849 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:24.466849 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:24.466849 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:24.466849 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:24.466849 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:24.466849 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:24.466849 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:24.466849 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:05:24.466849 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:24.474775 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 187/390] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:05:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:24.475670 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bd62a-ea2e-4089-95ce-f6b5854778ae None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:24.532859 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:24.535422 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e463510-41cf-40d1-9a66-f461617007e4 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:24.581256 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe3405-0595-469e-be1a-034bc3dfb40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:24.583565 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe3405-0595-469e-be1a-034bc3dfb40c None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:24.585151 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe3405-0595-469e-be1a-034bc3dfb40c None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:24.585716 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe3405-0595-469e-be1a-034bc3dfb40c None admin] PATH_INFO: `/v3/projects/3371d174840948c183eab2505d3b2776` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:24.588317 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe3405-0595-469e-be1a-034bc3dfb40c None admin] RBAC: Authorizing `identity:get_project(project_id=3371d174840948c183eab2505d3b2776)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:24.592981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe3405-0595-469e-be1a-034bc3dfb40c None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:24.596848 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 204/391] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:05:24 2022] GET /identity/v3/projects/3371d174840948c183eab2505d3b2776 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:24.619089 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe3405-0595-469e-be1a-034bc3dfb40c None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:24.690571 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bd62a-ea2e-4089-95ce-f6b5854778ae None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:24.733478 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d48d4-4e8a-4773-bcbc-f3bc00375972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:24.734073 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d48d4-4e8a-4773-bcbc-f3bc00375972 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:24.734370 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d48d4-4e8a-4773-bcbc-f3bc00375972 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:24.734868 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d48d4-4e8a-4773-bcbc-f3bc00375972 None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:24.735346 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d48d4-4e8a-4773-bcbc-f3bc00375972 None admin] RBAC: Adding query filter params (name=member) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:24.735654 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d48d4-4e8a-4773-bcbc-f3bc00375972 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:24.737112 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d48d4-4e8a-4773-bcbc-f3bc00375972 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:24.746031 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 188/392] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 23 04:05:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:24.746934 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d48d4-4e8a-4773-bcbc-f3bc00375972 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:24.749336 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:24.765785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe3405-0595-469e-be1a-034bc3dfb40c None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:24.804074 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f574615-a756-44f1-bbf9-21c4c50d0e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:24.804929 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f574615-a756-44f1-bbf9-21c4c50d0e25 None admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:24.805243 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f574615-a756-44f1-bbf9-21c4c50d0e25 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:24.805990 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f574615-a756-44f1-bbf9-21c4c50d0e25 None admin] PATH_INFO: `/v3/projects/3371d174840948c183eab2505d3b2776/groups/bb03563be2cb4a998da81229f24b27a0/roles/5434f93251a0417c890b94b90b40ab71` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:24.808140 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f574615-a756-44f1-bbf9-21c4c50d0e25 None admin] RBAC: Authorizing `identity:create_grant(project_id=3371d174840948c183eab2505d3b2776, group_id=bb03563be2cb4a998da81229f24b27a0, role_id=5434f93251a0417c890b94b90b40ab71)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:24.809980 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f574615-a756-44f1-bbf9-21c4c50d0e25 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:24.861637 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:24.874773 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d48d4-4e8a-4773-bcbc-f3bc00375972 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:24.879277 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 205/393] 10.222.0.42 () {58 vars in 1442 bytes} [Tue Aug 23 04:05:24 2022] PUT /identity/v3/projects/3371d174840948c183eab2505d3b2776/groups/bb03563be2cb4a998da81229f24b27a0/roles/5434f93251a0417c890b94b90b40ab71 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:05:24.882327 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f574615-a756-44f1-bbf9-21c4c50d0e25 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:24.932533 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d75a7-e588-41c2-a583-90af3322e4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:24.933543 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d75a7-e588-41c2-a583-90af3322e4a1 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:24.934927 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d75a7-e588-41c2-a583-90af3322e4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:24.935357 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d75a7-e588-41c2-a583-90af3322e4a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:24.971539 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d75a7-e588-41c2-a583-90af3322e4a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:24.981738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-a69d75a7-e588-41c2-a583-90af3322e4a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:05:24.981738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:24.981738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:24.981738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:24.981738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:24.981738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:24.981738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:24.981738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:24.981738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:24.981738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:24.981738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:24.981738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:24.981738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:24.981738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:24.981738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:24.981738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:24.982792 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:24.982792 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:24.982792 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:24.982792 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:24.982792 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:24.982792 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:24.982792 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:24.982792 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:24.982792 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:24.982792 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:24.982792 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:24.982792 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:24.982792 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:24.982792 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:24.982792 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:24.982792 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:24.983761 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:24.983761 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:24.983761 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:24.983761 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:24.983761 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:24.983761 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:24.983761 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:24.983761 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:24.983761 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:24.983761 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:24.983761 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:05:24.983761 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:24.995624 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 189/394] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:05:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:24.997877 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d75a7-e588-41c2-a583-90af3322e4a1 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:25.128832 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f574615-a756-44f1-bbf9-21c4c50d0e25 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:25.162350 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d75a7-e588-41c2-a583-90af3322e4a1 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:25.212635 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e363fb5-c9fb-42bf-98cc-271fae9d896d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:25.213310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e363fb5-c9fb-42bf-98cc-271fae9d896d None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:25.213588 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e363fb5-c9fb-42bf-98cc-271fae9d896d None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:25.213856 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e363fb5-c9fb-42bf-98cc-271fae9d896d None admin] PATH_INFO: `/v3/groups/bb03563be2cb4a998da81229f24b27a0` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:25.215491 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e363fb5-c9fb-42bf-98cc-271fae9d896d None admin] RBAC: Authorizing `identity:get_group(group_id=bb03563be2cb4a998da81229f24b27a0)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:25.216933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e363fb5-c9fb-42bf-98cc-271fae9d896d None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:25.218539 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 206/395] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 23 04:05:24 2022] GET /identity/v3/groups/bb03563be2cb4a998da81229f24b27a0 => generated 226 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:25.219236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f30e9-1c18-45b6-9e30-9f4fa3fdac5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:25.219855 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f30e9-1c18-45b6-9e30-9f4fa3fdac5e None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:25.220134 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f30e9-1c18-45b6-9e30-9f4fa3fdac5e None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:25.220406 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f30e9-1c18-45b6-9e30-9f4fa3fdac5e None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:25.221077 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f30e9-1c18-45b6-9e30-9f4fa3fdac5e None admin] RBAC: Adding query filter params (name=member) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:25.221400 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f30e9-1c18-45b6-9e30-9f4fa3fdac5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:25.222779 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f30e9-1c18-45b6-9e30-9f4fa3fdac5e None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:25.225231 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e363fb5-c9fb-42bf-98cc-271fae9d896d None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:25.240948 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 190/396] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 23 04:05:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:25.244611 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f30e9-1c18-45b6-9e30-9f4fa3fdac5e None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:25.262817 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:25.266276 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:25.390852 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e363fb5-c9fb-42bf-98cc-271fae9d896d None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:25.410160 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f30e9-1c18-45b6-9e30-9f4fa3fdac5e None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:25.431751 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f714570-a6f9-4c6d-a951-d24db4772951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:25.432933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f714570-a6f9-4c6d-a951-d24db4772951 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:25.433247 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f714570-a6f9-4c6d-a951-d24db4772951 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:25.433530 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f714570-a6f9-4c6d-a951-d24db4772951 None admin] PATH_INFO: `/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:25.434937 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f714570-a6f9-4c6d-a951-d24db4772951 None admin] RBAC: Authorizing `identity:get_project(project_id=8ad529e44aa842e4a9ae1e4cf2872a25)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:25.437069 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f714570-a6f9-4c6d-a951-d24db4772951 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:25.439938 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 207/397] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:05:25 2022] GET /identity/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:25.441119 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bac5c8-ea7e-45f2-9ada-fb42d45086e5 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:25.441411 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bac5c8-ea7e-45f2-9ada-fb42d45086e5 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:25.441687 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bac5c8-ea7e-45f2-9ada-fb42d45086e5 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:25.443122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 208/398] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:25.446621 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bac5c8-ea7e-45f2-9ada-fb42d45086e5 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:25.457720 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e0c90-1623-44a1-9355-0e68826d94a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:25.458586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e0c90-1623-44a1-9355-0e68826d94a0 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:25.459011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e0c90-1623-44a1-9355-0e68826d94a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:25.459450 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e0c90-1623-44a1-9355-0e68826d94a0 None admin] PATH_INFO: `/v3/groups/bb03563be2cb4a998da81229f24b27a0` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:25.461385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e0c90-1623-44a1-9355-0e68826d94a0 None admin] RBAC: Authorizing `identity:get_group(group_id=bb03563be2cb4a998da81229f24b27a0)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:25.463067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e0c90-1623-44a1-9355-0e68826d94a0 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:25.465156 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 191/399] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 23 04:05:25 2022] GET /identity/v3/groups/bb03563be2cb4a998da81229f24b27a0 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:25.466535 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfa66f-61da-453e-b32d-062292d544a1 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:25.467014 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfa66f-61da-453e-b32d-062292d544a1 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:25.467501 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfa66f-61da-453e-b32d-062292d544a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:25.485699 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-75cfa66f-61da-453e-b32d-062292d544a1 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:25.487170 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-75cfa66f-61da-453e-b32d-062292d544a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:25.553147 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:25.563800 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 192/400] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:25.564886 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfa66f-61da-453e-b32d-062292d544a1 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:25.577651 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bac5c8-ea7e-45f2-9ada-fb42d45086e5 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:25.584381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:25.624409 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67354062-1ea6-4b36-974c-db76207f7467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:25.625080 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67354062-1ea6-4b36-974c-db76207f7467 None admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:25.625383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67354062-1ea6-4b36-974c-db76207f7467 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:25.625652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67354062-1ea6-4b36-974c-db76207f7467 None admin] PATH_INFO: `/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25/groups/bb03563be2cb4a998da81229f24b27a0/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:25.628383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67354062-1ea6-4b36-974c-db76207f7467 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ad529e44aa842e4a9ae1e4cf2872a25, group_id=bb03563be2cb4a998da81229f24b27a0, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:25.630595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67354062-1ea6-4b36-974c-db76207f7467 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:25.683945 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfa66f-61da-453e-b32d-062292d544a1 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:25.712471 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 209/401] 10.222.0.42 () {58 vars in 1442 bytes} [Tue Aug 23 04:05:25 2022] PUT /identity/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25/groups/bb03563be2cb4a998da81229f24b27a0/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:05:25.714064 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbf320-3b53-4a1d-a20f-9171d016a858 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:25.714358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbf320-3b53-4a1d-a20f-9171d016a858 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:25.715054 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbf320-3b53-4a1d-a20f-9171d016a858 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:25.717128 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 210/402] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:25.723692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6fe79-9451-498d-86b3-c81d46e33566 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:25.724032 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6fe79-9451-498d-86b3-c81d46e33566 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:25.724239 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6fe79-9451-498d-86b3-c81d46e33566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:25.729030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c10b9b-4313-4d3f-bbfc-951eb72f3570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:25.730010 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c10b9b-4313-4d3f-bbfc-951eb72f3570 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:25.730516 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c10b9b-4313-4d3f-bbfc-951eb72f3570 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:25.731004 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c10b9b-4313-4d3f-bbfc-951eb72f3570 None admin] PATH_INFO: `/v3/projects/3371d174840948c183eab2505d3b2776` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:25.732440 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c10b9b-4313-4d3f-bbfc-951eb72f3570 None admin] RBAC: Authorizing `identity:get_project(project_id=3371d174840948c183eab2505d3b2776)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:25.734262 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c10b9b-4313-4d3f-bbfc-951eb72f3570 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:25.736181 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 193/403] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:05:25 2022] GET /identity/v3/projects/3371d174840948c183eab2505d3b2776 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:25.750361 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-e1f6fe79-9451-498d-86b3-c81d46e33566 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:25.750934 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c10b9b-4313-4d3f-bbfc-951eb72f3570 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:25.751614 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-e1f6fe79-9451-498d-86b3-c81d46e33566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:25.853625 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 211/404] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:25.854511 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6fe79-9451-498d-86b3-c81d46e33566 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:25.892641 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:25.919224 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c10b9b-4313-4d3f-bbfc-951eb72f3570 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:25.954272 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:25.968456 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d8f13-c9de-484c-8512-918b639a3034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:25.969552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d8f13-c9de-484c-8512-918b639a3034 None admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:25.970075 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d8f13-c9de-484c-8512-918b639a3034 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:25.970490 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d8f13-c9de-484c-8512-918b639a3034 None admin] PATH_INFO: `/v3/projects/3371d174840948c183eab2505d3b2776/groups/bb03563be2cb4a998da81229f24b27a0/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:25.972860 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d8f13-c9de-484c-8512-918b639a3034 None admin] RBAC: Authorizing `identity:create_grant(project_id=3371d174840948c183eab2505d3b2776, group_id=bb03563be2cb4a998da81229f24b27a0, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:25.974934 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d8f13-c9de-484c-8512-918b639a3034 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:25.990671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6fe79-9451-498d-86b3-c81d46e33566 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:26.030797 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f16c80-92df-49f7-b43b-f63b69b08d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:26.031436 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f16c80-92df-49f7-b43b-f63b69b08d52 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:26.031729 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f16c80-92df-49f7-b43b-f63b69b08d52 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:26.031997 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f16c80-92df-49f7-b43b-f63b69b08d52 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:26.042835 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f16c80-92df-49f7-b43b-f63b69b08d52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:26.048007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-d9f16c80-92df-49f7-b43b-f63b69b08d52 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 04:05:26.048007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:26.048007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:26.048007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:26.048007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:26.048007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:26.048007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:26.048007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:26.048007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:26.048007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:26.048007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:26.048007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:26.048007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:26.048007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:26.048007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:26.048007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:26.050173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:26.050173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:26.050173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:26.050173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:26.050173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:26.050173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:26.050173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:26.050173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:26.050173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:26.050173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:26.050173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:26.050173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:26.050173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:26.050173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:26.050173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:26.050173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:26.051109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:26.051109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:26.051109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:26.051109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:26.051109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:26.051109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:26.051109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:26.051109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:26.051109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:26.051109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:26.051109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 04:05:26.051109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:26.051109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 212/405] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 23 04:05:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:26.055791 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f16c80-92df-49f7-b43b-f63b69b08d52 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:26.084767 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 194/406] 10.222.0.42 () {58 vars in 1442 bytes} [Tue Aug 23 04:05:25 2022] PUT /identity/v3/projects/3371d174840948c183eab2505d3b2776/groups/bb03563be2cb4a998da81229f24b27a0/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:05:26.154254 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d8f13-c9de-484c-8512-918b639a3034 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:26.168056 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f16c80-92df-49f7-b43b-f63b69b08d52 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:26.207755 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97926079-1146-4373-bc67-4788d96a78c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:26.208489 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97926079-1146-4373-bc67-4788d96a78c3 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:26.208772 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97926079-1146-4373-bc67-4788d96a78c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:26.209049 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97926079-1146-4373-bc67-4788d96a78c3 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:26.209830 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97926079-1146-4373-bc67-4788d96a78c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:26.210134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97926079-1146-4373-bc67-4788d96a78c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:26.211645 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97926079-1146-4373-bc67-4788d96a78c3 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:26.225505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 213/407] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:05:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:05:26.226896 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:26.228892 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97926079-1146-4373-bc67-4788d96a78c3 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:26.356247 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97926079-1146-4373-bc67-4788d96a78c3 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:26.358488 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d8f13-c9de-484c-8512-918b639a3034 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:26.395648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33cdab2-0f42-43a0-8947-368a3d84e120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:26.396354 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cdab2-0f42-43a0-8947-368a3d84e120 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:26.396643 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cdab2-0f42-43a0-8947-368a3d84e120 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:26.396922 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cdab2-0f42-43a0-8947-368a3d84e120 None admin] PATH_INFO: `/v3/groups/bb03563be2cb4a998da81229f24b27a0` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:26.398122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33cdab2-0f42-43a0-8947-368a3d84e120 None admin] RBAC: Authorizing `identity:get_group(group_id=bb03563be2cb4a998da81229f24b27a0)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:26.399699 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33cdab2-0f42-43a0-8947-368a3d84e120 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:26.405185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 214/408] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 23 04:05:26 2022] GET /identity/v3/groups/bb03563be2cb4a998da81229f24b27a0 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:05:26.405398 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80236a28-aebc-4c4a-88ec-84e2deb082ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:26.406236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80236a28-aebc-4c4a-88ec-84e2deb082ed None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:26.406668 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80236a28-aebc-4c4a-88ec-84e2deb082ed None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:26.407097 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80236a28-aebc-4c4a-88ec-84e2deb082ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:26.412767 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33cdab2-0f42-43a0-8947-368a3d84e120 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:26.417655 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:26.421177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80236a28-aebc-4c4a-88ec-84e2deb082ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:26.427381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-80236a28-aebc-4c4a-88ec-84e2deb082ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:05:26.427381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:26.427381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:26.427381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:26.427381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:26.427381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:26.427381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:26.427381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:26.427381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:26.427381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:26.427381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:26.427381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:26.427381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:26.427381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:26.427381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:26.427381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:26.433664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:26.433664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:26.433664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:26.433664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:26.433664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:26.433664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:26.433664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:26.433664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:26.433664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:26.433664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:26.433664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:26.433664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:26.433664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:26.433664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:26.433664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:26.433664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:26.435181 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:26.435181 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:26.435181 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:26.435181 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:26.435181 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:26.435181 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:26.435181 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:26.435181 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:26.435181 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:26.435181 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:26.435181 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:05:26.435181 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:26.435181 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 195/409] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:05:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:26.437408 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80236a28-aebc-4c4a-88ec-84e2deb082ed None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:26.547387 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:26.551736 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80236a28-aebc-4c4a-88ec-84e2deb082ed None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:26.589209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751a43b-5890-4fd2-aabd-4100697aa281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:26.590291 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751a43b-5890-4fd2-aabd-4100697aa281 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:26.590772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751a43b-5890-4fd2-aabd-4100697aa281 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:26.591271 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751a43b-5890-4fd2-aabd-4100697aa281 None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:26.592148 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f751a43b-5890-4fd2-aabd-4100697aa281 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:26.592725 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f751a43b-5890-4fd2-aabd-4100697aa281 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:26.594472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f751a43b-5890-4fd2-aabd-4100697aa281 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:26.596098 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33cdab2-0f42-43a0-8947-368a3d84e120 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:26.608945 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 196/410] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:05:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:26.610603 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751a43b-5890-4fd2-aabd-4100697aa281 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:26.652554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02832f5d-8f76-4ad4-88a4-df3532806da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:26.653596 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02832f5d-8f76-4ad4-88a4-df3532806da5 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:26.654133 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02832f5d-8f76-4ad4-88a4-df3532806da5 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:26.654630 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02832f5d-8f76-4ad4-88a4-df3532806da5 None admin] PATH_INFO: `/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:26.656122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02832f5d-8f76-4ad4-88a4-df3532806da5 None admin] RBAC: Authorizing `identity:get_project(project_id=8ad529e44aa842e4a9ae1e4cf2872a25)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:26.658306 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02832f5d-8f76-4ad4-88a4-df3532806da5 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:26.660507 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 215/411] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:05:26 2022] GET /identity/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25 => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:26.667675 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02832f5d-8f76-4ad4-88a4-df3532806da5 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:26.755600 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:26.794284 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02832f5d-8f76-4ad4-88a4-df3532806da5 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:26.817304 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751a43b-5890-4fd2-aabd-4100697aa281 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:26.845403 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:26.851076 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17973b0c-272b-48b8-b4ff-76369dad2c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:26.852761 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17973b0c-272b-48b8-b4ff-76369dad2c9a None admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:26.853201 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17973b0c-272b-48b8-b4ff-76369dad2c9a None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:26.853623 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17973b0c-272b-48b8-b4ff-76369dad2c9a None admin] PATH_INFO: `/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25/groups/bb03563be2cb4a998da81229f24b27a0/roles/5434f93251a0417c890b94b90b40ab71` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:26.857867 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a77d5-5a06-445d-94d5-d3fa73491758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:26.858815 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a77d5-5a06-445d-94d5-d3fa73491758 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:26.859312 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17973b0c-272b-48b8-b4ff-76369dad2c9a None admin] RBAC: Authorizing `identity:create_grant(project_id=8ad529e44aa842e4a9ae1e4cf2872a25, group_id=bb03563be2cb4a998da81229f24b27a0, role_id=5434f93251a0417c890b94b90b40ab71)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:26.859590 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a77d5-5a06-445d-94d5-d3fa73491758 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:26.860059 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a77d5-5a06-445d-94d5-d3fa73491758 None admin] PATH_INFO: `/v3/groups/a3449354463645829a7d154c7bd49fee` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:26.860945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17973b0c-272b-48b8-b4ff-76369dad2c9a None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:26.861753 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a77d5-5a06-445d-94d5-d3fa73491758 None admin] RBAC: Authorizing `identity:get_group(group_id=a3449354463645829a7d154c7bd49fee)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:26.863362 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a77d5-5a06-445d-94d5-d3fa73491758 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:26.869326 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 197/412] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 23 04:05:26 2022] GET /identity/v3/groups/a3449354463645829a7d154c7bd49fee => generated 229 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:26.871369 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a77d5-5a06-445d-94d5-d3fa73491758 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:26.951808 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 216/413] 10.222.0.42 () {58 vars in 1442 bytes} [Tue Aug 23 04:05:26 2022] PUT /identity/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25/groups/bb03563be2cb4a998da81229f24b27a0/roles/5434f93251a0417c890b94b90b40ab71 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:05:26.982128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a77d5-5a06-445d-94d5-d3fa73491758 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:27.015780 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:27.023020 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ae73a-4b7c-4726-83f9-9198683a6862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:27.024228 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ae73a-4b7c-4726-83f9-9198683a6862 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:27.024515 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ae73a-4b7c-4726-83f9-9198683a6862 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:27.024794 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ae73a-4b7c-4726-83f9-9198683a6862 None admin] PATH_INFO: `/v3/projects/cb9c03cfd85c4ddcb76ee846b01a3645` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:27.025968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ae73a-4b7c-4726-83f9-9198683a6862 None admin] RBAC: Authorizing `identity:get_project(project_id=cb9c03cfd85c4ddcb76ee846b01a3645)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:27.027446 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ae73a-4b7c-4726-83f9-9198683a6862 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:27.031771 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 198/414] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:05:26 2022] GET /identity/v3/projects/cb9c03cfd85c4ddcb76ee846b01a3645 => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:05:27.035243 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17973b0c-272b-48b8-b4ff-76369dad2c9a None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:27.172144 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17973b0c-272b-48b8-b4ff-76369dad2c9a None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:27.207375 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64595778-f6ef-448d-9c59-45235711485b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:27.207972 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64595778-f6ef-448d-9c59-45235711485b None admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:27.208254 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64595778-f6ef-448d-9c59-45235711485b None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:27.208529 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64595778-f6ef-448d-9c59-45235711485b None admin] PATH_INFO: `/v3/projects/cb9c03cfd85c4ddcb76ee846b01a3645/groups/a3449354463645829a7d154c7bd49fee/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:27.211106 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64595778-f6ef-448d-9c59-45235711485b None admin] RBAC: Authorizing `identity:create_grant(project_id=cb9c03cfd85c4ddcb76ee846b01a3645, group_id=a3449354463645829a7d154c7bd49fee, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:27.212599 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64595778-f6ef-448d-9c59-45235711485b None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:27.215595 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270fe80-7530-439b-86ed-206d881fbd1d None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:27.215893 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270fe80-7530-439b-86ed-206d881fbd1d None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:27.216176 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270fe80-7530-439b-86ed-206d881fbd1d None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:27.221783 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 199/415] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:27.223503 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493da89-7f46-4cbf-9dfb-a8c83033553e None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:27.223796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493da89-7f46-4cbf-9dfb-a8c83033553e None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:27.224109 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493da89-7f46-4cbf-9dfb-a8c83033553e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:27.244497 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-0493da89-7f46-4cbf-9dfb-a8c83033553e None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:27.245748 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-0493da89-7f46-4cbf-9dfb-a8c83033553e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:27.295775 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 217/416] 10.222.0.42 () {58 vars in 1442 bytes} [Tue Aug 23 04:05:27 2022] PUT /identity/v3/projects/cb9c03cfd85c4ddcb76ee846b01a3645/groups/a3449354463645829a7d154c7bd49fee/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:05:27.326981 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 200/417] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 04:05:27.646278 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64595778-f6ef-448d-9c59-45235711485b None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:27.713621 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:27.778749 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64595778-f6ef-448d-9c59-45235711485b None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:27.823333 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e339ebf-47ee-469f-b194-50b856d960e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:27.824050 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e339ebf-47ee-469f-b194-50b856d960e7 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:27.824346 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e339ebf-47ee-469f-b194-50b856d960e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:27.824630 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e339ebf-47ee-469f-b194-50b856d960e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:27.838754 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e339ebf-47ee-469f-b194-50b856d960e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:27.844055 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-5e339ebf-47ee-469f-b194-50b856d960e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 04:05:27.844055 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:27.844055 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:27.844055 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:27.844055 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:27.844055 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:27.844055 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:27.844055 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:27.844055 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:27.844055 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:27.844055 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:27.844055 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:27.844055 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:27.844055 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:27.844055 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:27.844055 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:27.844939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:27.844939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:27.844939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:27.844939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:27.844939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:27.844939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:27.844939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:27.844939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:27.844939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:27.844939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:27.844939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:27.844939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:27.844939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:27.844939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:27.844939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:27.844939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:27.845784 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:27.845784 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:27.845784 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:27.845784 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:27.845784 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:27.845784 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:27.845784 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:27.845784 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:27.845784 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:27.845784 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:27.845784 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 04:05:27.845784 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:27.845784 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 218/418] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 23 04:05:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:27.851362 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493da89-7f46-4cbf-9dfb-a8c83033553e None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:27.974171 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0abe57-aca9-4e28-bfb7-b46e9a47b15f None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:27.974759 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0abe57-aca9-4e28-bfb7-b46e9a47b15f None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:27.975215 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0abe57-aca9-4e28-bfb7-b46e9a47b15f None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:27.976730 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 219/419] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 04:05:27.982059 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32680c48-dd37-452c-a06c-920b349d0f9d None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:27.982347 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32680c48-dd37-452c-a06c-920b349d0f9d None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:27.982627 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32680c48-dd37-452c-a06c-920b349d0f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:27.988958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493da89-7f46-4cbf-9dfb-a8c83033553e None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:28.014404 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-32680c48-dd37-452c-a06c-920b349d0f9d None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:28.015762 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-32680c48-dd37-452c-a06c-920b349d0f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:28.017509 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:28.034703 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a845c9-959c-43c1-96e4-26c67e9b2e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:28.035337 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a845c9-959c-43c1-96e4-26c67e9b2e7f None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:28.035625 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a845c9-959c-43c1-96e4-26c67e9b2e7f None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:28.035907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a845c9-959c-43c1-96e4-26c67e9b2e7f None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:28.036679 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a845c9-959c-43c1-96e4-26c67e9b2e7f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:28.036991 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a845c9-959c-43c1-96e4-26c67e9b2e7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:28.038397 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a845c9-959c-43c1-96e4-26c67e9b2e7f None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:28.053745 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 201/420] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:05:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:28.058738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a845c9-959c-43c1-96e4-26c67e9b2e7f None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:28.113607 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 220/421] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 04:05:28.233927 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a845c9-959c-43c1-96e4-26c67e9b2e7f None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:28.285293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26355caf-5f11-4728-8f80-013ad9afea9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:28.285921 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26355caf-5f11-4728-8f80-013ad9afea9c None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:28.286206 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26355caf-5f11-4728-8f80-013ad9afea9c None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:28.286487 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26355caf-5f11-4728-8f80-013ad9afea9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:28.350997 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:28.364045 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26355caf-5f11-4728-8f80-013ad9afea9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:28.365569 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26355caf-5f11-4728-8f80-013ad9afea9c None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:28.431645 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32680c48-dd37-452c-a06c-920b349d0f9d None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:28.503683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 202/422] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:05:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:05:28.506643 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:28.508642 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26355caf-5f11-4728-8f80-013ad9afea9c None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:28.567835 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32680c48-dd37-452c-a06c-920b349d0f9d None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:28.602557 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039f143-fadf-4e0c-9014-e3bf6c1c4397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:28.603195 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039f143-fadf-4e0c-9014-e3bf6c1c4397 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:28.603471 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039f143-fadf-4e0c-9014-e3bf6c1c4397 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:28.603742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039f143-fadf-4e0c-9014-e3bf6c1c4397 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:28.609408 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:28.620249 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26355caf-5f11-4728-8f80-013ad9afea9c None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:28.620666 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9039f143-fadf-4e0c-9014-e3bf6c1c4397 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:28.626737 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-9039f143-fadf-4e0c-9014-e3bf6c1c4397 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:05:28.626737 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:28.626737 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:28.626737 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:28.626737 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:28.626737 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:28.626737 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:28.626737 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:28.626737 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:28.626737 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:28.626737 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:28.626737 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:28.626737 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:28.626737 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:28.626737 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:28.626737 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:28.628808 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:28.628808 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:28.628808 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:28.628808 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:28.628808 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:28.628808 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:28.628808 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:28.628808 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:28.628808 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:28.628808 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:28.628808 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:28.628808 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:28.628808 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:28.628808 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:28.628808 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:28.628808 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:28.629704 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:28.629704 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:28.629704 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:28.629704 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:28.629704 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:28.629704 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:28.629704 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:28.629704 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:28.629704 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:28.629704 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:28.629704 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:05:28.629704 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:28.632327 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 221/423] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:05:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:28.634247 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bdb12c-c771-42d2-a26a-daff516cf836 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:28.634668 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bdb12c-c771-42d2-a26a-daff516cf836 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:28.635067 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bdb12c-c771-42d2-a26a-daff516cf836 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:28.636722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 222/424] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:28.645110 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bdb12c-c771-42d2-a26a-daff516cf836 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:28.665527 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc03a6c-8e2a-4b0a-aea6-906acf508836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:28.666169 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc03a6c-8e2a-4b0a-aea6-906acf508836 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:28.666457 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc03a6c-8e2a-4b0a-aea6-906acf508836 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:28.666733 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc03a6c-8e2a-4b0a-aea6-906acf508836 None admin] PATH_INFO: `/v3/projects/3371d174840948c183eab2505d3b2776` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:28.667875 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc03a6c-8e2a-4b0a-aea6-906acf508836 None admin] RBAC: Authorizing `identity:get_project(project_id=3371d174840948c183eab2505d3b2776)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:28.669349 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc03a6c-8e2a-4b0a-aea6-906acf508836 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:28.670971 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 203/425] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:05:28 2022] GET /identity/v3/projects/3371d174840948c183eab2505d3b2776 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:28.672075 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad018e6-a06d-46fb-bc42-e8d19a6840e3 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:28.672357 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad018e6-a06d-46fb-bc42-e8d19a6840e3 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:28.672629 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad018e6-a06d-46fb-bc42-e8d19a6840e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:28.695488 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-9ad018e6-a06d-46fb-bc42-e8d19a6840e3 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:28.696673 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-9ad018e6-a06d-46fb-bc42-e8d19a6840e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:28.756365 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bdb12c-c771-42d2-a26a-daff516cf836 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:28.758103 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:28.773986 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 204/426] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:28.776668 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad018e6-a06d-46fb-bc42-e8d19a6840e3 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:28.810985 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2f141-42a2-40c6-8134-bba794cb470c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:28.812034 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2f141-42a2-40c6-8134-bba794cb470c None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:28.813292 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2f141-42a2-40c6-8134-bba794cb470c None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:28.815532 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2f141-42a2-40c6-8134-bba794cb470c None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:28.816410 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2f141-42a2-40c6-8134-bba794cb470c None admin] RBAC: Adding query filter params (name=member) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:28.816858 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2f141-42a2-40c6-8134-bba794cb470c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:28.818432 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2f141-42a2-40c6-8134-bba794cb470c None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:28.832145 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 223/427] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 23 04:05:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:05:28.840920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2f141-42a2-40c6-8134-bba794cb470c None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:28.944729 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:28.972323 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad018e6-a06d-46fb-bc42-e8d19a6840e3 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:29.025332 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2f141-42a2-40c6-8134-bba794cb470c None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:29.065823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a18c7-5a53-4f19-9f9b-b0ca15f4e1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:29.066442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a18c7-5a53-4f19-9f9b-b0ca15f4e1b4 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:29.066721 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a18c7-5a53-4f19-9f9b-b0ca15f4e1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:29.066993 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a18c7-5a53-4f19-9f9b-b0ca15f4e1b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:29.082334 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70394ae-993e-41d0-9e64-7a579646a484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:29.082995 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70394ae-993e-41d0-9e64-7a579646a484 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:29.083280 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70394ae-993e-41d0-9e64-7a579646a484 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:29.083557 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70394ae-993e-41d0-9e64-7a579646a484 None admin] PATH_INFO: `/v3/groups/bb03563be2cb4a998da81229f24b27a0` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:29.084689 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70394ae-993e-41d0-9e64-7a579646a484 None admin] RBAC: Authorizing `identity:get_group(group_id=bb03563be2cb4a998da81229f24b27a0)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:29.086691 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70394ae-993e-41d0-9e64-7a579646a484 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:29.088580 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 205/428] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 23 04:05:28 2022] GET /identity/v3/groups/bb03563be2cb4a998da81229f24b27a0 => generated 226 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:29.094215 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70394ae-993e-41d0-9e64-7a579646a484 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:29.101768 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:29.143695 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a18c7-5a53-4f19-9f9b-b0ca15f4e1b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:29.145582 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a18c7-5a53-4f19-9f9b-b0ca15f4e1b4 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:29.220185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70394ae-993e-41d0-9e64-7a579646a484 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:29.255881 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c0b78-2c45-4fb1-8ca8-a84d611df277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:29.256959 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c0b78-2c45-4fb1-8ca8-a84d611df277 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:29.257912 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c0b78-2c45-4fb1-8ca8-a84d611df277 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:29.258570 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c0b78-2c45-4fb1-8ca8-a84d611df277 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:29.259899 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c0b78-2c45-4fb1-8ca8-a84d611df277 None admin] RBAC: Adding query filter params (group.id=bb03563be2cb4a998da81229f24b27a0, role.id=5434f93251a0417c890b94b90b40ab71, scope.project.id=3371d174840948c183eab2505d3b2776) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:29.260601 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c0b78-2c45-4fb1-8ca8-a84d611df277 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:29.262839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c0b78-2c45-4fb1-8ca8-a84d611df277 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:29.271723 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 224/429] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:05:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 04:05:29.271723 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a18c7-5a53-4f19-9f9b-b0ca15f4e1b4 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:29.276444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 206/430] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Aug 23 04:05:29 2022] GET /identity/v3/role_assignments?group.id=bb03563be2cb4a998da81229f24b27a0&scope.project.id=3371d174840948c183eab2505d3b2776&role.id=5434f93251a0417c890b94b90b40ab71 => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:29.277564 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c0b78-2c45-4fb1-8ca8-a84d611df277 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:29.329067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:29.379802 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:29.431178 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a18c7-5a53-4f19-9f9b-b0ca15f4e1b4 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:29.441607 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c0b78-2c45-4fb1-8ca8-a84d611df277 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:29.471987 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7baf4b-9944-4193-985d-2568dcc8eba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:29.472640 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7baf4b-9944-4193-985d-2568dcc8eba7 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:29.472915 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7baf4b-9944-4193-985d-2568dcc8eba7 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:29.473220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7baf4b-9944-4193-985d-2568dcc8eba7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:29.483827 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb05c1-55d4-4531-b723-2e1c9ed2ed5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:29.484794 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb05c1-55d4-4531-b723-2e1c9ed2ed5e None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:29.485080 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb05c1-55d4-4531-b723-2e1c9ed2ed5e None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:29.485391 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb05c1-55d4-4531-b723-2e1c9ed2ed5e None admin] PATH_INFO: `/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:29.486540 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb05c1-55d4-4531-b723-2e1c9ed2ed5e None admin] RBAC: Authorizing `identity:get_project(project_id=8ad529e44aa842e4a9ae1e4cf2872a25)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:29.486972 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7baf4b-9944-4193-985d-2568dcc8eba7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:29.487969 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb05c1-55d4-4531-b723-2e1c9ed2ed5e None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:29.494275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 207/431] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:05:29 2022] GET /identity/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:29.494275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8305c85-2a88-46bc-bc66-a17cf5410523 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:29.494275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8305c85-2a88-46bc-bc66-a17cf5410523 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:29.494275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8305c85-2a88-46bc-bc66-a17cf5410523 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:29.494611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-ff7baf4b-9944-4193-985d-2568dcc8eba7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:05:29.494611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:29.494611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:29.494611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:29.494611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:29.494611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:29.494611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:29.494611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:29.494611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:29.494611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:29.494611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:29.494611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:29.494611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:29.494611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:29.494611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:29.494611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:29.495469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:29.495469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:29.495469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:29.495469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:29.495469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:29.495469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:29.495469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:29.495469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:29.495469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:29.495469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:29.495469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:29.495469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:29.495469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:29.495469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:29.495469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:29.495469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:29.496284 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:29.496284 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:29.496284 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:29.496284 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:29.496284 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:29.496284 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:29.496284 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:29.496284 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:29.496284 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:29.496284 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:29.496284 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 04:05:29.496284 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:29.497521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 208/433] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:29.498787 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 225/433] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:05:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:29.498894 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8305c85-2a88-46bc-bc66-a17cf5410523 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:29.499047 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b40aec-2272-496f-8284-3baba1d61a7d None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:29.499339 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b40aec-2272-496f-8284-3baba1d61a7d None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:29.499616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b40aec-2272-496f-8284-3baba1d61a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:29.522161 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-f0b40aec-2272-496f-8284-3baba1d61a7d None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:29.524303 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-f0b40aec-2272-496f-8284-3baba1d61a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:29.596398 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 226/434] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:29.602125 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b40aec-2272-496f-8284-3baba1d61a7d None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:29.605748 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:29.619964 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8305c85-2a88-46bc-bc66-a17cf5410523 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:29.662611 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f289ee2-ff79-460b-9ff6-408e6619349e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:29.663943 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f289ee2-ff79-460b-9ff6-408e6619349e None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:29.664441 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f289ee2-ff79-460b-9ff6-408e6619349e None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:29.665145 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f289ee2-ff79-460b-9ff6-408e6619349e None admin] PATH_INFO: `/v3/groups/bb03563be2cb4a998da81229f24b27a0` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:29.667273 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f289ee2-ff79-460b-9ff6-408e6619349e None admin] RBAC: Authorizing `identity:get_group(group_id=bb03563be2cb4a998da81229f24b27a0)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:29.669600 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f289ee2-ff79-460b-9ff6-408e6619349e None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:29.671758 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 209/435] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 23 04:05:29 2022] GET /identity/v3/groups/bb03563be2cb4a998da81229f24b27a0 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:29.680441 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f289ee2-ff79-460b-9ff6-408e6619349e None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:29.681081 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:29.738886 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b40aec-2272-496f-8284-3baba1d61a7d None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:29.781158 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cadf1-9498-47f1-a484-3611d227f3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:29.782329 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cadf1-9498-47f1-a484-3611d227f3e1 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:29.782809 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cadf1-9498-47f1-a484-3611d227f3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:29.783315 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cadf1-9498-47f1-a484-3611d227f3e1 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:29.784205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073cadf1-9498-47f1-a484-3611d227f3e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:29.784601 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073cadf1-9498-47f1-a484-3611d227f3e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:29.786682 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073cadf1-9498-47f1-a484-3611d227f3e1 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:29.797217 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 227/436] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 23 04:05:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:29.797799 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f289ee2-ff79-460b-9ff6-408e6619349e None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:29.808218 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cadf1-9498-47f1-a484-3611d227f3e1 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:29.840897 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0d36a-8897-48a8-a6b2-f0d86592bcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:29.841773 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0d36a-8897-48a8-a6b2-f0d86592bcb0 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:29.842934 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0d36a-8897-48a8-a6b2-f0d86592bcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:29.843216 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0d36a-8897-48a8-a6b2-f0d86592bcb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:29.843960 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0d36a-8897-48a8-a6b2-f0d86592bcb0 None admin] RBAC: Adding query filter params (group.id=bb03563be2cb4a998da81229f24b27a0, role.id=b28fe6f1db4c4738862acb96ff94007c, scope.project.id=8ad529e44aa842e4a9ae1e4cf2872a25) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:29.844272 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0d36a-8897-48a8-a6b2-f0d86592bcb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:29.845753 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0d36a-8897-48a8-a6b2-f0d86592bcb0 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:29.857244 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 210/437] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Aug 23 04:05:29 2022] GET /identity/v3/role_assignments?group.id=bb03563be2cb4a998da81229f24b27a0&scope.project.id=8ad529e44aa842e4a9ae1e4cf2872a25&role.id=b28fe6f1db4c4738862acb96ff94007c => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:05:29.867551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0d36a-8897-48a8-a6b2-f0d86592bcb0 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:29.902204 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:29.926252 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cadf1-9498-47f1-a484-3611d227f3e1 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:29.949494 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:29.972113 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af0ff2-383b-409f-b4be-8cf17f772293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:29.972744 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af0ff2-383b-409f-b4be-8cf17f772293 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:29.973068 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af0ff2-383b-409f-b4be-8cf17f772293 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:29.973395 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af0ff2-383b-409f-b4be-8cf17f772293 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:30.009199 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0d36a-8897-48a8-a6b2-f0d86592bcb0 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:30.051483 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3476b75-1fcf-464a-9a84-9efecd63d38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:30.052630 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3476b75-1fcf-464a-9a84-9efecd63d38a None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:30.052914 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3476b75-1fcf-464a-9a84-9efecd63d38a None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:30.053529 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3476b75-1fcf-464a-9a84-9efecd63d38a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:30.054295 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af0ff2-383b-409f-b4be-8cf17f772293 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:30.056025 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af0ff2-383b-409f-b4be-8cf17f772293 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:30.067231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3476b75-1fcf-464a-9a84-9efecd63d38a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:30.072965 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-d3476b75-1fcf-464a-9a84-9efecd63d38a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 04:05:30.072965 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:30.072965 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:30.072965 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:30.072965 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:30.072965 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:30.072965 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:30.072965 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:30.072965 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:30.072965 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:30.072965 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:30.072965 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:30.072965 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:30.072965 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:30.072965 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:30.072965 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:30.073908 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:30.073908 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:30.073908 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:30.073908 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:30.073908 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:30.073908 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:30.073908 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:30.073908 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:30.073908 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:30.073908 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:30.073908 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:30.073908 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:30.073908 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:30.073908 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:30.073908 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:30.073908 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:30.074711 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:30.074711 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:30.074711 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:30.074711 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:30.074711 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:30.074711 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:30.074711 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:30.074711 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:30.074711 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:30.074711 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:30.074711 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 04:05:30.074711 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:30.074711 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 211/438] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 23 04:05:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:30.078883 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d213531-1b7a-414c-b581-81d572d05a12 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:30.078883 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d213531-1b7a-414c-b581-81d572d05a12 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:30.078883 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d213531-1b7a-414c-b581-81d572d05a12 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:30.078883 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 212/439] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:30.082232 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d213531-1b7a-414c-b581-81d572d05a12 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:30.162457 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:30.167452 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 228/440] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:05:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:05:30.170426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94497159-d4ba-497c-908f-6d2681829897 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:30.170708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94497159-d4ba-497c-908f-6d2681829897 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:30.170983 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94497159-d4ba-497c-908f-6d2681829897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:30.182313 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d213531-1b7a-414c-b581-81d572d05a12 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:30.188240 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-94497159-d4ba-497c-908f-6d2681829897 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:30.189450 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-94497159-d4ba-497c-908f-6d2681829897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:30.200600 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:30.216684 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99887a60-5b5c-4286-9d33-3784aff0ad25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:30.217323 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99887a60-5b5c-4286-9d33-3784aff0ad25 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:30.217665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99887a60-5b5c-4286-9d33-3784aff0ad25 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:30.217990 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99887a60-5b5c-4286-9d33-3784aff0ad25 None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:30.218656 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99887a60-5b5c-4286-9d33-3784aff0ad25 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:30.218962 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99887a60-5b5c-4286-9d33-3784aff0ad25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:30.220355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99887a60-5b5c-4286-9d33-3784aff0ad25 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:30.228250 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 213/441] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:05:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:30.229998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99887a60-5b5c-4286-9d33-3784aff0ad25 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:30.257769 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 229/442] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:30.258608 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94497159-d4ba-497c-908f-6d2681829897 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:30.332666 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99887a60-5b5c-4286-9d33-3784aff0ad25 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:30.363157 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94497159-d4ba-497c-908f-6d2681829897 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:30.368763 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194a9ca-8936-44a8-9fc9-f25c12ca9749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:30.369682 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194a9ca-8936-44a8-9fc9-f25c12ca9749 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:30.370164 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194a9ca-8936-44a8-9fc9-f25c12ca9749 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:30.370634 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194a9ca-8936-44a8-9fc9-f25c12ca9749 None admin] PATH_INFO: `/v3/projects/3371d174840948c183eab2505d3b2776` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:30.371983 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194a9ca-8936-44a8-9fc9-f25c12ca9749 None admin] RBAC: Authorizing `identity:get_project(project_id=3371d174840948c183eab2505d3b2776)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:30.373650 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194a9ca-8936-44a8-9fc9-f25c12ca9749 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:30.375490 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 214/443] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:05:30 2022] GET /identity/v3/projects/3371d174840948c183eab2505d3b2776 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:30.380750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194a9ca-8936-44a8-9fc9-f25c12ca9749 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:30.394945 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:30.399205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278edb84-381f-4cad-90cd-d1b1039df6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:30.399819 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278edb84-381f-4cad-90cd-d1b1039df6d0 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:30.400102 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278edb84-381f-4cad-90cd-d1b1039df6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:30.400373 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278edb84-381f-4cad-90cd-d1b1039df6d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:30.416531 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:30.471824 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278edb84-381f-4cad-90cd-d1b1039df6d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:30.473343 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278edb84-381f-4cad-90cd-d1b1039df6d0 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:30.494245 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194a9ca-8936-44a8-9fc9-f25c12ca9749 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:30.530222 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864fc9c-f503-4c0d-9ba7-711ca03b3f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:30.530852 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864fc9c-f503-4c0d-9ba7-711ca03b3f95 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:30.531130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864fc9c-f503-4c0d-9ba7-711ca03b3f95 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:30.531400 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864fc9c-f503-4c0d-9ba7-711ca03b3f95 None admin] PATH_INFO: `/v3/groups/bb03563be2cb4a998da81229f24b27a0` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:30.532514 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864fc9c-f503-4c0d-9ba7-711ca03b3f95 None admin] RBAC: Authorizing `identity:get_group(group_id=bb03563be2cb4a998da81229f24b27a0)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:30.533991 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864fc9c-f503-4c0d-9ba7-711ca03b3f95 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:30.540702 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 215/444] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 23 04:05:30 2022] GET /identity/v3/groups/bb03563be2cb4a998da81229f24b27a0 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:05:30.540702 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864fc9c-f503-4c0d-9ba7-711ca03b3f95 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:30.575754 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 230/445] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:05:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:05:30.576580 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278edb84-381f-4cad-90cd-d1b1039df6d0 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:30.615075 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:30.621186 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:30.636049 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864fc9c-f503-4c0d-9ba7-711ca03b3f95 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:30.670186 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0a07c-a64f-4d88-a157-dcfcc9b46558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:30.670747 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0a07c-a64f-4d88-a157-dcfcc9b46558 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:30.671028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0a07c-a64f-4d88-a157-dcfcc9b46558 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:30.671335 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0a07c-a64f-4d88-a157-dcfcc9b46558 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:30.672465 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278edb84-381f-4cad-90cd-d1b1039df6d0 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:30.681475 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f0a07c-a64f-4d88-a157-dcfcc9b46558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:30.687335 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-75f0a07c-a64f-4d88-a157-dcfcc9b46558 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:05:30.687335 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:30.687335 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:30.687335 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:30.687335 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:30.687335 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:30.687335 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:30.687335 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:30.687335 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:30.687335 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:30.687335 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:30.687335 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:30.687335 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:30.687335 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:30.687335 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:30.687335 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:30.688386 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:30.688386 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:30.688386 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:30.688386 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:30.688386 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:30.688386 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:30.688386 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:30.688386 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:30.688386 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:30.688386 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:30.688386 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:30.688386 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:30.688386 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:30.688386 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:30.688386 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:30.688386 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:30.689239 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:30.689239 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:30.689239 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:30.689239 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:30.689239 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:30.689239 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:30.689239 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:30.689239 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:30.689239 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:30.689239 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:30.689239 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:05:30.689239 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:30.689239 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 216/446] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:05:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:30.689239 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0a07c-a64f-4d88-a157-dcfcc9b46558 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:30.711714 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81a496-f0ea-4c40-8133-ec5e13f008ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:30.712326 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81a496-f0ea-4c40-8133-ec5e13f008ce None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:30.712608 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81a496-f0ea-4c40-8133-ec5e13f008ce None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:30.712882 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81a496-f0ea-4c40-8133-ec5e13f008ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:30.713671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81a496-f0ea-4c40-8133-ec5e13f008ce None admin] RBAC: Adding query filter params (group.id=bb03563be2cb4a998da81229f24b27a0, role.id=b28fe6f1db4c4738862acb96ff94007c, scope.project.id=3371d174840948c183eab2505d3b2776) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:30.713981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81a496-f0ea-4c40-8133-ec5e13f008ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:30.715491 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81a496-f0ea-4c40-8133-ec5e13f008ce None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:30.721052 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 231/447] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Aug 23 04:05:30 2022] GET /identity/v3/role_assignments?group.id=bb03563be2cb4a998da81229f24b27a0&scope.project.id=3371d174840948c183eab2505d3b2776&role.id=b28fe6f1db4c4738862acb96ff94007c => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:30.721849 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81a496-f0ea-4c40-8133-ec5e13f008ce None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:30.794867 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0a07c-a64f-4d88-a157-dcfcc9b46558 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:30.834260 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bd366-0ac3-4d2c-967b-7969e93e53d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:30.854957 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bd366-0ac3-4d2c-967b-7969e93e53d0 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:30.854957 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bd366-0ac3-4d2c-967b-7969e93e53d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:30.854957 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bd366-0ac3-4d2c-967b-7969e93e53d0 None admin] PATH_INFO: `/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:30.854957 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42bd366-0ac3-4d2c-967b-7969e93e53d0 None admin] RBAC: Authorizing `identity:get_project(project_id=8ad529e44aa842e4a9ae1e4cf2872a25)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:30.854957 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42bd366-0ac3-4d2c-967b-7969e93e53d0 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:30.854957 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 217/448] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:05:30 2022] GET /identity/v3/projects/8ad529e44aa842e4a9ae1e4cf2872a25 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:30.855428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81a496-f0ea-4c40-8133-ec5e13f008ce None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:30.855844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bd366-0ac3-4d2c-967b-7969e93e53d0 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:30.857553 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:30.858852 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:30.885751 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd17b0-57cf-44f8-9da1-1d103473eba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:30.885966 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd17b0-57cf-44f8-9da1-1d103473eba4 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:30.886241 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd17b0-57cf-44f8-9da1-1d103473eba4 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:30.886514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd17b0-57cf-44f8-9da1-1d103473eba4 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:30.887190 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd17b0-57cf-44f8-9da1-1d103473eba4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:30.887494 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd17b0-57cf-44f8-9da1-1d103473eba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:30.888903 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd17b0-57cf-44f8-9da1-1d103473eba4 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:30.898399 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 232/449] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:05:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:30.903920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd17b0-57cf-44f8-9da1-1d103473eba4 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:30.967152 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bd366-0ac3-4d2c-967b-7969e93e53d0 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:31.013677 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b5df7-1680-4da0-9a22-cb5f0914d0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:31.014468 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b5df7-1680-4da0-9a22-cb5f0914d0d1 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:31.014878 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b5df7-1680-4da0-9a22-cb5f0914d0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:31.015155 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b5df7-1680-4da0-9a22-cb5f0914d0d1 None admin] PATH_INFO: `/v3/groups/bb03563be2cb4a998da81229f24b27a0` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:31.016403 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b5df7-1680-4da0-9a22-cb5f0914d0d1 None admin] RBAC: Authorizing `identity:get_group(group_id=bb03563be2cb4a998da81229f24b27a0)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:31.017981 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b5df7-1680-4da0-9a22-cb5f0914d0d1 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:31.019662 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 218/450] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 23 04:05:30 2022] GET /identity/v3/groups/bb03563be2cb4a998da81229f24b27a0 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:31.026123 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b5df7-1680-4da0-9a22-cb5f0914d0d1 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:31.034882 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd17b0-57cf-44f8-9da1-1d103473eba4 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:31.080326 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d5f04-3ddd-4c2a-89a1-15b9890aa70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:31.080952 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d5f04-3ddd-4c2a-89a1-15b9890aa70a None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:31.081299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d5f04-3ddd-4c2a-89a1-15b9890aa70a None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:31.081581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d5f04-3ddd-4c2a-89a1-15b9890aa70a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:31.117070 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:31.129276 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:31.147831 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b5df7-1680-4da0-9a22-cb5f0914d0d1 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:31.159114 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d5f04-3ddd-4c2a-89a1-15b9890aa70a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:31.160590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d5f04-3ddd-4c2a-89a1-15b9890aa70a None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:31.191777 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e529c-a7c5-4330-8066-47042244eb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:31.192404 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e529c-a7c5-4330-8066-47042244eb99 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:31.193826 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e529c-a7c5-4330-8066-47042244eb99 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:31.193826 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e529c-a7c5-4330-8066-47042244eb99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:31.193826 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e529c-a7c5-4330-8066-47042244eb99 None admin] RBAC: Adding query filter params (group.id=bb03563be2cb4a998da81229f24b27a0, role.id=5434f93251a0417c890b94b90b40ab71, scope.project.id=8ad529e44aa842e4a9ae1e4cf2872a25) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:31.194081 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e529c-a7c5-4330-8066-47042244eb99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:31.196609 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e529c-a7c5-4330-8066-47042244eb99 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:31.203052 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 219/451] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Aug 23 04:05:31 2022] GET /identity/v3/role_assignments?group.id=bb03563be2cb4a998da81229f24b27a0&scope.project.id=8ad529e44aa842e4a9ae1e4cf2872a25&role.id=5434f93251a0417c890b94b90b40ab71 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:05:31.280590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 233/452] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:05:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 04:05:31.286499 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e529c-a7c5-4330-8066-47042244eb99 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:31.400642 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e529c-a7c5-4330-8066-47042244eb99 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:31.436686 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00652b1d-d410-4c13-b021-42678269a424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:31.437388 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00652b1d-d410-4c13-b021-42678269a424 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:31.437669 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00652b1d-d410-4c13-b021-42678269a424 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:31.437943 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00652b1d-d410-4c13-b021-42678269a424 None admin] PATH_INFO: `/v3/projects/cb9c03cfd85c4ddcb76ee846b01a3645` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:31.439067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00652b1d-d410-4c13-b021-42678269a424 None admin] RBAC: Authorizing `identity:get_project(project_id=cb9c03cfd85c4ddcb76ee846b01a3645)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:31.440497 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00652b1d-d410-4c13-b021-42678269a424 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:31.442291 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 220/453] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:05:31 2022] GET /identity/v3/projects/cb9c03cfd85c4ddcb76ee846b01a3645 => generated 344 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:31.448357 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d5f04-3ddd-4c2a-89a1-15b9890aa70a None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:31.519958 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:31.551305 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d5f04-3ddd-4c2a-89a1-15b9890aa70a None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:31.584517 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a4bc9-dd32-4aa4-a20b-99d39cb1cbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:31.585839 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a4bc9-dd32-4aa4-a20b-99d39cb1cbaf None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:31.586126 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a4bc9-dd32-4aa4-a20b-99d39cb1cbaf None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:31.586400 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a4bc9-dd32-4aa4-a20b-99d39cb1cbaf None admin] PATH_INFO: `/v3/groups/a3449354463645829a7d154c7bd49fee` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:31.587515 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a4bc9-dd32-4aa4-a20b-99d39cb1cbaf None admin] RBAC: Authorizing `identity:get_group(group_id=a3449354463645829a7d154c7bd49fee)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:31.588970 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a4bc9-dd32-4aa4-a20b-99d39cb1cbaf None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:31.590572 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 234/454] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 23 04:05:31 2022] GET /identity/v3/groups/a3449354463645829a7d154c7bd49fee => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:31.596393 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00652b1d-d410-4c13-b021-42678269a424 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:31.605475 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:31.692981 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00652b1d-d410-4c13-b021-42678269a424 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:31.725404 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3953c96-14c0-45e3-a030-8df389a088a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:31.726019 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3953c96-14c0-45e3-a030-8df389a088a0 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:31.726299 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3953c96-14c0-45e3-a030-8df389a088a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:31.726576 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3953c96-14c0-45e3-a030-8df389a088a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:31.727373 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3953c96-14c0-45e3-a030-8df389a088a0 None admin] RBAC: Adding query filter params (group.id=a3449354463645829a7d154c7bd49fee, role.id=255d9e4004c54505a7cda1b8af74e5f1, scope.project.id=cb9c03cfd85c4ddcb76ee846b01a3645) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:31.727684 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3953c96-14c0-45e3-a030-8df389a088a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:31.729111 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3953c96-14c0-45e3-a030-8df389a088a0 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:31.734582 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 221/455] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Aug 23 04:05:31 2022] GET /identity/v3/role_assignments?group.id=a3449354463645829a7d154c7bd49fee&scope.project.id=cb9c03cfd85c4ddcb76ee846b01a3645&role.id=255d9e4004c54505a7cda1b8af74e5f1 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:34.010463 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272da3e0-9ce5-4ea1-9531-9fa6eb1350ab None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:34.010995 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272da3e0-9ce5-4ea1-9531-9fa6eb1350ab None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:34.010995 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272da3e0-9ce5-4ea1-9531-9fa6eb1350ab None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:34.012621 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 235/456] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:34.018064 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa0c9c-7fae-4847-b731-8f56f44e78ff None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:34.018886 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa0c9c-7fae-4847-b731-8f56f44e78ff None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:34.019399 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa0c9c-7fae-4847-b731-8f56f44e78ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:34.042880 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-48fa0c9c-7fae-4847-b731-8f56f44e78ff None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:34.044416 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-48fa0c9c-7fae-4847-b731-8f56f44e78ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:34.126341 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:34.134843 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 222/457] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:34.309946 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1cf6c-b4a9-4e2c-b7e0-66cd612c45ce None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:34.310521 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1cf6c-b4a9-4e2c-b7e0-66cd612c45ce None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:34.310970 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1cf6c-b4a9-4e2c-b7e0-66cd612c45ce None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:34.312707 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 236/458] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:34.318336 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe3313-81ab-428a-a65f-27bb3dbcbe57 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:34.318629 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe3313-81ab-428a-a65f-27bb3dbcbe57 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:34.318908 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe3313-81ab-428a-a65f-27bb3dbcbe57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:34.346061 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-2dfe3313-81ab-428a-a65f-27bb3dbcbe57 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:34.347271 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-2dfe3313-81ab-428a-a65f-27bb3dbcbe57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:34.434554 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 223/459] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:34.542285 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b378992-9405-4f28-b635-a899cf6067c3 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:34.542965 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b378992-9405-4f28-b635-a899cf6067c3 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:34.543451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b378992-9405-4f28-b635-a899cf6067c3 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:34.545293 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 237/460] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:34.550808 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210e4a3-34f6-4467-acb8-fce01941cc20 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:34.551415 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210e4a3-34f6-4467-acb8-fce01941cc20 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:34.551907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210e4a3-34f6-4467-acb8-fce01941cc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:34.556692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b378992-9405-4f28-b635-a899cf6067c3 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:34.586240 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-4210e4a3-34f6-4467-acb8-fce01941cc20 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:34.590466 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-4210e4a3-34f6-4467-acb8-fce01941cc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:34.723593 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 224/461] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:34.735018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b378992-9405-4f28-b635-a899cf6067c3 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:34.749220 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb6a48-16a9-4ab6-bb05-b0e05107a517 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:34.749822 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb6a48-16a9-4ab6-bb05-b0e05107a517 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:34.750305 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb6a48-16a9-4ab6-bb05-b0e05107a517 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:34.753548 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 225/462] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 04:05:34.760273 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecde0e-2519-4378-a749-aa0e9b0bcdab None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:34.760821 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecde0e-2519-4378-a749-aa0e9b0bcdab None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:34.761330 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecde0e-2519-4378-a749-aa0e9b0bcdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:34.789898 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-1aecde0e-2519-4378-a749-aa0e9b0bcdab None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:34.791099 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-1aecde0e-2519-4378-a749-aa0e9b0bcdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:34.795135 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bc945-ef5e-42c0-9a87-2180ead156f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:34.795793 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bc945-ef5e-42c0-9a87-2180ead156f7 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:34.796071 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bc945-ef5e-42c0-9a87-2180ead156f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:34.796347 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bc945-ef5e-42c0-9a87-2180ead156f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:34.808957 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842bc945-ef5e-42c0-9a87-2180ead156f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:34.810474 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842bc945-ef5e-42c0-9a87-2180ead156f7 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:34.817467 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:34.826273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-842bc945-ef5e-42c0-9a87-2180ead156f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:34.826273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:34.826273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:34.826273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:34.826273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:34.826273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:34.826273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:34.826273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:34.826273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:34.826273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:34.826273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:34.826273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:34.826273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:34.826273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:34.826273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:34.826273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:34.827229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:34.827229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:34.827229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:34.827229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:34.827229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:34.827229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:34.827229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:34.827229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:34.827229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:34.827229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:34.827229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:34.827229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:34.827229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:34.827229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:34.827229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:34.827229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:34.827229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:34.828160 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:34.828160 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:34.828160 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:34.828160 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 238/463] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:34.828445 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bc945-ef5e-42c0-9a87-2180ead156f7 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:34.854014 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:34.869225 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 226/464] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 04:05:34.870101 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecde0e-2519-4378-a749-aa0e9b0bcdab None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:34.936444 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bc945-ef5e-42c0-9a87-2180ead156f7 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:34.996113 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c306a7-1c0c-43b6-bd21-b285be54a738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:34.996967 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c306a7-1c0c-43b6-bd21-b285be54a738 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:34.997275 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c306a7-1c0c-43b6-bd21-b285be54a738 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:34.997548 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c306a7-1c0c-43b6-bd21-b285be54a738 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:35.020658 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c306a7-1c0c-43b6-bd21-b285be54a738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:35.023807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c306a7-1c0c-43b6-bd21-b285be54a738 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:35.044943 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-05c306a7-1c0c-43b6-bd21-b285be54a738 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:35.044943 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:35.044943 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:35.044943 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:35.044943 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:35.044943 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:35.044943 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:35.044943 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:35.044943 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:35.044943 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:35.044943 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:35.044943 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:35.044943 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:35.044943 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:35.044943 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:35.044943 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:35.046007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:35.046007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:35.046007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:35.046007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:35.046007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:35.046007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:35.046007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:35.046007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:35.046007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:35.046007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:35.046007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:35.046007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:35.046007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:35.046007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:35.046007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:35.046007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:35.046007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:35.046875 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:35.046875 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:35.046875 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:35.051215 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 239/465] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:35.052075 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c306a7-1c0c-43b6-bd21-b285be54a738 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:35.054311 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecde0e-2519-4378-a749-aa0e9b0bcdab None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:35.100591 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fa328-1a2b-4af9-a950-444e6792125d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:35.101852 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fa328-1a2b-4af9-a950-444e6792125d None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:35.102480 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fa328-1a2b-4af9-a950-444e6792125d None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:35.103020 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fa328-1a2b-4af9-a950-444e6792125d None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:35.104174 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0fa328-1a2b-4af9-a950-444e6792125d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:35.104684 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0fa328-1a2b-4af9-a950-444e6792125d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:35.106711 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0fa328-1a2b-4af9-a950-444e6792125d None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:35.113473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:35.122791 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 227/466] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:35.124873 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fa328-1a2b-4af9-a950-444e6792125d None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:35.165256 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c306a7-1c0c-43b6-bd21-b285be54a738 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:35.193715 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:35.204106 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051f3c4-95a4-465d-9fdd-a00be975f114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:35.205600 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051f3c4-95a4-465d-9fdd-a00be975f114 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:35.205600 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051f3c4-95a4-465d-9fdd-a00be975f114 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:35.205989 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051f3c4-95a4-465d-9fdd-a00be975f114 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:35.217456 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051f3c4-95a4-465d-9fdd-a00be975f114 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:35.219107 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051f3c4-95a4-465d-9fdd-a00be975f114 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:35.234450 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-7051f3c4-95a4-465d-9fdd-a00be975f114 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:35.234450 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:35.234450 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:35.234450 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:35.234450 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:35.234450 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:35.234450 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:35.234450 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:35.234450 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:35.234450 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:35.234450 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:35.234450 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:35.234450 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:35.234450 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:35.234450 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:35.234450 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:35.235428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:35.235428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:35.235428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:35.235428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:35.235428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:35.235428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:35.235428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:35.235428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:35.235428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:35.235428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:35.235428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:35.235428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:35.235428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:35.235428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:35.235428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:35.235428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:35.235428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:35.236340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:35.236340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:35.236340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:35.236340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 240/467] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:35.236340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051f3c4-95a4-465d-9fdd-a00be975f114 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:35.257449 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fa328-1a2b-4af9-a950-444e6792125d None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:35.294423 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014fae7-75ba-441b-80e2-a07eb95087f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:35.295051 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014fae7-75ba-441b-80e2-a07eb95087f9 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:35.295344 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014fae7-75ba-441b-80e2-a07eb95087f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:35.295680 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014fae7-75ba-441b-80e2-a07eb95087f9 None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:35.296336 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014fae7-75ba-441b-80e2-a07eb95087f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:35.296702 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014fae7-75ba-441b-80e2-a07eb95087f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:35.298119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014fae7-75ba-441b-80e2-a07eb95087f9 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:35.311215 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 228/468] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:35.313990 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014fae7-75ba-441b-80e2-a07eb95087f9 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:35.347063 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:35.356495 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051f3c4-95a4-465d-9fdd-a00be975f114 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:35.388735 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ecfed0-7294-4f7d-ba11-173db9cdf2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:35.389372 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecfed0-7294-4f7d-ba11-173db9cdf2ed None admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:35.389650 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecfed0-7294-4f7d-ba11-173db9cdf2ed None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:35.389923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecfed0-7294-4f7d-ba11-173db9cdf2ed None admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:35.390569 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ecfed0-7294-4f7d-ba11-173db9cdf2ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:35.392024 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ecfed0-7294-4f7d-ba11-173db9cdf2ed None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:35.421861 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014fae7-75ba-441b-80e2-a07eb95087f9 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:35.433054 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:35.456494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f1016-b7b6-4677-a50b-2a6749674248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:35.457150 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f1016-b7b6-4677-a50b-2a6749674248 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:35.457437 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f1016-b7b6-4677-a50b-2a6749674248 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:35.457712 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f1016-b7b6-4677-a50b-2a6749674248 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:35.468584 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f1016-b7b6-4677-a50b-2a6749674248 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:35.470099 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f1016-b7b6-4677-a50b-2a6749674248 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:35.484907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-125f1016-b7b6-4677-a50b-2a6749674248 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:35.484907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:35.484907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:35.484907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:35.484907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:35.484907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:35.484907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:35.484907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:35.484907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:35.484907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:35.484907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:35.484907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:35.484907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:35.484907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:35.484907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:35.484907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:35.486058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:35.486058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:35.486058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:35.486058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:35.486058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:35.486058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:35.486058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:35.486058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:35.486058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:35.486058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:35.486058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:35.486058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:35.486058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:35.486058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:35.486058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:35.486058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:35.486058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:35.487189 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:35.487189 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:35.487189 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:35.489428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 229/469] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:35.491512 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f1016-b7b6-4677-a50b-2a6749674248 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:35.495918 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 241/470] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 23 04:05:35 2022] POST /identity/v3/users => generated 246 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:05:35.496534 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ecfed0-7294-4f7d-ba11-173db9cdf2ed None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:35.611651 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f1016-b7b6-4677-a50b-2a6749674248 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:35.624392 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ecfed0-7294-4f7d-ba11-173db9cdf2ed None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:35.646494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bcd42-744d-46ec-ba6d-a417c5cf0ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:35.647638 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bcd42-744d-46ec-ba6d-a417c5cf0ba5 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:35.647936 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bcd42-744d-46ec-ba6d-a417c5cf0ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:35.648213 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bcd42-744d-46ec-ba6d-a417c5cf0ba5 None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:35.648863 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bcd42-744d-46ec-ba6d-a417c5cf0ba5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:35.649206 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bcd42-744d-46ec-ba6d-a417c5cf0ba5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:35.650588 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bcd42-744d-46ec-ba6d-a417c5cf0ba5 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:35.665743 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 230/471] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:35.666108 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bcd42-744d-46ec-ba6d-a417c5cf0ba5 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:35.668038 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9f798-e93c-4fab-b84d-33756c1cca25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:35.668728 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9f798-e93c-4fab-b84d-33756c1cca25 None admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:35.669355 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9f798-e93c-4fab-b84d-33756c1cca25 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:35.669544 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9f798-e93c-4fab-b84d-33756c1cca25 None admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:35.670760 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec9f798-e93c-4fab-b84d-33756c1cca25 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:35.672133 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec9f798-e93c-4fab-b84d-33756c1cca25 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:35.693167 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:35.747242 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 242/472] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 23 04:05:35 2022] POST /identity/v3/users => generated 248 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:05:35.748604 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042f070-9af3-4e4a-a6a7-82b4ca8c291d None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:35.748991 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042f070-9af3-4e4a-a6a7-82b4ca8c291d None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:35.749384 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042f070-9af3-4e4a-a6a7-82b4ca8c291d None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:35.753166 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 243/473] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:35.753166 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042f070-9af3-4e4a-a6a7-82b4ca8c291d None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:35.766099 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:35.791991 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bcd42-744d-46ec-ba6d-a417c5cf0ba5 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:35.843196 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30736d3a-534a-4327-af5d-cb0606114545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:35.843863 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30736d3a-534a-4327-af5d-cb0606114545 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:35.844143 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30736d3a-534a-4327-af5d-cb0606114545 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:35.844418 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30736d3a-534a-4327-af5d-cb0606114545 None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:35.845078 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30736d3a-534a-4327-af5d-cb0606114545 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:35.845998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30736d3a-534a-4327-af5d-cb0606114545 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:35.847413 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30736d3a-534a-4327-af5d-cb0606114545 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:35.865534 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 231/474] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:35.867310 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65aca9-49fa-462c-8392-6c866a2f3649 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:35.867994 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65aca9-49fa-462c-8392-6c866a2f3649 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:35.868278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65aca9-49fa-462c-8392-6c866a2f3649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:35.876806 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042f070-9af3-4e4a-a6a7-82b4ca8c291d None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:35.892222 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-7b65aca9-49fa-462c-8392-6c866a2f3649 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:35.893950 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-7b65aca9-49fa-462c-8392-6c866a2f3649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:35.920040 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72dc44-187b-42b3-9b6b-daa2584be81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:35.920656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72dc44-187b-42b3-9b6b-daa2584be81a None admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:35.920938 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72dc44-187b-42b3-9b6b-daa2584be81a None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:35.921255 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72dc44-187b-42b3-9b6b-daa2584be81a None admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:35.921907 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72dc44-187b-42b3-9b6b-daa2584be81a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:35.923859 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72dc44-187b-42b3-9b6b-daa2584be81a None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:35.979846 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 232/475] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:35.980678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65aca9-49fa-462c-8392-6c866a2f3649 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:35.996262 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:36.003903 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 244/476] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 23 04:05:35 2022] POST /identity/v3/users => generated 248 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:05:36.116405 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65aca9-49fa-462c-8392-6c866a2f3649 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:36.164660 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51319544-5b0e-4aff-8d2f-a972c3201b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:36.165325 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51319544-5b0e-4aff-8d2f-a972c3201b62 None admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:36.165607 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51319544-5b0e-4aff-8d2f-a972c3201b62 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:36.165897 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51319544-5b0e-4aff-8d2f-a972c3201b62 None admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:36.166539 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51319544-5b0e-4aff-8d2f-a972c3201b62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:36.168084 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51319544-5b0e-4aff-8d2f-a972c3201b62 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:36.273107 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 233/477] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 23 04:05:35 2022] POST /identity/v3/users => generated 249 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:05:36.298527 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72dc44-187b-42b3-9b6b-daa2584be81a None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:36.372731 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:36.419484 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72dc44-187b-42b3-9b6b-daa2584be81a None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:36.461281 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d180c9e-d381-4f65-8eb7-908b39526e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:36.462255 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d180c9e-d381-4f65-8eb7-908b39526e24 None admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:36.462734 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d180c9e-d381-4f65-8eb7-908b39526e24 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:36.463257 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d180c9e-d381-4f65-8eb7-908b39526e24 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:36.464125 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d180c9e-d381-4f65-8eb7-908b39526e24 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:36.465731 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d180c9e-d381-4f65-8eb7-908b39526e24 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:36.506667 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.sql.core [None req-9d180c9e-d381-4f65-8eb7-908b39526e24 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 23 04:05:36.506667 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 23 04:05:36.506667 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [parameters: {'id': '09d1cba0fc6e4b49b6daa33f5c82dd4a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 23 04:05:36.506667 dv-cinder-854070-1-smb devstack@keystone.service[82355]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82355) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 04:05:36.526438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-9d180c9e-d381-4f65-8eb7-908b39526e24 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 23 04:05:36.526438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:36.526438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 04:05:36.526438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 04:05:36.526438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 04:05:36.526438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 04:05:36.526438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 04:05:36.526438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 04:05:36.526438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 04:05:36.526438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application conn.query(q) Aug 23 04:05:36.526438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 04:05:36.526438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 04:05:36.526438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 04:05:36.526438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application result.read() Aug 23 04:05:36.526438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 04:05:36.527418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 04:05:36.527418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 04:05:36.527418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 04:05:36.527418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 04:05:36.527418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 04:05:36.527418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 04:05:36.527418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 04:05:36.527418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 23 04:05:36.527418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:36.527418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 04:05:36.527418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:36.527418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:36.527418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 04:05:36.527418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 04:05:36.527418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 23 04:05:36.527418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return ref.to_dict() Aug 23 04:05:36.527418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 04:05:36.527418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application next(self.gen) Aug 23 04:05:36.528340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 04:05:36.528340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application yield resource Aug 23 04:05:36.528340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 04:05:36.528340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application next(self.gen) Aug 23 04:05:36.528340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 04:05:36.528340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 04:05:36.528340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 04:05:36.528340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 04:05:36.528340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 04:05:36.528340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise self.value Aug 23 04:05:36.528340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 04:05:36.528340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 04:05:36.528340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 04:05:36.528340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application session.commit() Aug 23 04:05:36.528340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 04:05:36.528340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 04:05:36.528340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 04:05:36.529329 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 04:05:36.529329 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 04:05:36.529329 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self.session.flush() Aug 23 04:05:36.529329 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 04:05:36.529329 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 04:05:36.529329 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 04:05:36.529329 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 04:05:36.529329 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 04:05:36.529329 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application compat.raise_( Aug 23 04:05:36.529329 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 04:05:36.529329 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception Aug 23 04:05:36.529329 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 04:05:36.529329 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 04:05:36.529329 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 04:05:36.529329 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 04:05:36.529329 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 04:05:36.529329 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 04:05:36.530216 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 04:05:36.530216 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 04:05:36.530216 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 23 04:05:36.530216 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 23 04:05:36.530216 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 04:05:36.530216 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 04:05:36.530216 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 04:05:36.530216 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 04:05:36.530216 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 04:05:36.530216 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 04:05:36.530216 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 04:05:36.530216 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 04:05:36.530216 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 04:05:36.530216 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 04:05:36.530216 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 04:05:36.530216 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception Aug 23 04:05:36.531046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 04:05:36.531046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 04:05:36.531046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 04:05:36.531046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 04:05:36.531046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 04:05:36.531046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 04:05:36.531046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 04:05:36.531046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application conn.query(q) Aug 23 04:05:36.531046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 04:05:36.531046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 04:05:36.531046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 04:05:36.531046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application result.read() Aug 23 04:05:36.531046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 04:05:36.531046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 04:05:36.531046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 04:05:36.531046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 04:05:36.534014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 04:05:36.534014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 04:05:36.534014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 04:05:36.534014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 04:05:36.534014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 23 04:05:36.534014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 23 04:05:36.534014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [parameters: {'id': '09d1cba0fc6e4b49b6daa33f5c82dd4a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 23 04:05:36.534014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 04:05:36.534014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:36.534014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 04:05:36.534014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:36.534014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:36.534014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:36.534014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:36.534014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:36.534014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:36.536014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:36.536014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:36.536014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:36.536014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:36.536014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:36.536014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:36.536014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 23 04:05:36.536014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 23 04:05:36.536014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:36.536014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:36.536014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 23 04:05:36.536014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 23 04:05:36.536014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 04:05:36.536014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 04:05:36.536014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 23 04:05:36.536014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:36.540427 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 245/478] 10.222.0.42 () {60 vars in 1131 bytes} [Tue Aug 23 04:05:36 2022] POST /identity/v3/roles => generated 144 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:36.546465 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51319544-5b0e-4aff-8d2f-a972c3201b62 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:36.626982 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:36.664279 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51319544-5b0e-4aff-8d2f-a972c3201b62 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:36.718492 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0db39-5203-4608-9436-f43dbdf70183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:36.719132 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0db39-5203-4608-9436-f43dbdf70183 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:36.719409 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0db39-5203-4608-9436-f43dbdf70183 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:36.719678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0db39-5203-4608-9436-f43dbdf70183 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:36.738187 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0db39-5203-4608-9436-f43dbdf70183 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:36.743549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-99b0db39-5203-4608-9436-f43dbdf70183 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 04:05:36.743549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:36.743549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:36.743549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:36.743549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:36.743549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:36.743549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:36.743549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:36.743549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:36.743549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:36.743549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:36.743549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:36.743549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:36.743549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:36.743549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:36.743549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:36.744445 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:36.744445 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:36.744445 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:36.744445 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:36.744445 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:36.744445 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:36.744445 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:36.744445 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:36.744445 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:36.744445 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:36.744445 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:36.744445 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:36.744445 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:36.744445 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:36.744445 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:36.744445 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:36.745287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:36.745287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:36.745287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:36.745287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:36.745287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:36.745287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:36.745287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:36.745287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:36.745287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:36.745287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:36.745287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 04:05:36.745287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:36.745287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 234/479] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 23 04:05:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:36.750698 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d180c9e-d381-4f65-8eb7-908b39526e24 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:36.865320 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d180c9e-d381-4f65-8eb7-908b39526e24 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:36.902876 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:36.911435 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6a04a-de56-41d7-a340-064447fea4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:36.912046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6a04a-de56-41d7-a340-064447fea4d7 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:36.918772 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6a04a-de56-41d7-a340-064447fea4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:36.918772 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6a04a-de56-41d7-a340-064447fea4d7 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:36.918772 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6a04a-de56-41d7-a340-064447fea4d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:36.918772 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6a04a-de56-41d7-a340-064447fea4d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:36.918772 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6a04a-de56-41d7-a340-064447fea4d7 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:36.924093 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 246/480] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:05:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:37.621082 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f9aa7-e9aa-4483-b13a-c9ad50928288 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:37.622124 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f9aa7-e9aa-4483-b13a-c9ad50928288 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:37.622606 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f9aa7-e9aa-4483-b13a-c9ad50928288 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:37.624385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 235/481] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:37.629778 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cfc63-59ac-48a0-af04-cd2f2cfd1312 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:37.630566 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cfc63-59ac-48a0-af04-cd2f2cfd1312 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:37.631060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cfc63-59ac-48a0-af04-cd2f2cfd1312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:37.662139 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-340cfc63-59ac-48a0-af04-cd2f2cfd1312 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:37.664190 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-340cfc63-59ac-48a0-af04-cd2f2cfd1312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:37.759719 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 247/482] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:38.173596 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfb5fb-974e-4d6b-87d2-ccc8a15a6800 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:38.173994 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfb5fb-974e-4d6b-87d2-ccc8a15a6800 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:38.174165 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfb5fb-974e-4d6b-87d2-ccc8a15a6800 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:38.175707 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 236/483] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:38.181937 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318d46d-4570-45e3-aaf5-31076119f07c None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:38.182224 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318d46d-4570-45e3-aaf5-31076119f07c None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:38.182497 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318d46d-4570-45e3-aaf5-31076119f07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:38.203527 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfb5fb-974e-4d6b-87d2-ccc8a15a6800 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:38.213429 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-e318d46d-4570-45e3-aaf5-31076119f07c None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:38.214316 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-e318d46d-4570-45e3-aaf5-31076119f07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:38.342366 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 248/484] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:38.377050 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfb5fb-974e-4d6b-87d2-ccc8a15a6800 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:38.411738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:38.424500 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e931b6-e52b-47b8-a137-f9ed98418730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:38.425627 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e931b6-e52b-47b8-a137-f9ed98418730 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:38.426099 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e931b6-e52b-47b8-a137-f9ed98418730 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:38.433456 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e931b6-e52b-47b8-a137-f9ed98418730 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:38.450697 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e931b6-e52b-47b8-a137-f9ed98418730 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:38.455652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-83e931b6-e52b-47b8-a137-f9ed98418730 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:05:38.455652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:38.455652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:38.455652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:38.455652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:38.455652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:38.455652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:38.455652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:38.455652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:38.455652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:38.455652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:38.455652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:38.455652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:38.455652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:38.455652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:38.455652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:38.461665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:38.461665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:38.461665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:38.461665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:38.461665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:38.461665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:38.461665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:38.461665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:38.461665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:38.461665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:38.461665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:38.461665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:38.461665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:38.461665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:38.461665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:38.461665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:38.462476 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:38.462476 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:38.462476 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:38.462476 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:38.462476 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:38.462476 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:38.462476 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:38.462476 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:38.462476 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:38.462476 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:38.462476 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:05:38.462476 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:38.464730 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 237/485] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 23 04:05:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:38.474460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318d46d-4570-45e3-aaf5-31076119f07c None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:38.476111 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e5742-1353-491e-81ca-c4774d8ebd1a None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:38.476599 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e5742-1353-491e-81ca-c4774d8ebd1a None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:38.477071 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e5742-1353-491e-81ca-c4774d8ebd1a None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:38.478892 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 238/486] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 04:05:38.484007 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ad8a2-1ce7-43d9-a6ae-77b30d1028db None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:38.484518 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ad8a2-1ce7-43d9-a6ae-77b30d1028db None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:38.485017 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ad8a2-1ce7-43d9-a6ae-77b30d1028db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:38.511748 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-e06ad8a2-1ce7-43d9-a6ae-77b30d1028db None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:38.512986 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-e06ad8a2-1ce7-43d9-a6ae-77b30d1028db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:38.555656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:38.633843 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318d46d-4570-45e3-aaf5-31076119f07c None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:38.635437 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 239/487] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 04:05:38.668702 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368e4b5-4f26-4e14-86c9-c9bd3f3f003c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:38.669370 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368e4b5-4f26-4e14-86c9-c9bd3f3f003c None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:38.670009 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368e4b5-4f26-4e14-86c9-c9bd3f3f003c None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:38.670378 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368e4b5-4f26-4e14-86c9-c9bd3f3f003c None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:38.671149 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368e4b5-4f26-4e14-86c9-c9bd3f3f003c None admin] RBAC: Adding query filter params (name=service) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:38.671551 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368e4b5-4f26-4e14-86c9-c9bd3f3f003c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:38.673082 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368e4b5-4f26-4e14-86c9-c9bd3f3f003c None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:38.681881 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 249/488] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 23 04:05:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:38.687421 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ad8a2-1ce7-43d9-a6ae-77b30d1028db None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:38.757726 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368e4b5-4f26-4e14-86c9-c9bd3f3f003c None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:38.799028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ad8a2-1ce7-43d9-a6ae-77b30d1028db None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:38.838754 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:38.863101 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673f260-db4b-4a66-9a29-4cbcebbc9529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:38.863852 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673f260-db4b-4a66-9a29-4cbcebbc9529 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:38.864131 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673f260-db4b-4a66-9a29-4cbcebbc9529 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:38.864402 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673f260-db4b-4a66-9a29-4cbcebbc9529 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:38.877378 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673f260-db4b-4a66-9a29-4cbcebbc9529 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:38.878984 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673f260-db4b-4a66-9a29-4cbcebbc9529 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:38.895128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-e673f260-db4b-4a66-9a29-4cbcebbc9529 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:38.895128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:38.895128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:38.895128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:38.895128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:38.895128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:38.895128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:38.895128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:38.895128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:38.895128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:38.895128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:38.895128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:38.895128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:38.895128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:38.895128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:38.895128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:38.896060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:38.896060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:38.896060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:38.896060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:38.896060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:38.896060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:38.896060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:38.896060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:38.896060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:38.896060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:38.896060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:38.896060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:38.896060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:38.896060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:38.896060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:38.896060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:38.896060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:38.897550 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:38.897550 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:38.897550 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:38.897550 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 240/489] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:38.902723 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2d4e4-75e9-49c8-ba25-f606c7b526da None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:38.903541 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2d4e4-75e9-49c8-ba25-f606c7b526da None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:38.903850 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2d4e4-75e9-49c8-ba25-f606c7b526da None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:38.905404 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 241/490] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 04:05:38.906479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2d4e4-75e9-49c8-ba25-f606c7b526da None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:38.939021 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368e4b5-4f26-4e14-86c9-c9bd3f3f003c None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:38.956162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:38.981452 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84f978-a8c9-41f3-ba9a-91e83fbfe6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:38.982166 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84f978-a8c9-41f3-ba9a-91e83fbfe6a8 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:38.982452 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84f978-a8c9-41f3-ba9a-91e83fbfe6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:38.982805 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84f978-a8c9-41f3-ba9a-91e83fbfe6a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:38.993989 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84f978-a8c9-41f3-ba9a-91e83fbfe6a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:38.999149 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-be84f978-a8c9-41f3-ba9a-91e83fbfe6a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:05:38.999149 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:38.999149 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:38.999149 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:38.999149 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:38.999149 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:38.999149 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:38.999149 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:38.999149 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:38.999149 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:38.999149 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:38.999149 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:38.999149 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:38.999149 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:38.999149 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:38.999149 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:39.000060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:39.000060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:39.000060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:39.000060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:39.000060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:39.000060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:39.000060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:39.000060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:39.000060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:39.000060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:39.000060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:39.000060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:39.000060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:39.000060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:39.000060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:39.000060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:39.000874 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:39.000874 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:39.000874 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:39.000874 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:39.000874 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:39.000874 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:39.000874 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:39.000874 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:39.000874 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:39.000874 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:39.000874 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:05:39.000874 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:39.001553 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 250/491] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 23 04:05:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:05:39.005137 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96720f9e-deea-40e5-8eb9-c169ff949f2e None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:39.005137 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96720f9e-deea-40e5-8eb9-c169ff949f2e None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:39.005137 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96720f9e-deea-40e5-8eb9-c169ff949f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:39.026340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-96720f9e-deea-40e5-8eb9-c169ff949f2e None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:39.027423 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-96720f9e-deea-40e5-8eb9-c169ff949f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:39.035359 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2d4e4-75e9-49c8-ba25-f606c7b526da None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:39.069894 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e299cf-35cf-4466-862b-1b432c1f766e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:39.070503 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e299cf-35cf-4466-862b-1b432c1f766e None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:39.070790 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e299cf-35cf-4466-862b-1b432c1f766e None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:39.071067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e299cf-35cf-4466-862b-1b432c1f766e None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:39.071718 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e299cf-35cf-4466-862b-1b432c1f766e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:39.072024 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e299cf-35cf-4466-862b-1b432c1f766e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:39.073443 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e299cf-35cf-4466-862b-1b432c1f766e None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:39.090132 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 242/492] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:39.090132 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e299cf-35cf-4466-862b-1b432c1f766e None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:39.107443 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 251/493] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:39.108141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96720f9e-deea-40e5-8eb9-c169ff949f2e None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:39.144611 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:39.230960 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96720f9e-deea-40e5-8eb9-c169ff949f2e None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:39.232094 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e299cf-35cf-4466-862b-1b432c1f766e None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:39.232652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:39.273293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e795999-9c81-4719-b494-4ac97bbfadf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:39.273931 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e795999-9c81-4719-b494-4ac97bbfadf4 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:39.274211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e795999-9c81-4719-b494-4ac97bbfadf4 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:39.274481 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e795999-9c81-4719-b494-4ac97bbfadf4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:39.275440 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fb5ef-4db6-405e-bcce-e3a4f5917b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:39.276600 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fb5ef-4db6-405e-bcce-e3a4f5917b1c None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:39.277502 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fb5ef-4db6-405e-bcce-e3a4f5917b1c None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:39.277980 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fb5ef-4db6-405e-bcce-e3a4f5917b1c None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:39.278864 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50fb5ef-4db6-405e-bcce-e3a4f5917b1c None admin] RBAC: Adding query filter params (name=service) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:39.279361 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50fb5ef-4db6-405e-bcce-e3a4f5917b1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:39.281222 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50fb5ef-4db6-405e-bcce-e3a4f5917b1c None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:39.285464 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e795999-9c81-4719-b494-4ac97bbfadf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:39.290310 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-7e795999-9c81-4719-b494-4ac97bbfadf4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:05:39.290310 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:39.290310 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:39.290310 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:39.290310 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:39.290310 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:39.290310 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:39.290310 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:39.290310 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:39.290310 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:39.290310 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:39.290310 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:39.290310 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:39.290310 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:39.290310 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:39.290310 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:39.291211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:39.291211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:39.291211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:39.291211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:39.291211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:39.291211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:39.291211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:39.291211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:39.291211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:39.291211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:39.291211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:39.291211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:39.291211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:39.291211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:39.291211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:39.291211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:39.292005 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:39.292005 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:39.292005 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:39.292005 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:39.292005 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:39.292005 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:39.292005 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:39.292005 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:39.292005 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:39.292005 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:39.292005 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:05:39.292005 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:39.298372 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 243/494] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 23 04:05:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:39.298372 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e795999-9c81-4719-b494-4ac97bbfadf4 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:39.298915 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 252/495] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 23 04:05:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:39.300025 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fb5ef-4db6-405e-bcce-e3a4f5917b1c None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:39.408951 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:39.419888 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e795999-9c81-4719-b494-4ac97bbfadf4 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:39.420830 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fb5ef-4db6-405e-bcce-e3a4f5917b1c None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:39.454154 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf0fa7-2c3e-409f-a62e-c85a900a9c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:39.454784 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf0fa7-2c3e-409f-a62e-c85a900a9c15 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:39.455022 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b595f-cfab-48f9-82b9-cfde212aac9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:39.455160 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf0fa7-2c3e-409f-a62e-c85a900a9c15 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:39.455328 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf0fa7-2c3e-409f-a62e-c85a900a9c15 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:39.455627 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b595f-cfab-48f9-82b9-cfde212aac9b None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:39.455908 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b595f-cfab-48f9-82b9-cfde212aac9b None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:39.456180 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b595f-cfab-48f9-82b9-cfde212aac9b None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:39.456847 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b595f-cfab-48f9-82b9-cfde212aac9b None admin] RBAC: Adding query filter params (name=service) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:39.457183 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b595f-cfab-48f9-82b9-cfde212aac9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:39.458559 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b595f-cfab-48f9-82b9-cfde212aac9b None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:39.462870 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf0fa7-2c3e-409f-a62e-c85a900a9c15 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:39.464330 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf0fa7-2c3e-409f-a62e-c85a900a9c15 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:39.466812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 253/496] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 23 04:05:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:39.467603 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b595f-cfab-48f9-82b9-cfde212aac9b None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:39.478835 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-6acf0fa7-2c3e-409f-a62e-c85a900a9c15 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 04:05:39.478835 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:39.478835 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:39.478835 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:39.478835 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:39.478835 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:39.478835 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:39.478835 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:39.478835 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:39.478835 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:39.478835 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:39.478835 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:39.478835 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:05:39.478835 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:05:39.478835 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:05:39.478835 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:05:39.479795 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:39.479795 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:39.479795 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:05:39.479795 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:05:39.479795 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:05:39.479795 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:05:39.479795 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:39.479795 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:39.479795 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:39.479795 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:39.479795 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:39.479795 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:39.479795 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:39.479795 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:39.479795 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:39.479795 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:39.479795 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:39.479795 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:39.480754 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:39.480754 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:39.480754 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:05:39.480754 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:05:39.480754 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:05:39.480754 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:05:39.480754 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:05:39.480754 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:05:39.480754 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 04:05:39.480754 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:39.480754 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 244/497] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Aug 23 04:05:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:39.480754 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf0fa7-2c3e-409f-a62e-c85a900a9c15 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:39.497439 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:39.568822 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b595f-cfab-48f9-82b9-cfde212aac9b None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:39.578314 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf0fa7-2c3e-409f-a62e-c85a900a9c15 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:39.602461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0adec-f5cd-4e38-930a-4c79f7ac7321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:39.603092 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0adec-f5cd-4e38-930a-4c79f7ac7321 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:39.603366 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0adec-f5cd-4e38-930a-4c79f7ac7321 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:39.603637 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0adec-f5cd-4e38-930a-4c79f7ac7321 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:39.611970 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd335ec-d368-4518-a25f-98b4e6e32132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:39.612588 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd335ec-d368-4518-a25f-98b4e6e32132 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:39.612870 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd335ec-d368-4518-a25f-98b4e6e32132 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:39.613181 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd335ec-d368-4518-a25f-98b4e6e32132 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:39.613805 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e0adec-f5cd-4e38-930a-4c79f7ac7321 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:39.615240 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e0adec-f5cd-4e38-930a-4c79f7ac7321 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:39.623218 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd335ec-d368-4518-a25f-98b4e6e32132 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:39.628301 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-3dd335ec-d368-4518-a25f-98b4e6e32132 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:05:39.628301 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:39.628301 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:39.628301 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:39.628301 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:39.628301 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:39.628301 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:39.628301 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:39.628301 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:39.628301 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:39.628301 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:39.628301 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:39.628301 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:39.628301 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:39.628301 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:39.628301 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:39.629207 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:39.629207 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:39.629207 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:39.629207 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:39.629207 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:39.629207 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:39.629207 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:39.629207 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:39.629207 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:39.629207 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:39.629207 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:39.629207 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:39.629207 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:39.629207 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:39.629207 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:39.629207 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:39.630028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:39.630028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:39.630028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:39.630028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:39.630028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:39.630028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:39.630028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:39.630028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:39.630028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:39.630028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:39.630028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:05:39.630028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:39.630669 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-a9e0adec-f5cd-4e38-930a-4c79f7ac7321 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:39.630669 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:39.630669 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:39.630669 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:39.630669 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:39.630669 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:39.630669 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:39.630669 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:39.630669 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:39.630669 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:39.630669 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:39.630669 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:39.630669 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:39.630669 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:39.630669 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:39.630669 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:39.631561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:39.631561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:39.631561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:39.631561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:39.631561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:39.631561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:39.631561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:39.631561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:39.631561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:39.631561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:39.631561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:39.631561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:39.631561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:39.631561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:39.631561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:39.631561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:39.631561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:39.632469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:39.632469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:39.632469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:39.632629 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 245/498] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 23 04:05:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:39.632703 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 254/499] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:39.632779 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b81647-750b-44bb-95b2-c429f60a734a None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:39.632779 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b81647-750b-44bb-95b2-c429f60a734a None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:39.632899 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0adec-f5cd-4e38-930a-4c79f7ac7321 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:39.632964 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b81647-750b-44bb-95b2-c429f60a734a None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:39.632964 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 246/500] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:39.633123 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b81647-750b-44bb-95b2-c429f60a734a None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:39.645682 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:39.714296 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:39.735146 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0adec-f5cd-4e38-930a-4c79f7ac7321 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:39.736433 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b81647-750b-44bb-95b2-c429f60a734a None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:39.769726 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0ae7d-8741-4478-8bc4-af4ede4eb96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:39.770353 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0ae7d-8741-4478-8bc4-af4ede4eb96c None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:39.770562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f960a3-8e87-4969-b3f6-f19a0bbc26c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:39.770669 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0ae7d-8741-4478-8bc4-af4ede4eb96c None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:39.770882 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0ae7d-8741-4478-8bc4-af4ede4eb96c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:39.771160 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f960a3-8e87-4969-b3f6-f19a0bbc26c6 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:39.771444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f960a3-8e87-4969-b3f6-f19a0bbc26c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:39.771766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f960a3-8e87-4969-b3f6-f19a0bbc26c6 None admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:39.772999 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f960a3-8e87-4969-b3f6-f19a0bbc26c6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:39.773338 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f960a3-8e87-4969-b3f6-f19a0bbc26c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:39.774783 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f960a3-8e87-4969-b3f6-f19a0bbc26c6 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:39.781821 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0ae7d-8741-4478-8bc4-af4ede4eb96c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:39.783259 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0ae7d-8741-4478-8bc4-af4ede4eb96c None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:39.797214 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-bde0ae7d-8741-4478-8bc4-af4ede4eb96c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:39.797214 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:39.797214 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:39.797214 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:39.797214 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:39.797214 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:39.797214 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:39.797214 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:39.797214 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:39.797214 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:39.797214 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:39.797214 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:39.797214 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:39.797214 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:39.797214 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:39.797214 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:39.798287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:39.798287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:39.798287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:39.798287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:39.798287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:39.798287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:39.798287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:39.798287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:39.798287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:39.798287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:39.798287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:39.798287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:39.798287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:39.798287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:39.798287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:39.798287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:39.798287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:39.799141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:39.799141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:39.799141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:39.799141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 255/501] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:39.799141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0ae7d-8741-4478-8bc4-af4ede4eb96c None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:39.816398 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 247/502] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Aug 23 04:05:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:39.817658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07840363-2a6f-4f3d-84d8-b65e72dcdb96 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:39.817951 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07840363-2a6f-4f3d-84d8-b65e72dcdb96 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:39.818225 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07840363-2a6f-4f3d-84d8-b65e72dcdb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:39.836510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-07840363-2a6f-4f3d-84d8-b65e72dcdb96 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:39.837660 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-07840363-2a6f-4f3d-84d8-b65e72dcdb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:39.898089 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:39.899693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0ae7d-8741-4478-8bc4-af4ede4eb96c None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:39.903114 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 248/503] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:39.916216 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07840363-2a6f-4f3d-84d8-b65e72dcdb96 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:39.930306 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:39.936363 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fddf07-5657-4563-b824-39cba21eefa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:39.937259 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fddf07-5657-4563-b824-39cba21eefa9 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:39.948986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fddf07-5657-4563-b824-39cba21eefa9 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:39.948986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fddf07-5657-4563-b824-39cba21eefa9 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:39.948986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fddf07-5657-4563-b824-39cba21eefa9 None admin] RBAC: Adding query filter params (name=service) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:39.948986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fddf07-5657-4563-b824-39cba21eefa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:39.948986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fddf07-5657-4563-b824-39cba21eefa9 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:39.951774 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 256/504] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 23 04:05:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:39.952618 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fddf07-5657-4563-b824-39cba21eefa9 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:40.003609 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07840363-2a6f-4f3d-84d8-b65e72dcdb96 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:40.037800 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268e958-b7ae-4a8d-aeff-c31a3c827dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:40.038405 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268e958-b7ae-4a8d-aeff-c31a3c827dd9 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:40.038683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268e958-b7ae-4a8d-aeff-c31a3c827dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:40.038952 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268e958-b7ae-4a8d-aeff-c31a3c827dd9 None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:40.039592 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268e958-b7ae-4a8d-aeff-c31a3c827dd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:40.039896 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268e958-b7ae-4a8d-aeff-c31a3c827dd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:40.041296 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268e958-b7ae-4a8d-aeff-c31a3c827dd9 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:40.052437 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 249/505] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:40.053834 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268e958-b7ae-4a8d-aeff-c31a3c827dd9 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:40.072199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fddf07-5657-4563-b824-39cba21eefa9 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:40.108355 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874c1ec-c1f5-452d-aba8-a06c0464ebb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:40.108990 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874c1ec-c1f5-452d-aba8-a06c0464ebb4 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:40.109299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874c1ec-c1f5-452d-aba8-a06c0464ebb4 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:40.109690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874c1ec-c1f5-452d-aba8-a06c0464ebb4 None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:40.110339 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874c1ec-c1f5-452d-aba8-a06c0464ebb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:40.110660 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874c1ec-c1f5-452d-aba8-a06c0464ebb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:40.112106 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:40.112960 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874c1ec-c1f5-452d-aba8-a06c0464ebb4 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:40.136426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 257/506] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:40.136426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874c1ec-c1f5-452d-aba8-a06c0464ebb4 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:40.159151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268e958-b7ae-4a8d-aeff-c31a3c827dd9 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:40.188339 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:40.194242 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867a328-f3b4-411d-912e-02fcbb4c39a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:40.194901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867a328-f3b4-411d-912e-02fcbb4c39a2 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:40.195179 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867a328-f3b4-411d-912e-02fcbb4c39a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:40.195447 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867a328-f3b4-411d-912e-02fcbb4c39a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:40.236612 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874c1ec-c1f5-452d-aba8-a06c0464ebb4 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:40.261918 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a867a328-f3b4-411d-912e-02fcbb4c39a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:40.263378 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a867a328-f3b4-411d-912e-02fcbb4c39a2 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:40.271026 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3781b-baad-4a09-9139-cdfced26d749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:40.271677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3781b-baad-4a09-9139-cdfced26d749 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:40.271961 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3781b-baad-4a09-9139-cdfced26d749 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:40.272235 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3781b-baad-4a09-9139-cdfced26d749 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:40.282311 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3781b-baad-4a09-9139-cdfced26d749 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:40.283764 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3781b-baad-4a09-9139-cdfced26d749 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:40.297840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-95e3781b-baad-4a09-9139-cdfced26d749 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:40.297840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:40.297840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:40.297840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:40.297840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:40.297840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:40.297840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:40.297840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:40.297840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:40.297840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:40.297840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:40.297840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:40.297840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:40.297840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:40.297840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:40.297840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:40.298925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:40.298925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:40.298925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:40.298925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:40.298925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:40.298925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:40.298925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:40.298925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:40.298925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:40.298925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:40.298925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:40.298925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:40.298925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:40.298925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:40.298925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:40.298925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:40.298925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:40.299829 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:40.299829 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:40.299829 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:40.299829 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 258/507] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:40.300109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3781b-baad-4a09-9139-cdfced26d749 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:40.319738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:40.360733 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 250/508] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:05:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:05:40.361536 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867a328-f3b4-411d-912e-02fcbb4c39a2 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:40.402454 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3781b-baad-4a09-9139-cdfced26d749 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:40.404712 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:40.436602 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26794656-53ca-4314-b97b-6986cd1f08ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:40.437272 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26794656-53ca-4314-b97b-6986cd1f08ad None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:40.437556 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26794656-53ca-4314-b97b-6986cd1f08ad None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:40.437834 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26794656-53ca-4314-b97b-6986cd1f08ad None admin] PATH_INFO: `/v3/users/glance` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:40.445213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26794656-53ca-4314-b97b-6986cd1f08ad None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:40.446671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26794656-53ca-4314-b97b-6986cd1f08ad None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:40.458846 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-26794656-53ca-4314-b97b-6986cd1f08ad None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 04:05:40.458846 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:40.458846 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:40.458846 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:40.458846 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:40.458846 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:40.458846 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:40.458846 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:40.458846 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:40.458846 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:40.458846 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:40.458846 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:40.458846 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:05:40.458846 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:05:40.458846 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:05:40.458846 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:05:40.459783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:40.459783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:40.459783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:05:40.459783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:05:40.459783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:05:40.459783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:05:40.459783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:40.459783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:40.459783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:40.459783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:40.459783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:40.459783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:40.459783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:40.459783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:40.459783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:40.459783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:40.459783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:40.459783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:40.460689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:40.460689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:40.460689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:05:40.460689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:05:40.460689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:05:40.460689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:05:40.460689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:05:40.460689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:05:40.460689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 04:05:40.460689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:40.460689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 259/509] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:05:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:40.461313 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867a328-f3b4-411d-912e-02fcbb4c39a2 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:40.461387 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26794656-53ca-4314-b97b-6986cd1f08ad None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:40.498094 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e831941-7417-4247-8a49-ec267daf32cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:40.498726 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e831941-7417-4247-8a49-ec267daf32cd None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:40.499011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e831941-7417-4247-8a49-ec267daf32cd None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:40.499287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e831941-7417-4247-8a49-ec267daf32cd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:40.506262 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e831941-7417-4247-8a49-ec267daf32cd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:40.507718 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e831941-7417-4247-8a49-ec267daf32cd None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:40.519067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-3e831941-7417-4247-8a49-ec267daf32cd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 04:05:40.519067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:40.519067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:40.519067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:40.519067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:40.519067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:40.519067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:40.519067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:40.519067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:40.519067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:40.519067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:40.519067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:40.519067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:05:40.519067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:05:40.519067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:05:40.519067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:05:40.520182 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:40.520182 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:40.520182 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:05:40.520182 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:05:40.520182 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:05:40.520182 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:05:40.520182 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:40.520182 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:40.520182 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:40.520182 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:40.520182 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:40.520182 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:40.520182 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:40.520182 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:40.520182 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:40.520182 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:40.520182 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:40.520182 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:40.521348 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:40.521348 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:40.521348 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:05:40.521348 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:05:40.521348 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:05:40.521348 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:05:40.521348 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:05:40.521348 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:05:40.521348 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 04:05:40.521348 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:40.524711 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 251/510] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:05:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:40.525518 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e831941-7417-4247-8a49-ec267daf32cd None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:40.544510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:40.560196 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26794656-53ca-4314-b97b-6986cd1f08ad None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:40.592586 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c143d7-fc3e-46de-8bca-e524e870fc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:40.593261 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c143d7-fc3e-46de-8bca-e524e870fc46 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:40.593543 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c143d7-fc3e-46de-8bca-e524e870fc46 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:40.593820 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c143d7-fc3e-46de-8bca-e524e870fc46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:40.604624 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c143d7-fc3e-46de-8bca-e524e870fc46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:40.606112 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c143d7-fc3e-46de-8bca-e524e870fc46 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:40.620497 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-07c143d7-fc3e-46de-8bca-e524e870fc46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:40.620497 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:40.620497 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:40.620497 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:40.620497 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:40.620497 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:40.620497 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:40.620497 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:40.620497 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:40.620497 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:40.620497 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:40.620497 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:40.620497 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:40.620497 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:40.620497 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:40.620497 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:40.621576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:40.621576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:40.621576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:40.621576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:40.621576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:40.621576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:40.621576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:40.621576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:40.621576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:40.621576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:40.621576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:40.621576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:40.621576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:40.621576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:40.621576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:40.621576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:40.621576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:40.622771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:40.622771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:40.622771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:40.622771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 260/511] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:40.622771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c143d7-fc3e-46de-8bca-e524e870fc46 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:40.629560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e831941-7417-4247-8a49-ec267daf32cd None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:40.640696 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:40.663272 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9e9ad-6265-4c5b-843c-27baa9b6250a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:40.663880 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9e9ad-6265-4c5b-843c-27baa9b6250a None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:40.664165 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9e9ad-6265-4c5b-843c-27baa9b6250a None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:40.664434 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9e9ad-6265-4c5b-843c-27baa9b6250a None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:40.665070 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9e9ad-6265-4c5b-843c-27baa9b6250a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:40.665399 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9e9ad-6265-4c5b-843c-27baa9b6250a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:40.666762 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9e9ad-6265-4c5b-843c-27baa9b6250a None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:40.678955 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 252/512] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:40.680003 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9e9ad-6265-4c5b-843c-27baa9b6250a None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:40.728776 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c143d7-fc3e-46de-8bca-e524e870fc46 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:40.757459 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:40.762869 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230bf7f-a07c-4fe7-a123-f9bde61f7df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:40.766189 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230bf7f-a07c-4fe7-a123-f9bde61f7df2 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:40.766189 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230bf7f-a07c-4fe7-a123-f9bde61f7df2 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:40.766189 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230bf7f-a07c-4fe7-a123-f9bde61f7df2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:40.776511 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230bf7f-a07c-4fe7-a123-f9bde61f7df2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:40.778025 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230bf7f-a07c-4fe7-a123-f9bde61f7df2 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:40.778700 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9e9ad-6265-4c5b-843c-27baa9b6250a None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:40.792447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-2230bf7f-a07c-4fe7-a123-f9bde61f7df2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:40.792447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:40.792447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:40.792447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:40.792447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:40.792447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:40.792447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:40.792447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:40.792447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:40.792447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:40.792447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:40.792447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:40.792447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:40.792447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:40.792447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:40.792447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:40.796581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:40.796581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:40.796581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:40.796581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:40.796581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:40.796581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:40.796581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:40.796581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:40.796581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:40.796581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:40.796581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:40.796581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:40.796581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:40.796581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:40.796581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:40.796581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:40.796581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:40.797546 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:40.797546 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:40.797546 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:40.797546 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 261/513] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:40.797546 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230bf7f-a07c-4fe7-a123-f9bde61f7df2 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:40.816004 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747ca7e-64de-4612-aae0-21dd4589fb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:40.816730 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747ca7e-64de-4612-aae0-21dd4589fb77 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:40.817009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747ca7e-64de-4612-aae0-21dd4589fb77 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:40.817299 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747ca7e-64de-4612-aae0-21dd4589fb77 None admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:40.818025 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747ca7e-64de-4612-aae0-21dd4589fb77 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:40.818328 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747ca7e-64de-4612-aae0-21dd4589fb77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:40.819768 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747ca7e-64de-4612-aae0-21dd4589fb77 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:40.837439 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 253/514] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Aug 23 04:05:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:40.838250 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747ca7e-64de-4612-aae0-21dd4589fb77 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:40.860810 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:40.892531 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230bf7f-a07c-4fe7-a123-f9bde61f7df2 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:40.927233 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e36525-a544-4c4d-830f-5015fcf5c2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:40.927872 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e36525-a544-4c4d-830f-5015fcf5c2d9 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:40.928625 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e36525-a544-4c4d-830f-5015fcf5c2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:40.928890 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e36525-a544-4c4d-830f-5015fcf5c2d9 None admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:40.929911 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e36525-a544-4c4d-830f-5015fcf5c2d9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:40.930220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e36525-a544-4c4d-830f-5015fcf5c2d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:40.931647 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e36525-a544-4c4d-830f-5015fcf5c2d9 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:40.940313 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747ca7e-64de-4612-aae0-21dd4589fb77 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:40.968185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 262/515] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Aug 23 04:05:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:40.969029 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e36525-a544-4c4d-830f-5015fcf5c2d9 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:40.976743 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2698050-c09b-46e5-b789-69676b8a7b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:40.977440 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2698050-c09b-46e5-b789-69676b8a7b9d None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:40.977725 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2698050-c09b-46e5-b789-69676b8a7b9d None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:40.978026 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2698050-c09b-46e5-b789-69676b8a7b9d None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:40.978670 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2698050-c09b-46e5-b789-69676b8a7b9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:40.978973 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2698050-c09b-46e5-b789-69676b8a7b9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:40.980350 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2698050-c09b-46e5-b789-69676b8a7b9d None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:40.982769 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:40.992448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 254/516] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:40.995408 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2698050-c09b-46e5-b789-69676b8a7b9d None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:41.067897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e36525-a544-4c4d-830f-5015fcf5c2d9 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:41.095010 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2698050-c09b-46e5-b789-69676b8a7b9d None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:41.095472 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:41.103813 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54dbb6-e90c-4263-a581-b4f797921a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:41.104514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54dbb6-e90c-4263-a581-b4f797921a4f None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:41.104796 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54dbb6-e90c-4263-a581-b4f797921a4f None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:41.105067 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54dbb6-e90c-4263-a581-b4f797921a4f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:41.112175 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54dbb6-e90c-4263-a581-b4f797921a4f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:41.113689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54dbb6-e90c-4263-a581-b4f797921a4f None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:41.125771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-1b54dbb6-e90c-4263-a581-b4f797921a4f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 04:05:41.125771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:41.125771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:41.125771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:41.125771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:41.125771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:41.125771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:41.125771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:41.125771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:41.125771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:41.125771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:41.125771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:41.125771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:05:41.125771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:05:41.125771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:05:41.125771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:05:41.126879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:41.126879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:41.126879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:05:41.126879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:05:41.126879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:05:41.126879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:05:41.126879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:41.126879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:41.126879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:41.126879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:41.126879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:41.126879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:41.126879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:41.126879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:41.126879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:41.126879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:41.126879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:41.126879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:41.127823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:41.127823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:41.127823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:05:41.127823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:05:41.127823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:05:41.127823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:05:41.127823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:05:41.127823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:05:41.127823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 04:05:41.127823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:41.127823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 263/517] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 23 04:05:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:41.127823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54dbb6-e90c-4263-a581-b4f797921a4f None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:41.131772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3ca74-c5b1-4027-af73-b7624e72bdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:41.132386 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3ca74-c5b1-4027-af73-b7624e72bdc0 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:41.132666 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3ca74-c5b1-4027-af73-b7624e72bdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:41.132935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3ca74-c5b1-4027-af73-b7624e72bdc0 None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:41.133614 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3ca74-c5b1-4027-af73-b7624e72bdc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:41.133919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3ca74-c5b1-4027-af73-b7624e72bdc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:41.135290 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3ca74-c5b1-4027-af73-b7624e72bdc0 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:41.147089 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 255/518] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:41.147817 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3ca74-c5b1-4027-af73-b7624e72bdc0 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:41.204108 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:41.227781 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54dbb6-e90c-4263-a581-b4f797921a4f None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:41.247052 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3ca74-c5b1-4027-af73-b7624e72bdc0 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:41.262007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df4980-387a-4145-bc7b-d919d0982b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:41.262610 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df4980-387a-4145-bc7b-d919d0982b57 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:41.262891 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df4980-387a-4145-bc7b-d919d0982b57 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:41.263165 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df4980-387a-4145-bc7b-d919d0982b57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:41.281344 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9954de-8b9a-4f67-a435-7e857de5cb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:41.281949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9954de-8b9a-4f67-a435-7e857de5cb9a None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:41.282231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9954de-8b9a-4f67-a435-7e857de5cb9a None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:41.282507 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9954de-8b9a-4f67-a435-7e857de5cb9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:41.317038 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:41.330705 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df4980-387a-4145-bc7b-d919d0982b57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:41.332194 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df4980-387a-4145-bc7b-d919d0982b57 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:41.348178 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9954de-8b9a-4f67-a435-7e857de5cb9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:41.349682 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9954de-8b9a-4f67-a435-7e857de5cb9a None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:41.403319 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:41.437644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 264/519] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:05:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:05:41.438461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df4980-387a-4145-bc7b-d919d0982b57 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:41.452615 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 256/520] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:05:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:05:41.453470 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9954de-8b9a-4f67-a435-7e857de5cb9a None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:41.530512 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:41.545165 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df4980-387a-4145-bc7b-d919d0982b57 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:41.548811 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9954de-8b9a-4f67-a435-7e857de5cb9a None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:41.579039 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e61da-ca8e-4e52-a706-d47fde3deef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:41.579643 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e61da-ca8e-4e52-a706-d47fde3deef3 None admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:41.579922 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e61da-ca8e-4e52-a706-d47fde3deef3 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:41.580193 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e61da-ca8e-4e52-a706-d47fde3deef3 None admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:41.580825 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e61da-ca8e-4e52-a706-d47fde3deef3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:41.582349 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e61da-ca8e-4e52-a706-d47fde3deef3 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:41.583268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53193cb-433d-4d0b-9929-135eedf6bd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:41.583872 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53193cb-433d-4d0b-9929-135eedf6bd0b None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:41.584332 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53193cb-433d-4d0b-9929-135eedf6bd0b None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:41.584609 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53193cb-433d-4d0b-9929-135eedf6bd0b None admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:41.585367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53193cb-433d-4d0b-9929-135eedf6bd0b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:41.585675 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53193cb-433d-4d0b-9929-135eedf6bd0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:41.587092 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53193cb-433d-4d0b-9929-135eedf6bd0b None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:41.603862 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 257/521] 10.222.0.42 () {56 vars in 1139 bytes} [Tue Aug 23 04:05:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:41.613955 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53193cb-433d-4d0b-9929-135eedf6bd0b None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:41.619446 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:41.671833 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 265/522] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 23 04:05:41 2022] POST /identity/v3/users => generated 247 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:05:41.672591 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e61da-ca8e-4e52-a706-d47fde3deef3 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:41.713125 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53193cb-433d-4d0b-9929-135eedf6bd0b None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:41.752853 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7473af1-1e29-4bfe-ab4e-b72f30359142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:41.753535 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7473af1-1e29-4bfe-ab4e-b72f30359142 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:41.753825 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7473af1-1e29-4bfe-ab4e-b72f30359142 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:41.754101 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7473af1-1e29-4bfe-ab4e-b72f30359142 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:41.762504 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7473af1-1e29-4bfe-ab4e-b72f30359142 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:41.764007 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7473af1-1e29-4bfe-ab4e-b72f30359142 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:41.777681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-c7473af1-1e29-4bfe-ab4e-b72f30359142 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:05:41.777681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:41.777681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:41.777681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:41.777681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:41.777681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:41.777681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:41.777681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:41.777681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:41.777681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:41.777681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:41.777681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:41.777681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:05:41.777681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:05:41.777681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:05:41.778821 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:05:41.778821 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:41.778821 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:41.778821 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:41.778821 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:41.778821 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:41.778821 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:41.778821 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:41.778821 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:41.778821 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:41.778821 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:41.778821 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:41.778821 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:41.778821 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:41.778821 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:41.778821 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:41.778821 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:41.784875 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:05:41.784875 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:05:41.784875 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:05:41.784875 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:05:41.784875 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:05:41.784875 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:05:41.784875 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:05:41.784875 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:41.784875 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 258/523] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:05:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:41.784875 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7473af1-1e29-4bfe-ab4e-b72f30359142 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:41.800101 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e61da-ca8e-4e52-a706-d47fde3deef3 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:41.842156 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448bbd64-949e-4d20-ba8f-b6151524c8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:41.842805 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bbd64-949e-4d20-ba8f-b6151524c8e5 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:41.843185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bbd64-949e-4d20-ba8f-b6151524c8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:41.843356 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bbd64-949e-4d20-ba8f-b6151524c8e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:41.854737 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448bbd64-949e-4d20-ba8f-b6151524c8e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:41.856229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448bbd64-949e-4d20-ba8f-b6151524c8e5 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:41.858259 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:41.870596 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:41.872351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-448bbd64-949e-4d20-ba8f-b6151524c8e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:41.872351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:41.872351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:41.872351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:41.872351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:41.872351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:41.872351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:41.872351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:41.872351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:41.872351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:41.872351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:41.872351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:41.872351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:41.872351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:41.872351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:41.872351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:41.873318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:41.873318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:41.873318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:41.873318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:41.873318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:41.873318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:41.873318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:41.873318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:41.873318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:41.873318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:41.873318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:41.873318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:41.873318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:41.873318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:41.873318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:41.873318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:41.873318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:41.874582 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:41.874582 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:41.874582 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:41.874582 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 266/524] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:41.874582 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448bbd64-949e-4d20-ba8f-b6151524c8e5 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:41.900098 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7473af1-1e29-4bfe-ab4e-b72f30359142 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:41.938634 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8fb59-c8de-4bd5-ac1d-fe0f7af0f181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:41.939187 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8fb59-c8de-4bd5-ac1d-fe0f7af0f181 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:41.939463 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8fb59-c8de-4bd5-ac1d-fe0f7af0f181 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:41.939732 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8fb59-c8de-4bd5-ac1d-fe0f7af0f181 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:41.950439 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8fb59-c8de-4bd5-ac1d-fe0f7af0f181 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:41.952366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8fb59-c8de-4bd5-ac1d-fe0f7af0f181 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:41.971490 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-c8d8fb59-c8de-4bd5-ac1d-fe0f7af0f181 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:41.971490 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:41.971490 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:41.971490 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:41.971490 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:41.971490 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:41.971490 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:41.971490 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:41.971490 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:41.971490 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:41.971490 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:41.971490 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:41.971490 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:41.971490 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:41.971490 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:41.971490 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:41.972436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:41.972436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:41.972436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:41.972436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:41.972436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:41.972436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:41.972436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:41.972436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:41.972436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:41.972436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:41.972436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:41.972436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:41.972436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:41.972436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:41.972436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:41.972436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:41.972436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:41.974206 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:41.974206 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:41.974206 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:41.974206 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 259/525] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:41.974206 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8fb59-c8de-4bd5-ac1d-fe0f7af0f181 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:41.988741 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448bbd64-949e-4d20-ba8f-b6151524c8e5 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:42.024846 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763c1ff-8c83-448c-94f9-a739518ba6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:42.025491 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763c1ff-8c83-448c-94f9-a739518ba6b0 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:42.025766 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763c1ff-8c83-448c-94f9-a739518ba6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:42.026041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763c1ff-8c83-448c-94f9-a739518ba6b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:42.081771 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8fb59-c8de-4bd5-ac1d-fe0f7af0f181 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:42.091176 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:42.099078 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9763c1ff-8c83-448c-94f9-a739518ba6b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:42.104625 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9763c1ff-8c83-448c-94f9-a739518ba6b0 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:42.109187 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:42.118560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e33da2-2fe8-4479-ba4e-24f5cdc98c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:42.119235 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e33da2-2fe8-4479-ba4e-24f5cdc98c72 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:42.119521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e33da2-2fe8-4479-ba4e-24f5cdc98c72 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:42.119795 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e33da2-2fe8-4479-ba4e-24f5cdc98c72 None admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:42.120489 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e33da2-2fe8-4479-ba4e-24f5cdc98c72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:42.120794 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e33da2-2fe8-4479-ba4e-24f5cdc98c72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:42.122272 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e33da2-2fe8-4479-ba4e-24f5cdc98c72 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:42.145124 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 260/526] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:05:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:42.145124 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e33da2-2fe8-4479-ba4e-24f5cdc98c72 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:42.211166 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 267/527] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:05:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:05:42.211937 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763c1ff-8c83-448c-94f9-a739518ba6b0 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:42.256276 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e33da2-2fe8-4479-ba4e-24f5cdc98c72 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:42.293317 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5d9eb-1ca2-453e-b084-487bce012901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:42.294637 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5d9eb-1ca2-453e-b084-487bce012901 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:42.295158 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5d9eb-1ca2-453e-b084-487bce012901 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:42.295629 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5d9eb-1ca2-453e-b084-487bce012901 None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:42.296831 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5d9eb-1ca2-453e-b084-487bce012901 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:42.297666 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5d9eb-1ca2-453e-b084-487bce012901 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:42.299575 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5d9eb-1ca2-453e-b084-487bce012901 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:42.313838 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 261/528] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:42.317346 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:42.319222 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5d9eb-1ca2-453e-b084-487bce012901 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:42.321293 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763c1ff-8c83-448c-94f9-a739518ba6b0 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:42.368399 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf6735-36a3-4996-a399-7c99e227f5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:42.368953 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:42.369110 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf6735-36a3-4996-a399-7c99e227f5a6 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:42.369305 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf6735-36a3-4996-a399-7c99e227f5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:42.369579 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf6735-36a3-4996-a399-7c99e227f5a6 None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:42.370627 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf6735-36a3-4996-a399-7c99e227f5a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:42.370627 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf6735-36a3-4996-a399-7c99e227f5a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:42.371924 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf6735-36a3-4996-a399-7c99e227f5a6 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:42.384580 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 268/529] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:42.385237 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf6735-36a3-4996-a399-7c99e227f5a6 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:42.429063 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5d9eb-1ca2-453e-b084-487bce012901 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:42.464218 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ceb0e-17f3-4bf3-a9f5-4623cb6e959d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:42.464799 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ceb0e-17f3-4bf3-a9f5-4623cb6e959d None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:42.465108 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ceb0e-17f3-4bf3-a9f5-4623cb6e959d None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:42.465390 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ceb0e-17f3-4bf3-a9f5-4623cb6e959d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:42.466119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ceb0e-17f3-4bf3-a9f5-4623cb6e959d None admin] RBAC: Adding query filter params (role.id=e7c20cdfa0b64f71a716edf832519cbb, scope.project.id=a7ada12a1e3a42949c00f483efd522ba, user.id=1e0236a0acac4b87be977878b5186551) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:42.466432 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ceb0e-17f3-4bf3-a9f5-4623cb6e959d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:42.467869 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ceb0e-17f3-4bf3-a9f5-4623cb6e959d None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:42.473475 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 262/530] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:05:42 2022] GET /identity/v3/role_assignments?user.id=1e0236a0acac4b87be977878b5186551&scope.project.id=a7ada12a1e3a42949c00f483efd522ba&role.id=e7c20cdfa0b64f71a716edf832519cbb => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:42.474067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ceb0e-17f3-4bf3-a9f5-4623cb6e959d None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:42.509244 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf6735-36a3-4996-a399-7c99e227f5a6 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:42.566781 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4ab45-fbba-4f00-8956-fe0e28ea8d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:42.568050 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4ab45-fbba-4f00-8956-fe0e28ea8d0f None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:42.569180 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4ab45-fbba-4f00-8956-fe0e28ea8d0f None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:42.569642 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4ab45-fbba-4f00-8956-fe0e28ea8d0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:42.586775 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4ab45-fbba-4f00-8956-fe0e28ea8d0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:42.589339 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4ab45-fbba-4f00-8956-fe0e28ea8d0f None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:42.591815 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ceb0e-17f3-4bf3-a9f5-4623cb6e959d None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:42.604150 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:42.609551 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-c1b4ab45-fbba-4f00-8956-fe0e28ea8d0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:42.609551 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:42.609551 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:42.609551 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:42.609551 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:42.609551 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:42.609551 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:42.609551 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:42.609551 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:42.609551 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:42.609551 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:42.609551 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:42.609551 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:42.609551 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:42.609551 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:42.609551 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:42.610493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:42.610493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:42.610493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:42.610493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:42.610493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:42.610493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:42.610493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:42.610493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:42.610493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:42.610493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:42.610493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:42.610493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:42.610493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:42.610493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:42.610493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:42.610493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:42.610493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:42.611343 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:42.611343 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:42.611343 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:42.611343 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 269/531] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:42.611577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4ab45-fbba-4f00-8956-fe0e28ea8d0f None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:42.622544 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:42.646820 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee9cda-de7f-4684-9f4e-037c52bfdc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:42.647571 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee9cda-de7f-4684-9f4e-037c52bfdc50 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:42.647918 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee9cda-de7f-4684-9f4e-037c52bfdc50 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:42.648350 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee9cda-de7f-4684-9f4e-037c52bfdc50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:42.658061 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee9cda-de7f-4684-9f4e-037c52bfdc50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:42.659533 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee9cda-de7f-4684-9f4e-037c52bfdc50 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:42.674555 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-38ee9cda-de7f-4684-9f4e-037c52bfdc50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:05:42.674555 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:42.674555 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:42.674555 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:42.674555 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:42.674555 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:42.674555 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:42.674555 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:42.674555 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:42.674555 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:42.674555 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:42.674555 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:42.674555 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:05:42.674555 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:05:42.674555 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:05:42.675659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:05:42.675659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:42.675659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:42.675659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:42.675659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:42.675659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:42.675659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:42.675659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:42.675659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:42.675659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:42.675659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:42.675659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:42.675659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:42.675659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:42.675659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:42.675659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:42.675659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:42.676732 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:05:42.676732 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:05:42.676732 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:05:42.676732 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:05:42.676732 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:05:42.676732 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:05:42.676732 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:05:42.676732 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:42.676732 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 263/532] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:05:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:42.676732 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee9cda-de7f-4684-9f4e-037c52bfdc50 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:42.743851 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4ab45-fbba-4f00-8956-fe0e28ea8d0f None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:42.788211 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947dc20-3167-4fea-9953-57c2bf6501c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:42.788961 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947dc20-3167-4fea-9953-57c2bf6501c8 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:42.793895 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947dc20-3167-4fea-9953-57c2bf6501c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:42.793895 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947dc20-3167-4fea-9953-57c2bf6501c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:42.800831 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9947dc20-3167-4fea-9953-57c2bf6501c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:42.804215 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9947dc20-3167-4fea-9953-57c2bf6501c8 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:42.805524 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee9cda-de7f-4684-9f4e-037c52bfdc50 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:42.826034 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-9947dc20-3167-4fea-9953-57c2bf6501c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:05:42.826034 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:42.826034 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:42.826034 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:42.826034 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:42.826034 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:42.826034 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:42.826034 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:42.826034 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:42.826034 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:42.826034 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:42.826034 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:42.826034 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:05:42.826034 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:05:42.826034 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:05:42.827204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:05:42.827204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:42.827204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:42.827204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:42.827204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:42.827204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:42.827204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:42.827204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:42.827204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:42.827204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:42.827204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:42.827204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:42.827204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:42.827204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:42.827204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:42.827204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:42.827204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:42.828281 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:05:42.828281 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:05:42.828281 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:05:42.828281 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:05:42.828281 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:05:42.828281 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:05:42.828281 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:05:42.828281 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:42.831070 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 270/533] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:05:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:42.832017 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947dc20-3167-4fea-9953-57c2bf6501c8 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:42.854408 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794912d-f56d-43b5-b1fd-63a5fbdcfe80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:42.855204 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794912d-f56d-43b5-b1fd-63a5fbdcfe80 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:42.855692 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794912d-f56d-43b5-b1fd-63a5fbdcfe80 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:42.856007 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794912d-f56d-43b5-b1fd-63a5fbdcfe80 None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:42.856784 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794912d-f56d-43b5-b1fd-63a5fbdcfe80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:42.857294 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794912d-f56d-43b5-b1fd-63a5fbdcfe80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:42.859572 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794912d-f56d-43b5-b1fd-63a5fbdcfe80 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:42.872905 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 264/534] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:42.873987 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794912d-f56d-43b5-b1fd-63a5fbdcfe80 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:42.906540 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:42.921874 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:42.961843 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947dc20-3167-4fea-9953-57c2bf6501c8 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:43.003684 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb39e38-532b-4b48-9249-e3c04aaefd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:43.004652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb39e38-532b-4b48-9249-e3c04aaefd6a None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:43.005082 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb39e38-532b-4b48-9249-e3c04aaefd6a None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:43.005629 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb39e38-532b-4b48-9249-e3c04aaefd6a None admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:43.006527 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb39e38-532b-4b48-9249-e3c04aaefd6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:43.006982 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb39e38-532b-4b48-9249-e3c04aaefd6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:43.008533 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794912d-f56d-43b5-b1fd-63a5fbdcfe80 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:43.008825 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb39e38-532b-4b48-9249-e3c04aaefd6a None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:43.035491 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 271/535] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:05:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:43.035491 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb39e38-532b-4b48-9249-e3c04aaefd6a None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:43.063413 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84aab7d-7720-410d-892c-826e672228b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:43.064491 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84aab7d-7720-410d-892c-826e672228b4 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:43.065249 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84aab7d-7720-410d-892c-826e672228b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:43.065950 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84aab7d-7720-410d-892c-826e672228b4 None admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:43.066801 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84aab7d-7720-410d-892c-826e672228b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:43.067421 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84aab7d-7720-410d-892c-826e672228b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:43.069691 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84aab7d-7720-410d-892c-826e672228b4 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:43.085512 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 265/536] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:05:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:43.086999 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84aab7d-7720-410d-892c-826e672228b4 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:43.148209 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb39e38-532b-4b48-9249-e3c04aaefd6a None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:43.175953 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:43.189206 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c927b-a944-4933-8745-ddd58cf3e9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:43.194816 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c927b-a944-4933-8745-ddd58cf3e9b9 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:43.194816 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c927b-a944-4933-8745-ddd58cf3e9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:43.194816 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c927b-a944-4933-8745-ddd58cf3e9b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:43.200775 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c927b-a944-4933-8745-ddd58cf3e9b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:43.203012 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c927b-a944-4933-8745-ddd58cf3e9b9 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:43.210321 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:43.220410 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84aab7d-7720-410d-892c-826e672228b4 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:43.222533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-bd6c927b-a944-4933-8745-ddd58cf3e9b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:05:43.222533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:43.222533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:43.222533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:43.222533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:43.222533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:43.222533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:43.222533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:43.222533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:43.222533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:43.222533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:43.222533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:43.222533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:05:43.222533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:05:43.222533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:05:43.223812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:05:43.223812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:43.223812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:43.223812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:43.223812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:43.223812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:43.223812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:43.223812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:43.223812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:43.223812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:43.223812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:43.223812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:43.223812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:43.223812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:43.223812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:43.223812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:43.223812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:43.225608 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:05:43.225608 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:05:43.225608 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:05:43.225608 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:05:43.225608 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:05:43.225608 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:05:43.225608 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:05:43.225608 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:43.228453 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 272/537] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:05:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:43.229524 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c927b-a944-4933-8745-ddd58cf3e9b9 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:43.266090 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5d4b1-2a39-4f89-bab4-58a470e9d92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:43.266863 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5d4b1-2a39-4f89-bab4-58a470e9d92b None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:43.267263 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5d4b1-2a39-4f89-bab4-58a470e9d92b None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:43.267919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5d4b1-2a39-4f89-bab4-58a470e9d92b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:43.268562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5d4b1-2a39-4f89-bab4-58a470e9d92b None admin] RBAC: Adding query filter params (role.id=e7c20cdfa0b64f71a716edf832519cbb, scope.project.id=a7ada12a1e3a42949c00f483efd522ba, user.id=020af86302e447a6b3973df4abbabafa) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:43.268975 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5d4b1-2a39-4f89-bab4-58a470e9d92b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:43.270631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5d4b1-2a39-4f89-bab4-58a470e9d92b None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:43.282831 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 266/538] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:05:43 2022] GET /identity/v3/role_assignments?user.id=020af86302e447a6b3973df4abbabafa&scope.project.id=a7ada12a1e3a42949c00f483efd522ba&role.id=e7c20cdfa0b64f71a716edf832519cbb => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:43.283869 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5d4b1-2a39-4f89-bab4-58a470e9d92b None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:43.400200 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c927b-a944-4933-8745-ddd58cf3e9b9 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:43.442973 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793204d8-27a7-4c38-aee6-5fa863d4aa44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:43.444421 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793204d8-27a7-4c38-aee6-5fa863d4aa44 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:43.444858 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793204d8-27a7-4c38-aee6-5fa863d4aa44 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:43.445890 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793204d8-27a7-4c38-aee6-5fa863d4aa44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:43.446955 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793204d8-27a7-4c38-aee6-5fa863d4aa44 None admin] RBAC: Adding query filter params (role.id=e7c20cdfa0b64f71a716edf832519cbb, scope.project.id=a7ada12a1e3a42949c00f483efd522ba, user.id=a0b0ac2dd135450c9bfe918f98c19425) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:43.447552 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793204d8-27a7-4c38-aee6-5fa863d4aa44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:43.449394 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793204d8-27a7-4c38-aee6-5fa863d4aa44 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:43.456989 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 273/539] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:05:43 2022] GET /identity/v3/role_assignments?user.id=a0b0ac2dd135450c9bfe918f98c19425&scope.project.id=a7ada12a1e3a42949c00f483efd522ba&role.id=e7c20cdfa0b64f71a716edf832519cbb => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:43.490807 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5d4b1-2a39-4f89-bab4-58a470e9d92b None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:43.532240 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804954b0-ffb8-42b5-b519-e207a8299948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:43.533149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804954b0-ffb8-42b5-b519-e207a8299948 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:43.533582 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804954b0-ffb8-42b5-b519-e207a8299948 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:43.534006 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804954b0-ffb8-42b5-b519-e207a8299948 None admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:43.534894 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804954b0-ffb8-42b5-b519-e207a8299948 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:43.535359 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804954b0-ffb8-42b5-b519-e207a8299948 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:43.537635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804954b0-ffb8-42b5-b519-e207a8299948 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:43.558331 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 267/540] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:05:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:43.566428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793204d8-27a7-4c38-aee6-5fa863d4aa44 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:43.636178 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befaec8-43c1-477f-8f51-90016cb0a47f None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:43.636178 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befaec8-43c1-477f-8f51-90016cb0a47f None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:43.636449 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befaec8-43c1-477f-8f51-90016cb0a47f None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:43.637724 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 268/541] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 04:05:43.642987 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e564b-f53e-40cd-b1a4-4739e5a0821c None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:43.643269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e564b-f53e-40cd-b1a4-4739e5a0821c None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:43.643543 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e564b-f53e-40cd-b1a4-4739e5a0821c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:43.650412 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:43.663478 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-c67e564b-f53e-40cd-b1a4-4739e5a0821c None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:43.665196 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c67e564b-f53e-40cd-b1a4-4739e5a0821c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:43.676762 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:43.745722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793204d8-27a7-4c38-aee6-5fa863d4aa44 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:43.749677 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 269/542] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 04:05:43.809560 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaafc1f-2760-4ac4-a6dc-677548194c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:43.810085 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaafc1f-2760-4ac4-a6dc-677548194c6d None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:43.810430 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaafc1f-2760-4ac4-a6dc-677548194c6d None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:43.810715 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaafc1f-2760-4ac4-a6dc-677548194c6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:43.811532 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaafc1f-2760-4ac4-a6dc-677548194c6d None admin] RBAC: Adding query filter params (role.id=e7c20cdfa0b64f71a716edf832519cbb, scope.project.id=a7ada12a1e3a42949c00f483efd522ba, user.id=8304ca06f82742ef8ce74396884e90b4) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:43.811854 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaafc1f-2760-4ac4-a6dc-677548194c6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:43.817795 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaafc1f-2760-4ac4-a6dc-677548194c6d None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:43.824115 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 274/543] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:05:43 2022] GET /identity/v3/role_assignments?user.id=8304ca06f82742ef8ce74396884e90b4&scope.project.id=a7ada12a1e3a42949c00f483efd522ba&role.id=e7c20cdfa0b64f71a716edf832519cbb => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:44.033584 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e564b-f53e-40cd-b1a4-4739e5a0821c None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:44.158695 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e564b-f53e-40cd-b1a4-4739e5a0821c None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:44.195340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115f1d9-7bb5-4700-9e2f-394b92464c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:44.195972 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115f1d9-7bb5-4700-9e2f-394b92464c75 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:44.196249 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115f1d9-7bb5-4700-9e2f-394b92464c75 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:44.196518 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115f1d9-7bb5-4700-9e2f-394b92464c75 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:44.207237 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115f1d9-7bb5-4700-9e2f-394b92464c75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:44.212049 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-3115f1d9-7bb5-4700-9e2f-394b92464c75 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:05:44.212049 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:44.212049 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:44.212049 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:44.212049 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:44.212049 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:44.212049 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:44.212049 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:44.212049 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:44.212049 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:44.212049 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:44.212049 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:44.212049 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:44.212049 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:44.212049 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:44.212049 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:44.212966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:44.212966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:44.212966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:44.212966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:44.212966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:44.212966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:44.212966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:44.212966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:44.212966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:44.212966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:44.212966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:44.212966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:44.212966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:44.212966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:44.212966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:44.212966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:44.213827 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:44.213827 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:44.213827 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:44.213827 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:44.213827 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:44.213827 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:44.213827 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:44.213827 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:44.213827 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:44.213827 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:44.213827 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:05:44.213827 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:44.217343 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 270/544] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 23 04:05:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:44.219633 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaafc1f-2760-4ac4-a6dc-677548194c6d None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:44.327382 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaafc1f-2760-4ac4-a6dc-677548194c6d None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:44.342653 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:44.363003 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776f28e-a435-40d1-99a6-996f586d8ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:44.363614 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776f28e-a435-40d1-99a6-996f586d8ecb None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:44.363891 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776f28e-a435-40d1-99a6-996f586d8ecb None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:44.364163 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776f28e-a435-40d1-99a6-996f586d8ecb None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:44.369300 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776f28e-a435-40d1-99a6-996f586d8ecb None admin] RBAC: Adding query filter params (name=service) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:44.369300 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776f28e-a435-40d1-99a6-996f586d8ecb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:44.369300 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776f28e-a435-40d1-99a6-996f586d8ecb None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:44.378553 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 275/545] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 23 04:05:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:44.381970 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115f1d9-7bb5-4700-9e2f-394b92464c75 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:44.386529 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:44.486652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115f1d9-7bb5-4700-9e2f-394b92464c75 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:44.522807 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6be975-2773-42d8-8076-ca509ae43a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:44.523760 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6be975-2773-42d8-8076-ca509ae43a28 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:44.524221 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6be975-2773-42d8-8076-ca509ae43a28 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:44.524683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6be975-2773-42d8-8076-ca509ae43a28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:44.538925 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6be975-2773-42d8-8076-ca509ae43a28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:44.540653 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6be975-2773-42d8-8076-ca509ae43a28 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:44.561282 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-5e6be975-2773-42d8-8076-ca509ae43a28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:44.561282 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:44.561282 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:44.561282 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:44.561282 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:44.561282 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:44.561282 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:44.561282 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:44.561282 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:44.561282 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:44.561282 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:44.561282 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:44.561282 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:44.561282 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:44.561282 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:44.561282 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:44.562232 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:44.562232 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:44.562232 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:44.562232 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:44.562232 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:44.562232 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:44.562232 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:44.562232 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:44.562232 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:44.562232 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:44.562232 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:44.562232 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:44.562232 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:44.562232 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:44.562232 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:44.562232 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:44.562232 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:44.563374 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:44.563374 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:44.563374 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:44.563374 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 271/546] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:44.570042 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776f28e-a435-40d1-99a6-996f586d8ecb None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:44.674688 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776f28e-a435-40d1-99a6-996f586d8ecb None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:44.710558 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c18b0-2586-427c-b365-eca0b9a18558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:44.711632 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c18b0-2586-427c-b365-eca0b9a18558 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:44.712170 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c18b0-2586-427c-b365-eca0b9a18558 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:44.712638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c18b0-2586-427c-b365-eca0b9a18558 None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:44.713555 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c18b0-2586-427c-b365-eca0b9a18558 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:44.714054 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c18b0-2586-427c-b365-eca0b9a18558 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:44.715697 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c18b0-2586-427c-b365-eca0b9a18558 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:44.732332 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 276/547] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:44.734171 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6be975-2773-42d8-8076-ca509ae43a28 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:44.832125 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:44.883085 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6be975-2773-42d8-8076-ca509ae43a28 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:44.921794 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d24541-9b2d-40b3-9cac-c3fc36c1dd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:44.922434 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d24541-9b2d-40b3-9cac-c3fc36c1dd84 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:44.922716 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d24541-9b2d-40b3-9cac-c3fc36c1dd84 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:44.922991 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d24541-9b2d-40b3-9cac-c3fc36c1dd84 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:44.930200 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb415662-d83d-43a7-857c-3b7a31c8d73c None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:44.931061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb415662-d83d-43a7-857c-3b7a31c8d73c None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:44.931554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb415662-d83d-43a7-857c-3b7a31c8d73c None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:44.932324 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d24541-9b2d-40b3-9cac-c3fc36c1dd84 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:44.933814 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d24541-9b2d-40b3-9cac-c3fc36c1dd84 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:44.937190 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 277/548] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:44.939570 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42311b65-dc57-4798-a435-49bd35cae27f None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:44.939957 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42311b65-dc57-4798-a435-49bd35cae27f None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:44.940350 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42311b65-dc57-4798-a435-49bd35cae27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:44.946988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-07d24541-9b2d-40b3-9cac-c3fc36c1dd84 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 04:05:44.946988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:44.946988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:44.946988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:44.946988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:44.946988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:44.946988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:44.946988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:44.946988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:44.946988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:44.946988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:44.946988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:44.946988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:05:44.946988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:05:44.946988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:05:44.946988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:05:44.948326 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:44.948326 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:44.948326 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:05:44.948326 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:05:44.948326 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:05:44.948326 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:05:44.948326 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:44.948326 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:44.948326 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:44.948326 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:44.948326 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:44.948326 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:44.948326 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:44.948326 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:44.948326 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:44.948326 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:44.948326 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:44.948326 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:44.949495 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:44.949495 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:44.949495 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:05:44.949495 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:05:44.949495 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:05:44.949495 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:05:44.949495 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:05:44.949495 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:05:44.949495 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 04:05:44.949495 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:44.951646 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 272/549] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:05:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:44.958232 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d24541-9b2d-40b3-9cac-c3fc36c1dd84 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:44.983118 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-42311b65-dc57-4798-a435-49bd35cae27f None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:44.984339 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-42311b65-dc57-4798-a435-49bd35cae27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:45.044468 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:45.113463 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 278/550] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 04:05:45.127292 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d24541-9b2d-40b3-9cac-c3fc36c1dd84 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:45.163725 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:45.192569 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb255e-9a60-4c73-8448-e08085f8a15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:45.193734 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb255e-9a60-4c73-8448-e08085f8a15f None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:45.194022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb255e-9a60-4c73-8448-e08085f8a15f None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:45.194301 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb255e-9a60-4c73-8448-e08085f8a15f None admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:45.195047 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eb255e-9a60-4c73-8448-e08085f8a15f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:45.195427 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eb255e-9a60-4c73-8448-e08085f8a15f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:45.196875 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eb255e-9a60-4c73-8448-e08085f8a15f None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:45.227807 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 273/551] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Aug 23 04:05:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:05:45.233406 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42311b65-dc57-4798-a435-49bd35cae27f None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:45.383159 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42311b65-dc57-4798-a435-49bd35cae27f None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:45.432368 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b352977-1e7c-4099-bc52-89c6c7a8c659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:45.433385 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b352977-1e7c-4099-bc52-89c6c7a8c659 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:45.433982 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b352977-1e7c-4099-bc52-89c6c7a8c659 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:45.434468 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b352977-1e7c-4099-bc52-89c6c7a8c659 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:45.444268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb255e-9a60-4c73-8448-e08085f8a15f None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:45.501542 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:45.577398 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb255e-9a60-4c73-8448-e08085f8a15f None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:45.590111 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b352977-1e7c-4099-bc52-89c6c7a8c659 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:45.591605 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b352977-1e7c-4099-bc52-89c6c7a8c659 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:45.617220 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e5ae4-8b27-4e09-bacf-42edd67df6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:45.618369 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e5ae4-8b27-4e09-bacf-42edd67df6eb None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:45.618882 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e5ae4-8b27-4e09-bacf-42edd67df6eb None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:45.619380 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e5ae4-8b27-4e09-bacf-42edd67df6eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:45.630850 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e5ae4-8b27-4e09-bacf-42edd67df6eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:45.636096 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-7d2e5ae4-8b27-4e09-bacf-42edd67df6eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:05:45.636096 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:45.636096 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:45.636096 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:45.636096 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:45.636096 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:45.636096 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:45.636096 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:45.636096 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:45.636096 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:45.636096 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:45.636096 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:45.636096 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:45.636096 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:45.636096 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:45.636096 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:45.637022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:45.637022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:45.637022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:45.637022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:45.637022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:45.637022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:45.637022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:45.637022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:45.637022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:45.637022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:45.637022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:45.637022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:45.637022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:45.637022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:45.637022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:45.637022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:45.637900 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:45.637900 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:45.637900 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:45.637900 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:45.637900 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:45.637900 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:45.637900 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:45.637900 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:45.637900 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:45.637900 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:45.637900 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:05:45.637900 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:45.641342 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 274/552] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 23 04:05:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:45.647248 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e5ae4-8b27-4e09-bacf-42edd67df6eb None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:45.725436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:45.761064 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 279/553] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:05:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:05:45.762811 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd9af0-b96e-440c-bace-790847a3a485 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:45.763443 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd9af0-b96e-440c-bace-790847a3a485 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:45.763928 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd9af0-b96e-440c-bace-790847a3a485 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:45.765898 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 280/554] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:45.766839 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd9af0-b96e-440c-bace-790847a3a485 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:45.814016 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e5ae4-8b27-4e09-bacf-42edd67df6eb None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:45.853951 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:45.862984 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d82c16-51ba-4e84-a431-2cb8c5c2708f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:45.863943 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d82c16-51ba-4e84-a431-2cb8c5c2708f None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:45.864395 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d82c16-51ba-4e84-a431-2cb8c5c2708f None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:45.864838 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d82c16-51ba-4e84-a431-2cb8c5c2708f None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:45.866185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d82c16-51ba-4e84-a431-2cb8c5c2708f None admin] RBAC: Adding query filter params (name=service) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:45.866669 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d82c16-51ba-4e84-a431-2cb8c5c2708f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:45.868934 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d82c16-51ba-4e84-a431-2cb8c5c2708f None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:45.880178 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 275/555] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 23 04:05:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:45.882666 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5307a-48d0-412e-a1b9-6c7194852e51 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:45.883165 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5307a-48d0-412e-a1b9-6c7194852e51 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:45.883952 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5307a-48d0-412e-a1b9-6c7194852e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:45.894559 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd9af0-b96e-440c-bace-790847a3a485 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:45.908743 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-aad5307a-48d0-412e-a1b9-6c7194852e51 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:45.910571 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-aad5307a-48d0-412e-a1b9-6c7194852e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:45.937154 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb17d3e-5883-47fb-9330-48f7f8a3a9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:45.937799 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb17d3e-5883-47fb-9330-48f7f8a3a9bc None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:45.938082 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb17d3e-5883-47fb-9330-48f7f8a3a9bc None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:45.938355 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb17d3e-5883-47fb-9330-48f7f8a3a9bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:45.950233 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb17d3e-5883-47fb-9330-48f7f8a3a9bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:45.951689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb17d3e-5883-47fb-9330-48f7f8a3a9bc None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:45.970644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-0cb17d3e-5883-47fb-9330-48f7f8a3a9bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:45.970644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:45.970644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:45.970644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:45.970644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:45.970644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:45.970644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:45.970644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:45.970644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:45.970644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:45.970644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:45.970644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:45.970644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:45.970644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:45.970644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:45.970644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:45.971639 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:45.971639 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:45.971639 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:45.971639 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:45.971639 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:45.971639 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:45.971639 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:45.971639 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:45.971639 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:45.971639 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:45.971639 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:45.971639 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:45.971639 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:45.971639 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:45.971639 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:45.971639 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:45.971639 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:45.972561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:45.972561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:45.972561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:45.972561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 281/556] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:45.972561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb17d3e-5883-47fb-9330-48f7f8a3a9bc None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:45.999678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 276/557] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:46.000955 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c43ff5-0424-4b0c-b9cf-d28de6ea974e None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:46.001304 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c43ff5-0424-4b0c-b9cf-d28de6ea974e None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:46.001584 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c43ff5-0424-4b0c-b9cf-d28de6ea974e None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:46.003051 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 277/558] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:46.008334 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c43ff5-0424-4b0c-b9cf-d28de6ea974e None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:46.042959 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:46.094010 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb17d3e-5883-47fb-9330-48f7f8a3a9bc None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:46.113744 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:46.134458 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d8ad7-1816-4cac-9e7a-31821b2c7d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:46.135728 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d8ad7-1816-4cac-9e7a-31821b2c7d8f None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:46.136325 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d8ad7-1816-4cac-9e7a-31821b2c7d8f None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:46.136627 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c43ff5-0424-4b0c-b9cf-d28de6ea974e None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:46.137447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d8ad7-1816-4cac-9e7a-31821b2c7d8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:46.149756 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d8ad7-1816-4cac-9e7a-31821b2c7d8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:46.152032 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d8ad7-1816-4cac-9e7a-31821b2c7d8f None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:46.167209 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-bd1d8ad7-1816-4cac-9e7a-31821b2c7d8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:46.167209 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:46.167209 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:46.167209 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:46.167209 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:46.167209 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:46.167209 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:46.167209 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:46.167209 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:46.167209 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:46.167209 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:46.167209 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:46.167209 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:46.167209 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:46.167209 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:46.167209 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:46.168648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:46.168648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:46.168648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:46.168648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:46.168648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:46.168648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:46.168648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:46.168648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:46.168648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:46.168648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:46.168648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:46.168648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:46.168648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:46.168648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:46.168648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:46.168648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:46.168648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:46.170143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:46.170143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:46.170143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:46.170143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 282/559] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:46.170143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f7bf5-35b4-40ae-8064-25f64b45f8c7 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:46.170143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f7bf5-35b4-40ae-8064-25f64b45f8c7 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:46.170486 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f7bf5-35b4-40ae-8064-25f64b45f8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:46.181473 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dacd3f-ca79-47ce-9420-7bf8feac530e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:46.182092 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dacd3f-ca79-47ce-9420-7bf8feac530e None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:46.182378 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dacd3f-ca79-47ce-9420-7bf8feac530e None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:46.182657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dacd3f-ca79-47ce-9420-7bf8feac530e None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:46.183312 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dacd3f-ca79-47ce-9420-7bf8feac530e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:46.183618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dacd3f-ca79-47ce-9420-7bf8feac530e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:46.184981 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dacd3f-ca79-47ce-9420-7bf8feac530e None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:46.189715 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-669f7bf5-35b4-40ae-8064-25f64b45f8c7 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:46.190910 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-669f7bf5-35b4-40ae-8064-25f64b45f8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:46.201535 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 278/560] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:46.201535 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127f849-981d-44ad-a511-eb033881c91b None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:46.201535 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127f849-981d-44ad-a511-eb033881c91b None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:46.201535 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127f849-981d-44ad-a511-eb033881c91b None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:46.201535 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 279/561] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:46.202227 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127f849-981d-44ad-a511-eb033881c91b None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:46.266682 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 283/562] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:46.267604 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f7bf5-35b4-40ae-8064-25f64b45f8c7 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:46.307019 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:46.324242 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127f849-981d-44ad-a511-eb033881c91b None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:46.362169 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9b820-3c63-4c2e-9e78-99d0438f369c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:46.363015 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9b820-3c63-4c2e-9e78-99d0438f369c None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:46.363396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9b820-3c63-4c2e-9e78-99d0438f369c None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:46.363801 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9b820-3c63-4c2e-9e78-99d0438f369c None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:46.364518 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9b820-3c63-4c2e-9e78-99d0438f369c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:46.364928 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9b820-3c63-4c2e-9e78-99d0438f369c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:46.366663 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9b820-3c63-4c2e-9e78-99d0438f369c None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:46.372008 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:46.374931 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f7bf5-35b4-40ae-8064-25f64b45f8c7 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:46.384481 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 280/563] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:46.385755 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b081b6-17a6-4406-bc5c-9f7c869da958 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:46.386054 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b081b6-17a6-4406-bc5c-9f7c869da958 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:46.386338 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b081b6-17a6-4406-bc5c-9f7c869da958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:46.404317 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-01b081b6-17a6-4406-bc5c-9f7c869da958 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:46.405476 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-01b081b6-17a6-4406-bc5c-9f7c869da958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:46.412906 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbf8c6-4a3e-4eb4-9aab-24827c3fb67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:46.413979 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbf8c6-4a3e-4eb4-9aab-24827c3fb67c None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:46.414269 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbf8c6-4a3e-4eb4-9aab-24827c3fb67c None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:46.414542 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbf8c6-4a3e-4eb4-9aab-24827c3fb67c None admin] PATH_INFO: `/v3/projects/service` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:46.422036 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dbf8c6-4a3e-4eb4-9aab-24827c3fb67c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:46.424025 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dbf8c6-4a3e-4eb4-9aab-24827c3fb67c None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:46.435690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-92dbf8c6-4a3e-4eb4-9aab-24827c3fb67c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:05:46.435690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:46.435690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:46.435690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:46.435690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:46.435690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:46.435690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:46.435690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:46.435690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:46.435690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:46.435690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:46.435690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:46.435690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:05:46.435690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:05:46.435690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:05:46.436593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:05:46.436593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:46.436593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:46.436593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:46.436593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:46.436593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:46.436593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:46.436593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:46.436593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:46.436593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:46.436593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:46.436593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:46.436593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:46.436593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:46.436593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:46.436593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:46.436593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:46.438046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:05:46.438046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:05:46.438046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:05:46.438046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:05:46.438046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:05:46.438046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:05:46.438046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:05:46.438046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:46.438046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 284/564] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:05:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:46.438046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbf8c6-4a3e-4eb4-9aab-24827c3fb67c None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:46.487075 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 281/565] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:46.488352 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b081b6-17a6-4406-bc5c-9f7c869da958 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:46.542824 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbf8c6-4a3e-4eb4-9aab-24827c3fb67c None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:46.577321 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a85ad-731b-4dbe-a71f-684e421c9b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:46.577948 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a85ad-731b-4dbe-a71f-684e421c9b5f None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:46.578230 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a85ad-731b-4dbe-a71f-684e421c9b5f None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:46.578505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a85ad-731b-4dbe-a71f-684e421c9b5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:46.588073 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:46.594680 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a85ad-731b-4dbe-a71f-684e421c9b5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:46.599595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-d02a85ad-731b-4dbe-a71f-684e421c9b5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:05:46.599595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:46.599595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:46.599595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:46.599595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:46.599595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:46.599595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:46.599595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:46.599595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:46.599595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:46.599595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:46.599595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:46.599595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:46.599595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:46.599595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:46.599595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:46.600753 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:46.600753 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:46.600753 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:46.600753 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:46.600753 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:46.600753 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:46.600753 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:46.600753 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:46.600753 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:46.600753 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:46.600753 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:46.600753 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:46.600753 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:46.600753 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:46.600753 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:46.600753 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:46.602205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:46.602205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:46.602205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:46.602205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:46.602205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:46.602205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:46.602205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:46.602205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:46.602205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:46.602205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:46.602205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:05:46.602205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:46.602205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 285/566] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 23 04:05:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:46.602205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a85ad-731b-4dbe-a71f-684e421c9b5f None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:46.619030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b081b6-17a6-4406-bc5c-9f7c869da958 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:46.624257 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:46.655915 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d41438e-53af-4e52-ac07-3105ca56e2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:46.656481 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41438e-53af-4e52-ac07-3105ca56e2b0 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:46.656773 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41438e-53af-4e52-ac07-3105ca56e2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:46.657052 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41438e-53af-4e52-ac07-3105ca56e2b0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:46.664760 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d41438e-53af-4e52-ac07-3105ca56e2b0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:46.667063 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d41438e-53af-4e52-ac07-3105ca56e2b0 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:46.682493 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-0d41438e-53af-4e52-ac07-3105ca56e2b0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 04:05:46.682493 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:46.682493 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:46.682493 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:46.682493 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:46.682493 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:46.682493 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:46.682493 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:46.682493 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:46.682493 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:46.682493 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:46.682493 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:46.682493 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:05:46.682493 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:05:46.682493 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:05:46.682493 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:05:46.683684 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:46.683684 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:46.683684 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:05:46.683684 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:05:46.683684 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:05:46.683684 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:05:46.683684 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:46.683684 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:46.683684 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:46.683684 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:46.683684 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:46.683684 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:46.683684 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:46.683684 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:46.683684 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:46.683684 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:46.683684 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:46.683684 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:46.684825 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:46.684825 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:46.684825 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:05:46.684825 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:05:46.684825 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:05:46.684825 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:05:46.684825 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:05:46.684825 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:05:46.684825 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 04:05:46.684825 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:46.689020 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 282/567] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Aug 23 04:05:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:46.689734 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d41438e-53af-4e52-ac07-3105ca56e2b0 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:46.713283 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a85ad-731b-4dbe-a71f-684e421c9b5f None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:46.748187 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642dd1a0-5451-48ae-8a11-026f9420196f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:46.749042 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dd1a0-5451-48ae-8a11-026f9420196f None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:46.749511 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dd1a0-5451-48ae-8a11-026f9420196f None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:46.749785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dd1a0-5451-48ae-8a11-026f9420196f None admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:46.750517 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642dd1a0-5451-48ae-8a11-026f9420196f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:46.750825 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642dd1a0-5451-48ae-8a11-026f9420196f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:46.752261 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642dd1a0-5451-48ae-8a11-026f9420196f None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:46.764323 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 286/568] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:05:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:46.765158 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642dd1a0-5451-48ae-8a11-026f9420196f None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:46.795607 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d41438e-53af-4e52-ac07-3105ca56e2b0 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:46.830237 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710cb6e-82b4-4163-a870-c2f7594c8652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:46.830859 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710cb6e-82b4-4163-a870-c2f7594c8652 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:46.831145 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710cb6e-82b4-4163-a870-c2f7594c8652 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:46.831838 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710cb6e-82b4-4163-a870-c2f7594c8652 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:46.834075 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:46.842258 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710cb6e-82b4-4163-a870-c2f7594c8652 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:46.845869 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:46.846977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-6710cb6e-82b4-4163-a870-c2f7594c8652 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:05:46.846977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:46.846977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:46.846977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:46.846977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:46.846977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:46.846977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:46.846977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:46.846977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:46.846977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:46.846977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:46.846977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:46.846977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:46.846977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:46.846977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:46.846977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:46.848144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:46.848144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:46.848144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:46.848144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:46.848144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:46.848144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:46.848144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:46.848144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:46.848144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:46.848144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:46.848144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:46.848144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:46.848144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:46.848144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:46.848144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:46.848144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:46.849231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:46.849231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:46.849231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:46.849231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:46.849231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:46.849231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:46.849231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:46.849231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:46.849231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:46.849231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:46.849231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:05:46.849231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:46.849231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 283/569] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 23 04:05:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:46.849231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710cb6e-82b4-4163-a870-c2f7594c8652 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:46.870398 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642dd1a0-5451-48ae-8a11-026f9420196f None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:46.903535 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea0654-e796-40d6-ad22-c8aaac12e04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:46.904147 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea0654-e796-40d6-ad22-c8aaac12e04c None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:46.904428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea0654-e796-40d6-ad22-c8aaac12e04c None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:46.904699 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea0654-e796-40d6-ad22-c8aaac12e04c None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:46.905391 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea0654-e796-40d6-ad22-c8aaac12e04c None admin] RBAC: Adding query filter params (name=service) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:46.905690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea0654-e796-40d6-ad22-c8aaac12e04c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:46.907101 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea0654-e796-40d6-ad22-c8aaac12e04c None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:46.915052 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 287/570] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 23 04:05:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:46.915965 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea0654-e796-40d6-ad22-c8aaac12e04c None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:46.958225 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710cb6e-82b4-4163-a870-c2f7594c8652 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:46.992440 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760994b4-b675-4793-b19c-1513e47f6198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:46.993048 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760994b4-b675-4793-b19c-1513e47f6198 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:46.993367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760994b4-b675-4793-b19c-1513e47f6198 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:46.993643 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760994b4-b675-4793-b19c-1513e47f6198 None admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:46.994384 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760994b4-b675-4793-b19c-1513e47f6198 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:46.994691 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760994b4-b675-4793-b19c-1513e47f6198 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:46.996127 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760994b4-b675-4793-b19c-1513e47f6198 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:47.013306 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 284/571] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Aug 23 04:05:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:47.014104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760994b4-b675-4793-b19c-1513e47f6198 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:47.019233 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea0654-e796-40d6-ad22-c8aaac12e04c None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:47.051472 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b189d0-fb96-46bf-add6-8dff8f08583f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:47.052099 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b189d0-fb96-46bf-add6-8dff8f08583f None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:47.052890 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b189d0-fb96-46bf-add6-8dff8f08583f None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:47.053193 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b189d0-fb96-46bf-add6-8dff8f08583f None admin] PATH_INFO: `/v3/roles/service` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:47.063286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b189d0-fb96-46bf-add6-8dff8f08583f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:47.068850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-02b189d0-fb96-46bf-add6-8dff8f08583f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:05:47.068850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:47.068850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:47.068850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:47.068850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:47.068850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:47.068850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:47.068850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:47.068850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:47.068850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:47.068850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:47.068850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:47.068850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:47.068850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:47.068850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:47.068850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:47.069865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:47.069865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:47.069865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:47.069865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:47.069865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:47.069865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:47.069865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:47.069865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:47.069865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:47.069865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:47.069865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:47.069865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:47.069865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:47.069865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:47.069865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:47.069865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:47.070713 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:47.070713 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:47.070713 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:47.070713 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:47.070713 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:47.070713 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:47.070713 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:47.070713 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:47.070713 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:47.070713 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:47.070713 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:05:47.070713 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:47.071380 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:47.071456 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 288/572] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 23 04:05:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:47.071456 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b189d0-fb96-46bf-add6-8dff8f08583f None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:47.073379 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:47.116246 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760994b4-b675-4793-b19c-1513e47f6198 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:47.149638 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3dd9e-d1da-45a0-8564-4a3cee5ed350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:47.150242 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3dd9e-d1da-45a0-8564-4a3cee5ed350 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:47.150527 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3dd9e-d1da-45a0-8564-4a3cee5ed350 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:47.150798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3dd9e-d1da-45a0-8564-4a3cee5ed350 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:47.151523 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3dd9e-d1da-45a0-8564-4a3cee5ed350 None admin] RBAC: Adding query filter params (role.id=e7c20cdfa0b64f71a716edf832519cbb, scope.project.id=a7ada12a1e3a42949c00f483efd522ba, user.id=63190c62bc92403880ffaedc4737485a) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:47.151834 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3dd9e-d1da-45a0-8564-4a3cee5ed350 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:47.153292 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3dd9e-d1da-45a0-8564-4a3cee5ed350 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:47.158536 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 285/573] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:05:47 2022] GET /identity/v3/role_assignments?user.id=63190c62bc92403880ffaedc4737485a&scope.project.id=a7ada12a1e3a42949c00f483efd522ba&role.id=e7c20cdfa0b64f71a716edf832519cbb => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:47.159247 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3dd9e-d1da-45a0-8564-4a3cee5ed350 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:47.170466 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b189d0-fb96-46bf-add6-8dff8f08583f None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:47.208182 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a97ba-e095-41ad-ad9b-21e3bd6def8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:47.208824 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a97ba-e095-41ad-ad9b-21e3bd6def8c None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:47.209138 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a97ba-e095-41ad-ad9b-21e3bd6def8c None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:47.209420 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a97ba-e095-41ad-ad9b-21e3bd6def8c None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:47.210120 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a97ba-e095-41ad-ad9b-21e3bd6def8c None admin] RBAC: Adding query filter params (name=service) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:47.210426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a97ba-e095-41ad-ad9b-21e3bd6def8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:47.211875 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a97ba-e095-41ad-ad9b-21e3bd6def8c None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:47.221114 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 289/574] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 23 04:05:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:47.222014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a97ba-e095-41ad-ad9b-21e3bd6def8c None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:47.289175 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3dd9e-d1da-45a0-8564-4a3cee5ed350 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:47.292746 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:47.315192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:47.331617 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a689594-7eba-45bf-a2ec-65bb46c21154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:47.332248 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a689594-7eba-45bf-a2ec-65bb46c21154 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:47.332525 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a689594-7eba-45bf-a2ec-65bb46c21154 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:47.332795 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a689594-7eba-45bf-a2ec-65bb46c21154 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:47.338220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a97ba-e095-41ad-ad9b-21e3bd6def8c None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:47.344427 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a689594-7eba-45bf-a2ec-65bb46c21154 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:47.345965 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a689594-7eba-45bf-a2ec-65bb46c21154 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:47.361977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-9a689594-7eba-45bf-a2ec-65bb46c21154 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:47.361977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:47.361977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:47.361977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:47.361977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:47.361977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:47.361977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:47.361977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:47.361977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:47.361977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:47.361977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:47.361977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:47.361977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:47.361977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:47.361977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:47.361977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:47.363137 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:47.363137 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:47.363137 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:47.363137 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:47.363137 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:47.363137 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:47.363137 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:47.363137 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:47.363137 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:47.363137 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:47.363137 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:47.363137 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:47.363137 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:47.363137 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:47.363137 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:47.363137 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:47.363137 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:47.369453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:47.369453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:47.369453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:47.369453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 286/575] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:47.369453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a689594-7eba-45bf-a2ec-65bb46c21154 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:47.383126 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af738b-693b-436a-a7e0-1168f509f36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:47.384083 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af738b-693b-436a-a7e0-1168f509f36a None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:47.384205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af738b-693b-436a-a7e0-1168f509f36a None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:47.384396 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af738b-693b-436a-a7e0-1168f509f36a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:47.395442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af738b-693b-436a-a7e0-1168f509f36a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:47.397132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af738b-693b-436a-a7e0-1168f509f36a None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:47.412561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-88af738b-693b-436a-a7e0-1168f509f36a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:47.412561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:47.412561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:47.412561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:47.412561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:47.412561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:47.412561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:47.412561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:47.412561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:47.412561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:47.412561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:47.412561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:47.412561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:47.412561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:47.412561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:47.412561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:47.413722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:47.413722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:47.413722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:47.413722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:47.413722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:47.413722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:47.413722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:47.413722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:47.413722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:47.413722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:47.413722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:47.413722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:47.413722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:47.413722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:47.413722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:47.413722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:47.413722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:47.414766 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:47.414766 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:47.414766 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:47.414766 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 290/576] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:47.418900 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af738b-693b-436a-a7e0-1168f509f36a None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:47.474874 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a689594-7eba-45bf-a2ec-65bb46c21154 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:47.509395 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749412f5-fb71-4af7-a58f-b8872ef3ef1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:47.510095 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749412f5-fb71-4af7-a58f-b8872ef3ef1f None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:47.510444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749412f5-fb71-4af7-a58f-b8872ef3ef1f None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:47.510785 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749412f5-fb71-4af7-a58f-b8872ef3ef1f None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:47.511521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749412f5-fb71-4af7-a58f-b8872ef3ef1f None admin] RBAC: Adding query filter params (name=service) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:47.511924 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749412f5-fb71-4af7-a58f-b8872ef3ef1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:47.513410 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749412f5-fb71-4af7-a58f-b8872ef3ef1f None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:47.525134 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 287/577] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 23 04:05:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:47.525134 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749412f5-fb71-4af7-a58f-b8872ef3ef1f None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:47.529519 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af738b-693b-436a-a7e0-1168f509f36a None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:47.547816 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:47.557888 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:47.567196 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ebb65-4643-4ca3-b8b1-0fdf9380dee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:47.567998 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ebb65-4643-4ca3-b8b1-0fdf9380dee2 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:47.568342 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ebb65-4643-4ca3-b8b1-0fdf9380dee2 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:47.568734 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ebb65-4643-4ca3-b8b1-0fdf9380dee2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:47.579457 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ebb65-4643-4ca3-b8b1-0fdf9380dee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:47.581007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ebb65-4643-4ca3-b8b1-0fdf9380dee2 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:47.597286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-0f7ebb65-4643-4ca3-b8b1-0fdf9380dee2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:47.597286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:47.597286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:47.597286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:47.597286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:47.597286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:47.597286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:47.597286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:47.597286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:47.597286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:47.597286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:47.597286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:47.597286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:47.597286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:47.597286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:47.597286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:47.598299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:47.598299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:47.598299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:47.598299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:47.598299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:47.598299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:47.598299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:47.598299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:47.598299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:47.598299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:47.598299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:47.598299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:47.598299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:47.598299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:47.598299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:47.598299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:47.598299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:47.599284 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:47.599284 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:47.599284 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:47.599284 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 291/578] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:47.599284 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ebb65-4643-4ca3-b8b1-0fdf9380dee2 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:47.632341 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749412f5-fb71-4af7-a58f-b8872ef3ef1f None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:47.668635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b79e53-87fe-41a9-a112-2101896800f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:47.669202 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b79e53-87fe-41a9-a112-2101896800f2 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:47.669496 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b79e53-87fe-41a9-a112-2101896800f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:47.669768 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b79e53-87fe-41a9-a112-2101896800f2 None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:47.670415 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b79e53-87fe-41a9-a112-2101896800f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:47.670723 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b79e53-87fe-41a9-a112-2101896800f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:47.672135 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b79e53-87fe-41a9-a112-2101896800f2 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:47.689149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 288/579] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:47.689149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b79e53-87fe-41a9-a112-2101896800f2 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:47.717526 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ebb65-4643-4ca3-b8b1-0fdf9380dee2 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:47.765548 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cf11b-5a8d-4193-ac79-0786d91031c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:47.766170 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cf11b-5a8d-4193-ac79-0786d91031c2 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:47.766448 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cf11b-5a8d-4193-ac79-0786d91031c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:47.766725 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cf11b-5a8d-4193-ac79-0786d91031c2 None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:47.767746 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3cf11b-5a8d-4193-ac79-0786d91031c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:47.768051 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3cf11b-5a8d-4193-ac79-0786d91031c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:47.769820 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3cf11b-5a8d-4193-ac79-0786d91031c2 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:47.783655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 292/580] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:47.783947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:47.784661 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cf11b-5a8d-4193-ac79-0786d91031c2 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:47.797180 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b79e53-87fe-41a9-a112-2101896800f2 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:47.815722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:47.832962 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd757cc0-4afc-49a8-8c50-2a586c871f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:47.834174 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd757cc0-4afc-49a8-8c50-2a586c871f1f None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:47.834455 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd757cc0-4afc-49a8-8c50-2a586c871f1f None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:47.834727 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd757cc0-4afc-49a8-8c50-2a586c871f1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:47.844606 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd757cc0-4afc-49a8-8c50-2a586c871f1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:47.846079 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd757cc0-4afc-49a8-8c50-2a586c871f1f None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:47.860678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-fd757cc0-4afc-49a8-8c50-2a586c871f1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:47.860678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:47.860678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:47.860678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:47.860678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:47.860678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:47.860678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:47.860678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:47.860678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:47.860678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:47.860678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:47.860678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:47.860678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:47.860678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:47.860678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:47.860678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:47.866356 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:47.866356 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:47.866356 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:47.866356 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:47.866356 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:47.866356 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:47.866356 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:47.866356 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:47.866356 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:47.866356 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:47.866356 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:47.866356 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:47.866356 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:47.866356 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:47.866356 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:47.866356 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:47.866356 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:47.867573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:47.867573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:47.867573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:47.867573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 289/581] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:47.867573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd757cc0-4afc-49a8-8c50-2a586c871f1f None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:47.932726 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cf11b-5a8d-4193-ac79-0786d91031c2 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:47.972876 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd757cc0-4afc-49a8-8c50-2a586c871f1f None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:47.978107 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f1e72-6693-4c3a-8765-bc54cd96c7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:47.978713 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f1e72-6693-4c3a-8765-bc54cd96c7c6 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:47.978992 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f1e72-6693-4c3a-8765-bc54cd96c7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:47.979262 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f1e72-6693-4c3a-8765-bc54cd96c7c6 None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:47.980016 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f1e72-6693-4c3a-8765-bc54cd96c7c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:47.980318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f1e72-6693-4c3a-8765-bc54cd96c7c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:47.981825 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f1e72-6693-4c3a-8765-bc54cd96c7c6 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:47.993585 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 293/582] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:47.994396 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f1e72-6693-4c3a-8765-bc54cd96c7c6 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:48.012838 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfce87-2447-49c2-b0dc-0a06073df466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:48.013748 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfce87-2447-49c2-b0dc-0a06073df466 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:48.014217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfce87-2447-49c2-b0dc-0a06073df466 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:48.014705 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfce87-2447-49c2-b0dc-0a06073df466 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:48.023322 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cfce87-2447-49c2-b0dc-0a06073df466 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:48.024761 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cfce87-2447-49c2-b0dc-0a06073df466 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:48.035802 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-19cfce87-2447-49c2-b0dc-0a06073df466 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 04:05:48.035802 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:48.035802 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:48.035802 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:48.035802 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:48.035802 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:48.035802 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:48.035802 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:48.035802 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:48.035802 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:48.035802 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:48.035802 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:48.035802 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:05:48.035802 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:05:48.035802 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:05:48.035802 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:05:48.036784 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:48.036784 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:48.036784 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:05:48.036784 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:05:48.036784 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:05:48.036784 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:05:48.036784 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:48.036784 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:48.036784 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:48.036784 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:48.036784 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:48.036784 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:48.036784 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:48.036784 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:48.036784 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:48.036784 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:48.036784 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:48.036784 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:48.038367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:48.038367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:48.038367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:05:48.038367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:05:48.038367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:05:48.038367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:05:48.038367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:05:48.038367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:05:48.038367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 04:05:48.038367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:48.038367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 290/583] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:05:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:48.038367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfce87-2447-49c2-b0dc-0a06073df466 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:48.043610 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:48.095530 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:48.107686 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f1e72-6693-4c3a-8765-bc54cd96c7c6 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:48.144163 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e7bcb-68f2-44d8-92cb-8aecf76d0b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:48.144804 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e7bcb-68f2-44d8-92cb-8aecf76d0b5c None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:48.145108 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e7bcb-68f2-44d8-92cb-8aecf76d0b5c None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:48.145395 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e7bcb-68f2-44d8-92cb-8aecf76d0b5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:48.149506 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfce87-2447-49c2-b0dc-0a06073df466 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:48.153664 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e7bcb-68f2-44d8-92cb-8aecf76d0b5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:48.155120 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e7bcb-68f2-44d8-92cb-8aecf76d0b5c None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:48.166734 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-d54e7bcb-68f2-44d8-92cb-8aecf76d0b5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:05:48.166734 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:48.166734 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:48.166734 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:48.166734 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:48.166734 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:48.166734 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:48.166734 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:48.166734 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:48.166734 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:48.166734 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:48.166734 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:48.166734 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:05:48.166734 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:05:48.166734 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:05:48.167648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:05:48.167648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:48.167648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:48.167648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:48.167648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:48.167648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:48.167648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:48.167648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:48.167648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:48.167648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:48.167648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:48.167648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:48.167648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:48.167648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:48.167648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:48.167648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:48.167648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:48.168552 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:05:48.168552 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:05:48.168552 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:05:48.168552 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:05:48.168552 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:05:48.168552 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:05:48.168552 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:05:48.168552 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:48.168552 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 294/584] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:05:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:48.169512 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e7bcb-68f2-44d8-92cb-8aecf76d0b5c None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:48.195282 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57104a-f1dd-4f7c-bf13-0f73cdc4c85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:48.195799 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57104a-f1dd-4f7c-bf13-0f73cdc4c85c None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:48.196089 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57104a-f1dd-4f7c-bf13-0f73cdc4c85c None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:48.196358 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57104a-f1dd-4f7c-bf13-0f73cdc4c85c None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:48.197004 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57104a-f1dd-4f7c-bf13-0f73cdc4c85c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:48.197346 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57104a-f1dd-4f7c-bf13-0f73cdc4c85c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:48.198715 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57104a-f1dd-4f7c-bf13-0f73cdc4c85c None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:48.215793 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 291/585] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:48.215793 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57104a-f1dd-4f7c-bf13-0f73cdc4c85c None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:48.280444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:48.284106 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e7bcb-68f2-44d8-92cb-8aecf76d0b5c None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:48.321766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57104a-f1dd-4f7c-bf13-0f73cdc4c85c None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:48.324741 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b099de1-e213-4a4e-86a2-e9d1ee74b630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:48.324741 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b099de1-e213-4a4e-86a2-e9d1ee74b630 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:48.325032 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b099de1-e213-4a4e-86a2-e9d1ee74b630 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:48.325342 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b099de1-e213-4a4e-86a2-e9d1ee74b630 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:48.332933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b099de1-e213-4a4e-86a2-e9d1ee74b630 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:48.334434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b099de1-e213-4a4e-86a2-e9d1ee74b630 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:48.345271 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-9b099de1-e213-4a4e-86a2-e9d1ee74b630 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 04:05:48.345271 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:48.345271 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:48.345271 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:48.345271 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:48.345271 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:48.345271 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:48.345271 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:48.345271 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:48.345271 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:48.345271 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:48.345271 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:48.345271 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:05:48.345271 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:05:48.345271 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:05:48.345271 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:05:48.346205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:48.346205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:48.346205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:05:48.346205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:05:48.346205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:05:48.346205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:05:48.346205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:48.346205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:48.346205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:48.346205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:48.346205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:48.346205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:48.346205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:48.346205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:48.346205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:48.346205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:48.346205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:48.346205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:48.347162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:48.347162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:48.347162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:05:48.347162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:05:48.347162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:05:48.347162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:05:48.347162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:05:48.347162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:05:48.347162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 04:05:48.347162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:48.347162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 295/586] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:05:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:48.347162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b099de1-e213-4a4e-86a2-e9d1ee74b630 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:48.359241 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:48.364029 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db5ed3-6e2c-41f7-a7d8-28f42f5a9ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:48.365175 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db5ed3-6e2c-41f7-a7d8-28f42f5a9ee3 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:48.365526 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db5ed3-6e2c-41f7-a7d8-28f42f5a9ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:48.365826 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db5ed3-6e2c-41f7-a7d8-28f42f5a9ee3 None admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:48.366546 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db5ed3-6e2c-41f7-a7d8-28f42f5a9ee3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:48.373434 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db5ed3-6e2c-41f7-a7d8-28f42f5a9ee3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:48.373434 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db5ed3-6e2c-41f7-a7d8-28f42f5a9ee3 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:48.390837 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 292/587] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Aug 23 04:05:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:48.390837 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db5ed3-6e2c-41f7-a7d8-28f42f5a9ee3 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:48.451770 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b099de1-e213-4a4e-86a2-e9d1ee74b630 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:48.486786 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c979fa-f252-4609-bb62-b38f0322ca46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:48.487402 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c979fa-f252-4609-bb62-b38f0322ca46 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:48.487686 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c979fa-f252-4609-bb62-b38f0322ca46 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:48.487956 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c979fa-f252-4609-bb62-b38f0322ca46 None admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:48.488654 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c979fa-f252-4609-bb62-b38f0322ca46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:48.488960 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c979fa-f252-4609-bb62-b38f0322ca46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:48.490551 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c979fa-f252-4609-bb62-b38f0322ca46 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:48.497500 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db5ed3-6e2c-41f7-a7d8-28f42f5a9ee3 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:48.508183 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 296/588] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:05:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:48.508183 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c979fa-f252-4609-bb62-b38f0322ca46 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:48.521798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:48.534336 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e792e47-0fca-4a79-a323-9cc919c981c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:48.534962 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e792e47-0fca-4a79-a323-9cc919c981c2 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:48.535246 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e792e47-0fca-4a79-a323-9cc919c981c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:48.535518 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e792e47-0fca-4a79-a323-9cc919c981c2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:48.544225 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e792e47-0fca-4a79-a323-9cc919c981c2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:48.546149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e792e47-0fca-4a79-a323-9cc919c981c2 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:48.558340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-5e792e47-0fca-4a79-a323-9cc919c981c2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 04:05:48.558340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:48.558340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:48.558340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:48.558340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:48.558340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:48.558340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:48.558340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:48.558340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:48.558340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:48.558340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:48.558340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:48.558340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:05:48.558340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:05:48.558340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:05:48.558340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:05:48.559385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:48.559385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:48.559385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:05:48.559385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:05:48.559385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:05:48.559385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:05:48.559385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:48.559385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:48.559385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:48.559385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:48.559385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:48.559385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:48.559385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:48.559385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:48.559385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:48.559385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:48.559385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:48.559385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:48.560406 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:48.560406 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:48.560406 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:05:48.560406 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:05:48.560406 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:05:48.560406 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:05:48.560406 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:05:48.560406 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:05:48.560406 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 04:05:48.560406 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:48.560406 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 293/589] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 23 04:05:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:48.560406 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e792e47-0fca-4a79-a323-9cc919c981c2 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:48.588585 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:48.622520 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c979fa-f252-4609-bb62-b38f0322ca46 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:48.657194 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717536f5-70ca-4dfc-af26-26a4009d6149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:48.657810 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717536f5-70ca-4dfc-af26-26a4009d6149 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:48.658088 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717536f5-70ca-4dfc-af26-26a4009d6149 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:48.658360 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717536f5-70ca-4dfc-af26-26a4009d6149 None admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:48.659091 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717536f5-70ca-4dfc-af26-26a4009d6149 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:48.659392 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717536f5-70ca-4dfc-af26-26a4009d6149 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:48.660829 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717536f5-70ca-4dfc-af26-26a4009d6149 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:48.669497 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e792e47-0fca-4a79-a323-9cc919c981c2 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:48.682875 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 297/590] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Aug 23 04:05:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:48.682875 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717536f5-70ca-4dfc-af26-26a4009d6149 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:48.711305 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2670e-0fa5-4074-8fa2-7f13d3b4be91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:48.711987 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2670e-0fa5-4074-8fa2-7f13d3b4be91 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:48.712275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2670e-0fa5-4074-8fa2-7f13d3b4be91 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:48.712553 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2670e-0fa5-4074-8fa2-7f13d3b4be91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:48.724611 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2670e-0fa5-4074-8fa2-7f13d3b4be91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:48.726108 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2670e-0fa5-4074-8fa2-7f13d3b4be91 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:48.741395 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-bbe2670e-0fa5-4074-8fa2-7f13d3b4be91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:48.741395 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:48.741395 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:48.741395 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:48.741395 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:48.741395 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:48.741395 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:48.741395 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:48.741395 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:48.741395 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:48.741395 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:48.741395 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:48.741395 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:48.741395 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:48.741395 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:48.741395 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:48.742367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:48.742367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:48.742367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:48.742367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:48.742367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:48.742367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:48.742367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:48.742367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:48.742367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:48.742367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:48.742367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:48.742367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:48.742367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:48.742367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:48.742367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:48.742367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:48.742367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:48.743272 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:48.743272 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:48.743272 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:48.743272 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 294/591] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:48.743498 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2670e-0fa5-4074-8fa2-7f13d3b4be91 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:48.781603 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:48.786841 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717536f5-70ca-4dfc-af26-26a4009d6149 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:48.813186 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:48.822517 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27aa89-36b3-4f5a-bfc1-c5596a2db9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:48.823185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27aa89-36b3-4f5a-bfc1-c5596a2db9bb None admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:48.823467 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27aa89-36b3-4f5a-bfc1-c5596a2db9bb None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:48.823733 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27aa89-36b3-4f5a-bfc1-c5596a2db9bb None admin] PATH_INFO: `/v3/projects/a7ada12a1e3a42949c00f483efd522ba/users/1e0236a0acac4b87be977878b5186551/roles/e7c20cdfa0b64f71a716edf832519cbb` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:48.838813 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27aa89-36b3-4f5a-bfc1-c5596a2db9bb None admin] RBAC: Authorizing `identity:create_grant(project_id=a7ada12a1e3a42949c00f483efd522ba, user_id=1e0236a0acac4b87be977878b5186551, role_id=e7c20cdfa0b64f71a716edf832519cbb)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:48.840261 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27aa89-36b3-4f5a-bfc1-c5596a2db9bb None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:48.855425 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2670e-0fa5-4074-8fa2-7f13d3b4be91 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:48.888735 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f48e6e-e562-4426-a296-fd0ad927719c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:48.889382 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f48e6e-e562-4426-a296-fd0ad927719c None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:48.889671 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f48e6e-e562-4426-a296-fd0ad927719c None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:48.889951 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f48e6e-e562-4426-a296-fd0ad927719c None admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:48.890681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f48e6e-e562-4426-a296-fd0ad927719c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:48.890998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f48e6e-e562-4426-a296-fd0ad927719c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:48.892456 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f48e6e-e562-4426-a296-fd0ad927719c None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:48.914789 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 298/592] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 23 04:05:48 2022] PUT /identity/v3/projects/a7ada12a1e3a42949c00f483efd522ba/users/1e0236a0acac4b87be977878b5186551/roles/e7c20cdfa0b64f71a716edf832519cbb => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:05:48.914789 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27aa89-36b3-4f5a-bfc1-c5596a2db9bb None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:48.915114 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 295/593] 10.222.0.42 () {56 vars in 1139 bytes} [Tue Aug 23 04:05:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:48.915114 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f48e6e-e562-4426-a296-fd0ad927719c None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:49.023809 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:49.032908 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f48e6e-e562-4426-a296-fd0ad927719c None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:49.072075 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27aa89-36b3-4f5a-bfc1-c5596a2db9bb None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:49.072560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426ac51-bba5-4205-874f-01e75bb0072e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:49.073213 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426ac51-bba5-4205-874f-01e75bb0072e None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:49.073498 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426ac51-bba5-4205-874f-01e75bb0072e None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:49.073774 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426ac51-bba5-4205-874f-01e75bb0072e None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:49.074430 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426ac51-bba5-4205-874f-01e75bb0072e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:49.074732 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426ac51-bba5-4205-874f-01e75bb0072e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:49.076185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426ac51-bba5-4205-874f-01e75bb0072e None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:49.089140 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 296/594] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:49.090415 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426ac51-bba5-4205-874f-01e75bb0072e None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:49.115627 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7e1da-2a06-47c6-ac2f-8343cb1157a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:49.116704 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7e1da-2a06-47c6-ac2f-8343cb1157a3 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:49.116987 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7e1da-2a06-47c6-ac2f-8343cb1157a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:49.117495 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7e1da-2a06-47c6-ac2f-8343cb1157a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:49.132105 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7e1da-2a06-47c6-ac2f-8343cb1157a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:49.133590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7e1da-2a06-47c6-ac2f-8343cb1157a3 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:49.153677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-d8e7e1da-2a06-47c6-ac2f-8343cb1157a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:49.153677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:49.153677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:49.153677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:49.153677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:49.153677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:49.153677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:49.153677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:49.153677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:49.153677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:49.153677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:49.153677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:49.153677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:49.153677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:49.153677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:49.153677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:49.154689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:49.154689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:49.154689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:49.154689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:49.154689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:49.154689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:49.154689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:49.154689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:49.154689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:49.154689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:49.154689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:49.154689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:49.154689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:49.154689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:49.154689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:49.154689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:49.154689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:49.155593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:49.155593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:49.155593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:49.155593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 299/595] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:49.156527 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c425dec-6e4e-4d41-a7ed-2d8548c86476 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:49.156527 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c425dec-6e4e-4d41-a7ed-2d8548c86476 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:49.156703 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c425dec-6e4e-4d41-a7ed-2d8548c86476 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:49.158188 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 300/596] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:49.158892 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c425dec-6e4e-4d41-a7ed-2d8548c86476 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:49.190529 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:49.202806 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426ac51-bba5-4205-874f-01e75bb0072e None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:49.239308 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e96457-aba4-4e31-be7b-1acbb3db8f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:49.240476 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e96457-aba4-4e31-be7b-1acbb3db8f4b None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:49.240759 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e96457-aba4-4e31-be7b-1acbb3db8f4b None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:49.241030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e96457-aba4-4e31-be7b-1acbb3db8f4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:49.252155 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e96457-aba4-4e31-be7b-1acbb3db8f4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:49.253633 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e96457-aba4-4e31-be7b-1acbb3db8f4b None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:49.268427 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-80e96457-aba4-4e31-be7b-1acbb3db8f4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:49.268427 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:49.268427 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:49.268427 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:49.268427 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:49.268427 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:49.268427 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:49.268427 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:49.268427 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:49.268427 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:49.268427 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:49.268427 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:49.268427 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:49.268427 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:49.268427 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:49.268427 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:49.269479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:49.269479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:49.269479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:49.269479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:49.269479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:49.269479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:49.269479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:49.269479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:49.269479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:49.269479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:49.269479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:49.269479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:49.269479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:49.269479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:49.269479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:49.269479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:49.269479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:49.270383 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:49.270383 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:49.270383 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:49.270383 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 297/597] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:49.270383 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e96457-aba4-4e31-be7b-1acbb3db8f4b None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:49.279858 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:49.280902 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c425dec-6e4e-4d41-a7ed-2d8548c86476 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:49.318832 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1380b72-792c-45d3-a5fc-d760f0cea821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:49.319893 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1380b72-792c-45d3-a5fc-d760f0cea821 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:49.320241 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1380b72-792c-45d3-a5fc-d760f0cea821 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:49.320513 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1380b72-792c-45d3-a5fc-d760f0cea821 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:49.327185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1380b72-792c-45d3-a5fc-d760f0cea821 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:49.328662 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1380b72-792c-45d3-a5fc-d760f0cea821 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:49.340434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-c1380b72-792c-45d3-a5fc-d760f0cea821 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:05:49.340434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:49.340434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:49.340434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:49.340434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:49.340434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:49.340434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:49.340434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:49.340434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:49.340434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:49.340434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:49.340434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:49.340434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:05:49.340434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:05:49.340434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:05:49.341378 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:05:49.341378 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:49.341378 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:49.341378 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:49.341378 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:49.341378 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:49.341378 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:49.341378 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:49.341378 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:49.341378 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:49.341378 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:49.341378 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:49.341378 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:49.341378 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:49.341378 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:49.341378 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:49.341378 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:49.342358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:05:49.342358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:05:49.342358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:05:49.342358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:05:49.342358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:05:49.342358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:05:49.342358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:05:49.342358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:49.346284 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 301/598] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:05:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:49.347300 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a360795-c3c7-4cd9-af39-8bd01f330a5d None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:49.347584 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a360795-c3c7-4cd9-af39-8bd01f330a5d None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:49.347859 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a360795-c3c7-4cd9-af39-8bd01f330a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:49.365647 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-9a360795-c3c7-4cd9-af39-8bd01f330a5d None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:49.366830 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-9a360795-c3c7-4cd9-af39-8bd01f330a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:49.376658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e96457-aba4-4e31-be7b-1acbb3db8f4b None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:49.414307 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d649e-1b20-4de0-b645-2de55c5559a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:49.414924 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d649e-1b20-4de0-b645-2de55c5559a6 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:49.415199 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d649e-1b20-4de0-b645-2de55c5559a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:49.415482 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d649e-1b20-4de0-b645-2de55c5559a6 None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:49.416139 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d649e-1b20-4de0-b645-2de55c5559a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:49.416429 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d649e-1b20-4de0-b645-2de55c5559a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:49.417826 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d649e-1b20-4de0-b645-2de55c5559a6 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:49.431344 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 298/599] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:49.432173 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d649e-1b20-4de0-b645-2de55c5559a6 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:49.439869 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 302/600] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:49.441023 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a360795-c3c7-4cd9-af39-8bd01f330a5d None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:49.461009 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:49.514604 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:49.553620 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d649e-1b20-4de0-b645-2de55c5559a6 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:49.558477 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a360795-c3c7-4cd9-af39-8bd01f330a5d None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:49.591327 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf558b0-7e38-4e18-a71f-fe62ad05482e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:49.592593 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf558b0-7e38-4e18-a71f-fe62ad05482e None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:49.593347 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf558b0-7e38-4e18-a71f-fe62ad05482e None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:49.593771 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf558b0-7e38-4e18-a71f-fe62ad05482e None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:49.594806 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf558b0-7e38-4e18-a71f-fe62ad05482e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:49.595255 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf558b0-7e38-4e18-a71f-fe62ad05482e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:49.597398 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf558b0-7e38-4e18-a71f-fe62ad05482e None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:49.601052 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef0c1d-f4b4-42ae-bb95-21de017ceb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:49.601805 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef0c1d-f4b4-42ae-bb95-21de017ceb76 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:49.602185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef0c1d-f4b4-42ae-bb95-21de017ceb76 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:49.602557 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef0c1d-f4b4-42ae-bb95-21de017ceb76 None admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:49.603357 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef0c1d-f4b4-42ae-bb95-21de017ceb76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:49.603765 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef0c1d-f4b4-42ae-bb95-21de017ceb76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:49.605780 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef0c1d-f4b4-42ae-bb95-21de017ceb76 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:49.611212 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 299/601] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:49.612235 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf558b0-7e38-4e18-a71f-fe62ad05482e None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:49.629760 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 303/602] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:05:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:49.631269 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef0c1d-f4b4-42ae-bb95-21de017ceb76 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:49.724805 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:49.745944 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf558b0-7e38-4e18-a71f-fe62ad05482e None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:49.746327 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef0c1d-f4b4-42ae-bb95-21de017ceb76 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:49.772538 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:49.784059 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db4e3f-1025-4297-a814-e33c1c61c436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:49.784354 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fd9b6-c37c-451c-b385-3d44a609b639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:49.784739 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db4e3f-1025-4297-a814-e33c1c61c436 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:49.784970 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fd9b6-c37c-451c-b385-3d44a609b639 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:49.785069 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db4e3f-1025-4297-a814-e33c1c61c436 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:49.785281 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fd9b6-c37c-451c-b385-3d44a609b639 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:49.785392 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db4e3f-1025-4297-a814-e33c1c61c436 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:49.785558 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fd9b6-c37c-451c-b385-3d44a609b639 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:49.792138 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db4e3f-1025-4297-a814-e33c1c61c436 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:49.792272 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181fd9b6-c37c-451c-b385-3d44a609b639 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:49.793642 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db4e3f-1025-4297-a814-e33c1c61c436 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:49.793759 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181fd9b6-c37c-451c-b385-3d44a609b639 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:49.805920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-181fd9b6-c37c-451c-b385-3d44a609b639 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:05:49.805920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:49.805920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:49.805920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:49.805920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:49.805920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:49.805920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:49.805920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:49.805920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:49.805920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:49.805920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:49.805920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:49.805920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:05:49.805920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:05:49.805920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:05:49.806823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:05:49.806823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:49.806823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:49.806823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:49.806823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:49.806823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:49.806823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:49.806823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:49.806823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:49.806823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:49.806823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:49.806823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:49.806823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:49.806823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:49.806823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:49.806823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:49.806823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:49.808388 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:05:49.808388 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:05:49.808388 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:05:49.808388 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:05:49.808388 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:05:49.808388 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:05:49.808388 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:05:49.808388 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:49.808388 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 304/603] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:05:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:49.808388 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fd9b6-c37c-451c-b385-3d44a609b639 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:49.809385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-a7db4e3f-1025-4297-a814-e33c1c61c436 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:05:49.809385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:49.809385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:49.809385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:49.809385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:49.809385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:49.809385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:49.809385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:49.809385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:49.809385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:49.809385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:49.809385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:49.809385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:05:49.809385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:05:49.809385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:05:49.810393 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:05:49.810393 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:49.810393 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:49.810393 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:49.810393 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:49.810393 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:49.810393 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:49.810393 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:49.810393 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:49.810393 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:49.810393 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:49.810393 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:49.810393 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:49.810393 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:49.810393 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:49.810393 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:49.810393 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:49.811611 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:05:49.811611 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:05:49.811611 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:05:49.811611 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:05:49.811611 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:05:49.811611 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:05:49.811611 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:05:49.811611 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:49.813794 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 300/604] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:05:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:49.815223 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db4e3f-1025-4297-a814-e33c1c61c436 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:49.921127 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fd9b6-c37c-451c-b385-3d44a609b639 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:49.922815 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db4e3f-1025-4297-a814-e33c1c61c436 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:49.962993 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7decd8-c760-46e2-992e-7bd1dacfd1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:49.963679 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7decd8-c760-46e2-992e-7bd1dacfd1ba None admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:49.963962 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7decd8-c760-46e2-992e-7bd1dacfd1ba None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:49.964235 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7decd8-c760-46e2-992e-7bd1dacfd1ba None admin] PATH_INFO: `/v3/projects/a7ada12a1e3a42949c00f483efd522ba/users/a0b0ac2dd135450c9bfe918f98c19425/roles/e7c20cdfa0b64f71a716edf832519cbb` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:49.965970 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375923ba-4a1c-4864-837a-bba9de92e5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:49.966770 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375923ba-4a1c-4864-837a-bba9de92e5ad None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:49.967254 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375923ba-4a1c-4864-837a-bba9de92e5ad None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:49.967707 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375923ba-4a1c-4864-837a-bba9de92e5ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:49.973401 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:49.978745 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375923ba-4a1c-4864-837a-bba9de92e5ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:49.980141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7decd8-c760-46e2-992e-7bd1dacfd1ba None admin] RBAC: Authorizing `identity:create_grant(project_id=a7ada12a1e3a42949c00f483efd522ba, user_id=a0b0ac2dd135450c9bfe918f98c19425, role_id=e7c20cdfa0b64f71a716edf832519cbb)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:49.981714 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7decd8-c760-46e2-992e-7bd1dacfd1ba None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:49.984712 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-375923ba-4a1c-4864-837a-bba9de92e5ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:05:49.984712 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:49.984712 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:49.984712 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:49.984712 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:49.984712 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:49.984712 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:49.984712 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:49.984712 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:49.984712 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:49.984712 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:49.984712 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:49.984712 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:49.984712 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:49.984712 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:49.984712 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:49.986110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:49.986110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:49.986110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:49.986110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:49.986110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:49.986110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:49.986110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:49.986110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:49.986110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:49.986110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:49.986110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:49.986110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:49.986110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:49.986110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:49.986110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:49.986110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:49.987009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:49.987009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:49.987009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:49.987009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:49.987009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:49.987009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:49.987009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:49.987009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:49.987009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:49.987009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:49.987009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:05:49.987009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:49.987009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 301/605] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 23 04:05:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:49.987009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375923ba-4a1c-4864-837a-bba9de92e5ad None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:50.035065 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:50.060343 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 305/606] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 23 04:05:49 2022] PUT /identity/v3/projects/a7ada12a1e3a42949c00f483efd522ba/users/a0b0ac2dd135450c9bfe918f98c19425/roles/e7c20cdfa0b64f71a716edf832519cbb => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:05:50.061120 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7decd8-c760-46e2-992e-7bd1dacfd1ba None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:50.110059 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375923ba-4a1c-4864-837a-bba9de92e5ad None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:50.160998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4afda-34aa-4814-8bab-43fd63abe3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:50.162398 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4afda-34aa-4814-8bab-43fd63abe3a7 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:50.162749 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4afda-34aa-4814-8bab-43fd63abe3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:50.162969 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4afda-34aa-4814-8bab-43fd63abe3a7 None admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:50.164159 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4afda-34aa-4814-8bab-43fd63abe3a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:50.164474 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4afda-34aa-4814-8bab-43fd63abe3a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:50.166256 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4afda-34aa-4814-8bab-43fd63abe3a7 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:50.188794 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 302/607] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:05:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:50.189729 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4afda-34aa-4814-8bab-43fd63abe3a7 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:50.215548 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7decd8-c760-46e2-992e-7bd1dacfd1ba None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:50.259933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e3673-9af7-41cc-a420-1f96fdf1cba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:50.261435 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e3673-9af7-41cc-a420-1f96fdf1cba5 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:50.262070 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e3673-9af7-41cc-a420-1f96fdf1cba5 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:50.262740 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e3673-9af7-41cc-a420-1f96fdf1cba5 None admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:50.263784 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e3673-9af7-41cc-a420-1f96fdf1cba5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:50.264269 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e3673-9af7-41cc-a420-1f96fdf1cba5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:50.266570 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e3673-9af7-41cc-a420-1f96fdf1cba5 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:50.282363 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 306/608] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:05:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:50.283953 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e3673-9af7-41cc-a420-1f96fdf1cba5 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:50.310467 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4afda-34aa-4814-8bab-43fd63abe3a7 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:50.325492 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:50.351201 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:50.364675 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8dc3fa-c5a2-4a71-9e42-12459bc4b20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:50.365856 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dc3fa-c5a2-4a71-9e42-12459bc4b20e None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:50.366645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dc3fa-c5a2-4a71-9e42-12459bc4b20e None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:50.367359 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dc3fa-c5a2-4a71-9e42-12459bc4b20e None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:50.368205 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8dc3fa-c5a2-4a71-9e42-12459bc4b20e None admin] RBAC: Adding query filter params (name=service) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:50.373366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8dc3fa-c5a2-4a71-9e42-12459bc4b20e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:50.373366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8dc3fa-c5a2-4a71-9e42-12459bc4b20e None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:50.381866 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 303/609] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 23 04:05:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:50.382812 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8dc3fa-c5a2-4a71-9e42-12459bc4b20e None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:50.418897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e3673-9af7-41cc-a420-1f96fdf1cba5 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:50.466087 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6f31d-9a34-4f71-a0de-4b5df4ca16ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:50.466756 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6f31d-9a34-4f71-a0de-4b5df4ca16ac None admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:50.467035 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6f31d-9a34-4f71-a0de-4b5df4ca16ac None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:50.467309 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6f31d-9a34-4f71-a0de-4b5df4ca16ac None admin] PATH_INFO: `/v3/projects/a7ada12a1e3a42949c00f483efd522ba/users/8304ca06f82742ef8ce74396884e90b4/roles/e7c20cdfa0b64f71a716edf832519cbb` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:50.486102 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6f31d-9a34-4f71-a0de-4b5df4ca16ac None admin] RBAC: Authorizing `identity:create_grant(project_id=a7ada12a1e3a42949c00f483efd522ba, user_id=8304ca06f82742ef8ce74396884e90b4, role_id=e7c20cdfa0b64f71a716edf832519cbb)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:50.487920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6f31d-9a34-4f71-a0de-4b5df4ca16ac None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:50.508823 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8dc3fa-c5a2-4a71-9e42-12459bc4b20e None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:50.544751 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54374c1d-deed-4832-b36a-f4d009e3a744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:50.545444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54374c1d-deed-4832-b36a-f4d009e3a744 None admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:50.545727 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54374c1d-deed-4832-b36a-f4d009e3a744 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:50.546001 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54374c1d-deed-4832-b36a-f4d009e3a744 None admin] PATH_INFO: `/v3/projects/a7ada12a1e3a42949c00f483efd522ba/users/020af86302e447a6b3973df4abbabafa/roles/e7c20cdfa0b64f71a716edf832519cbb` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:50.563819 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54374c1d-deed-4832-b36a-f4d009e3a744 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7ada12a1e3a42949c00f483efd522ba, user_id=020af86302e447a6b3973df4abbabafa, role_id=e7c20cdfa0b64f71a716edf832519cbb)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:50.565183 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54374c1d-deed-4832-b36a-f4d009e3a744 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:50.569744 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 307/610] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 23 04:05:50 2022] PUT /identity/v3/projects/a7ada12a1e3a42949c00f483efd522ba/users/8304ca06f82742ef8ce74396884e90b4/roles/e7c20cdfa0b64f71a716edf832519cbb => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:05:50.570784 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6f31d-9a34-4f71-a0de-4b5df4ca16ac None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:50.648872 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 304/611] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 23 04:05:50 2022] PUT /identity/v3/projects/a7ada12a1e3a42949c00f483efd522ba/users/020af86302e447a6b3973df4abbabafa/roles/e7c20cdfa0b64f71a716edf832519cbb => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:05:50.703982 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:50.708293 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6f31d-9a34-4f71-a0de-4b5df4ca16ac None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:50.748398 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288cb7a9-eaed-4ba3-8d7d-6389d2a29f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:50.749072 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cb7a9-eaed-4ba3-8d7d-6389d2a29f89 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:50.749412 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cb7a9-eaed-4ba3-8d7d-6389d2a29f89 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:50.749688 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cb7a9-eaed-4ba3-8d7d-6389d2a29f89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:50.762932 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288cb7a9-eaed-4ba3-8d7d-6389d2a29f89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:50.764496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288cb7a9-eaed-4ba3-8d7d-6389d2a29f89 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:50.781286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-288cb7a9-eaed-4ba3-8d7d-6389d2a29f89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:50.781286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:50.781286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:50.781286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:50.781286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:50.781286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:50.781286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:50.781286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:50.781286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:50.781286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:50.781286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:50.781286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:50.781286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:50.781286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:50.781286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:50.781286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:50.782504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:50.782504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:50.782504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:50.782504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:50.782504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:50.782504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:50.782504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:50.782504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:50.782504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:50.782504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:50.782504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:50.782504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:50.782504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:50.782504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:50.782504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:50.782504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:50.782504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:50.783607 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:50.783607 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:50.783607 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:50.785912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 308/612] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:50.791665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54374c1d-deed-4832-b36a-f4d009e3a744 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:50.813026 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:50.916741 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54374c1d-deed-4832-b36a-f4d009e3a744 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:50.957780 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba6944-4494-4e11-b23d-1dbc08d76f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:50.959006 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba6944-4494-4e11-b23d-1dbc08d76f31 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:50.959294 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba6944-4494-4e11-b23d-1dbc08d76f31 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:50.959569 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba6944-4494-4e11-b23d-1dbc08d76f31 None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:50.960224 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba6944-4494-4e11-b23d-1dbc08d76f31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:50.960867 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba6944-4494-4e11-b23d-1dbc08d76f31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:50.961923 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba6944-4494-4e11-b23d-1dbc08d76f31 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:50.968141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b3b22-c8cb-4102-b0c5-2265265702f0 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:50.968435 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b3b22-c8cb-4102-b0c5-2265265702f0 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:50.968715 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b3b22-c8cb-4102-b0c5-2265265702f0 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:50.970376 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 309/613] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 04:05:50.975337 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a57db2-df1c-4317-9d48-683efc51c48f None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:50.975653 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a57db2-df1c-4317-9d48-683efc51c48f None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:50.975888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a57db2-df1c-4317-9d48-683efc51c48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:50.979720 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 305/614] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:05:50.984709 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba6944-4494-4e11-b23d-1dbc08d76f31 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:51.008183 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-38a57db2-df1c-4317-9d48-683efc51c48f None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:51.009443 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-38a57db2-df1c-4317-9d48-683efc51c48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:51.106593 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:51.143234 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 310/615] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 04:05:51.150478 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba6944-4494-4e11-b23d-1dbc08d76f31 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:51.205766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f479a-8b52-40db-8b1a-c5b8ae20fbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:51.206746 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f479a-8b52-40db-8b1a-c5b8ae20fbbc None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:51.207251 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f479a-8b52-40db-8b1a-c5b8ae20fbbc None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:51.207728 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f479a-8b52-40db-8b1a-c5b8ae20fbbc None admin] PATH_INFO: `/v3/users/swift` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:51.220691 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f479a-8b52-40db-8b1a-c5b8ae20fbbc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:51.222453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f479a-8b52-40db-8b1a-c5b8ae20fbbc None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:51.241482 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-236f479a-8b52-40db-8b1a-c5b8ae20fbbc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 04:05:51.241482 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:51.241482 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:51.241482 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:51.241482 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:51.241482 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:51.241482 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:51.241482 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:51.241482 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:51.241482 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:51.241482 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:51.241482 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:51.241482 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:05:51.241482 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:05:51.241482 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:05:51.241482 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:05:51.242521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:51.242521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:51.242521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:05:51.242521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:05:51.242521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:05:51.242521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:05:51.242521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:51.242521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:51.242521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:51.242521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:51.242521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:51.242521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:51.242521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:51.242521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:51.242521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:51.242521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:51.242521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:51.242521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:51.243489 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:51.243489 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:51.243489 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:05:51.243489 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:05:51.243489 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:05:51.243489 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:05:51.243489 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:05:51.243489 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:05:51.243489 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 04:05:51.243489 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:51.249912 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 306/616] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:05:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:05:51.255847 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a57db2-df1c-4317-9d48-683efc51c48f None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:51.391062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:51.416429 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a57db2-df1c-4317-9d48-683efc51c48f None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:51.423435 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f479a-8b52-40db-8b1a-c5b8ae20fbbc None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:51.474976 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435ebed-c50b-4481-8623-193626f762d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:51.475513 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435ebed-c50b-4481-8623-193626f762d1 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:51.475793 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435ebed-c50b-4481-8623-193626f762d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:51.476068 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435ebed-c50b-4481-8623-193626f762d1 None admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:51.476803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435ebed-c50b-4481-8623-193626f762d1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:51.477136 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435ebed-c50b-4481-8623-193626f762d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:51.478596 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435ebed-c50b-4481-8623-193626f762d1 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:51.504343 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 311/617] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Aug 23 04:05:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:51.510132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435ebed-c50b-4481-8623-193626f762d1 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:51.587100 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f479a-8b52-40db-8b1a-c5b8ae20fbbc None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:51.650475 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf32abf-da45-4242-82d5-e71c8559a1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:51.651674 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf32abf-da45-4242-82d5-e71c8559a1a3 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:51.652995 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf32abf-da45-4242-82d5-e71c8559a1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:51.655900 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf32abf-da45-4242-82d5-e71c8559a1a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:51.661947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:51.671430 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf32abf-da45-4242-82d5-e71c8559a1a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:51.676297 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-ccf32abf-da45-4242-82d5-e71c8559a1a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:05:51.676297 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:51.676297 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:51.676297 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:51.676297 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:51.676297 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:51.676297 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:51.676297 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:51.676297 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:51.676297 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:51.676297 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:51.676297 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:51.676297 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:51.676297 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:51.676297 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:51.676297 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:51.683971 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:51.683971 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:51.683971 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:51.683971 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:51.683971 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:51.683971 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:51.683971 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:51.683971 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:51.683971 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:51.683971 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:51.683971 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:51.683971 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:51.683971 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:51.683971 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:51.683971 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:51.683971 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:51.684968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:51.684968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:51.684968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:51.684968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:51.684968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:51.684968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:51.684968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:51.684968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:51.684968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:51.684968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:51.684968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:05:51.684968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:51.684968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 307/618] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 23 04:05:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:05:51.686651 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435ebed-c50b-4481-8623-193626f762d1 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:51.686762 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf32abf-da45-4242-82d5-e71c8559a1a3 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:51.751948 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc8286-3d35-4d3e-8de7-2085d1f0b94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:51.753256 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc8286-3d35-4d3e-8de7-2085d1f0b94e None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:51.753904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc8286-3d35-4d3e-8de7-2085d1f0b94e None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:51.755225 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc8286-3d35-4d3e-8de7-2085d1f0b94e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:51.768440 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:51.775654 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc8286-3d35-4d3e-8de7-2085d1f0b94e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:51.777676 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc8286-3d35-4d3e-8de7-2085d1f0b94e None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:51.809469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-8adc8286-3d35-4d3e-8de7-2085d1f0b94e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:51.809469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:51.809469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:51.809469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:51.809469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:51.809469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:51.809469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:51.809469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:51.809469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:51.809469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:51.809469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:51.809469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:51.809469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:51.809469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:51.809469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:51.809469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:51.810514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:51.810514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:51.810514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:51.810514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:51.810514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:51.810514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:51.810514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:51.810514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:51.810514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:51.810514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:51.810514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:51.810514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:51.810514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:51.810514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:51.810514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:51.810514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:51.810514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:51.811443 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:51.811443 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:51.811443 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:51.814687 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 312/619] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:51.820122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc8286-3d35-4d3e-8de7-2085d1f0b94e None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:51.886443 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf32abf-da45-4242-82d5-e71c8559a1a3 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:51.952232 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638f505-ad8d-4e88-bc08-7f0fa1877a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:51.956858 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638f505-ad8d-4e88-bc08-7f0fa1877a2f None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:51.957414 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638f505-ad8d-4e88-bc08-7f0fa1877a2f None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:51.957930 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638f505-ad8d-4e88-bc08-7f0fa1877a2f None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:51.958889 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638f505-ad8d-4e88-bc08-7f0fa1877a2f None admin] RBAC: Adding query filter params (name=service) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:51.959460 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638f505-ad8d-4e88-bc08-7f0fa1877a2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:51.969271 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638f505-ad8d-4e88-bc08-7f0fa1877a2f None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:51.986256 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 308/620] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 23 04:05:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:51.994941 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638f505-ad8d-4e88-bc08-7f0fa1877a2f None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:52.024947 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc8286-3d35-4d3e-8de7-2085d1f0b94e None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:52.085448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:52.101969 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc437f-2ad5-4f50-a374-9299c53158ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:52.102592 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc437f-2ad5-4f50-a374-9299c53158ac None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:52.102868 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc437f-2ad5-4f50-a374-9299c53158ac None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:52.103145 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc437f-2ad5-4f50-a374-9299c53158ac None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:52.103828 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc437f-2ad5-4f50-a374-9299c53158ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:52.104138 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc437f-2ad5-4f50-a374-9299c53158ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:52.106137 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc437f-2ad5-4f50-a374-9299c53158ac None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:52.123112 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 313/621] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:52.128475 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc437f-2ad5-4f50-a374-9299c53158ac None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:52.163428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638f505-ad8d-4e88-bc08-7f0fa1877a2f None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:52.184634 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:52.230760 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a46b9-e0b5-492b-9421-05f89c7ac1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:52.231400 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a46b9-e0b5-492b-9421-05f89c7ac1ed None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:52.231681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a46b9-e0b5-492b-9421-05f89c7ac1ed None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:52.231949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a46b9-e0b5-492b-9421-05f89c7ac1ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:52.239567 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc437f-2ad5-4f50-a374-9299c53158ac None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:52.250894 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a46b9-e0b5-492b-9421-05f89c7ac1ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:52.252346 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a46b9-e0b5-492b-9421-05f89c7ac1ed None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:52.266554 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-3a5a46b9-e0b5-492b-9421-05f89c7ac1ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:52.266554 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:52.266554 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:52.266554 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:52.266554 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:52.266554 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:52.266554 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:52.266554 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:52.266554 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:52.266554 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:52.266554 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:52.266554 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:52.266554 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:52.266554 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:52.266554 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:52.266554 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:52.267549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:52.267549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:52.267549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:52.267549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:52.267549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:52.267549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:52.267549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:52.267549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:52.267549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:52.267549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:52.267549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:52.267549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:52.267549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:52.267549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:52.267549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:52.267549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:52.267549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:52.268472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:52.268472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:52.268472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:52.268472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 309/622] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:52.275599 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a46b9-e0b5-492b-9421-05f89c7ac1ed None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:52.282994 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd4275-3387-41f8-acb6-8b98db12486e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:52.283645 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd4275-3387-41f8-acb6-8b98db12486e None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:52.283930 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd4275-3387-41f8-acb6-8b98db12486e None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:52.284210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd4275-3387-41f8-acb6-8b98db12486e None admin] PATH_INFO: `/v3/projects/service` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:52.296140 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd4275-3387-41f8-acb6-8b98db12486e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:52.298277 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd4275-3387-41f8-acb6-8b98db12486e None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:52.311052 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-8abd4275-3387-41f8-acb6-8b98db12486e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:05:52.311052 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:52.311052 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:52.311052 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:52.311052 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:52.311052 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:52.311052 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:52.311052 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:52.311052 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:52.311052 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:52.311052 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:52.311052 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:52.311052 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:05:52.311052 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:05:52.311052 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:05:52.312001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:05:52.312001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:52.312001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:52.312001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:52.312001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:52.312001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:52.312001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:52.312001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:52.312001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:52.312001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:52.312001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:52.312001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:52.312001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:52.312001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:52.312001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:52.312001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:52.312001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:52.312922 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:05:52.312922 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:05:52.312922 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:05:52.312922 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:05:52.312922 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:05:52.312922 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:05:52.312922 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:05:52.312922 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:52.315547 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 314/623] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:05:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:52.317002 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a02ae-fcc1-4a7e-a47a-b6d34132892f None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:52.317548 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a02ae-fcc1-4a7e-a47a-b6d34132892f None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:52.318135 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a02ae-fcc1-4a7e-a47a-b6d34132892f None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:52.319815 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 315/624] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:52.324945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a02ae-fcc1-4a7e-a47a-b6d34132892f None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:52.404648 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a46b9-e0b5-492b-9421-05f89c7ac1ed None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:52.417715 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:52.444902 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d8769-46ab-47e3-9460-1a2a57a99723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:52.446422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d8769-46ab-47e3-9460-1a2a57a99723 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:52.447204 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d8769-46ab-47e3-9460-1a2a57a99723 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:52.447707 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d8769-46ab-47e3-9460-1a2a57a99723 None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:52.448583 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d8769-46ab-47e3-9460-1a2a57a99723 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:52.449237 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d8769-46ab-47e3-9460-1a2a57a99723 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:52.450968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d8769-46ab-47e3-9460-1a2a57a99723 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:52.456107 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a02ae-fcc1-4a7e-a47a-b6d34132892f None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:52.469359 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:52.472743 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 310/625] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:05:52.474437 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a97191-3d25-4fdf-bbb3-eb5d59d2f5b2 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:52.474816 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a97191-3d25-4fdf-bbb3-eb5d59d2f5b2 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:52.480662 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a97191-3d25-4fdf-bbb3-eb5d59d2f5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:52.494446 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-22a97191-3d25-4fdf-bbb3-eb5d59d2f5b2 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:52.495831 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-22a97191-3d25-4fdf-bbb3-eb5d59d2f5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:52.497730 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb46b42-08aa-4f49-831d-cac3422071a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:52.499063 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb46b42-08aa-4f49-831d-cac3422071a7 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:52.500778 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb46b42-08aa-4f49-831d-cac3422071a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:52.501250 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb46b42-08aa-4f49-831d-cac3422071a7 None admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:52.502110 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb46b42-08aa-4f49-831d-cac3422071a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:52.502589 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb46b42-08aa-4f49-831d-cac3422071a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:52.504201 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb46b42-08aa-4f49-831d-cac3422071a7 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:52.527336 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 316/626] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:05:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:05:52.527336 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb46b42-08aa-4f49-831d-cac3422071a7 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:52.597674 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 311/627] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:52.598952 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a97191-3d25-4fdf-bbb3-eb5d59d2f5b2 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:52.671160 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb46b42-08aa-4f49-831d-cac3422071a7 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:52.717291 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:52.721705 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a97191-3d25-4fdf-bbb3-eb5d59d2f5b2 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:52.750197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8890dee-76b9-461d-a8b0-bacd68358cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:52.750916 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8890dee-76b9-461d-a8b0-bacd68358cb7 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:52.751212 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8890dee-76b9-461d-a8b0-bacd68358cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:52.751528 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8890dee-76b9-461d-a8b0-bacd68358cb7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:52.761750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57105871-73fe-4fd0-9c76-a8fdb068e9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:52.762836 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57105871-73fe-4fd0-9c76-a8fdb068e9ef None admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:52.763324 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57105871-73fe-4fd0-9c76-a8fdb068e9ef None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:52.763834 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57105871-73fe-4fd0-9c76-a8fdb068e9ef None admin] PATH_INFO: `/v3/projects/a7ada12a1e3a42949c00f483efd522ba/users/63190c62bc92403880ffaedc4737485a/roles/e7c20cdfa0b64f71a716edf832519cbb` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:52.766133 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8890dee-76b9-461d-a8b0-bacd68358cb7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:52.767790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8890dee-76b9-461d-a8b0-bacd68358cb7 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:52.791310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-f8890dee-76b9-461d-a8b0-bacd68358cb7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 04:05:52.791310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:52.791310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:52.791310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:52.791310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:52.791310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:52.791310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:52.791310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:52.791310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:52.791310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:52.791310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:52.791310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:52.791310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:05:52.791310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:05:52.791310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:05:52.791310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:05:52.792310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:52.792310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:52.792310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:05:52.792310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:05:52.792310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:05:52.792310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:05:52.792310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:52.792310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:52.792310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:52.792310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:52.792310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:52.792310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:52.792310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:52.792310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:52.792310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:52.792310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:52.792310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:52.792310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:52.793387 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:52.793387 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:52.793387 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:05:52.793387 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:05:52.793387 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:05:52.793387 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:05:52.793387 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:05:52.793387 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:05:52.793387 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 04:05:52.793387 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:52.798860 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 317/628] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Aug 23 04:05:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:52.800392 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57105871-73fe-4fd0-9c76-a8fdb068e9ef None admin] RBAC: Authorizing `identity:create_grant(project_id=a7ada12a1e3a42949c00f483efd522ba, user_id=63190c62bc92403880ffaedc4737485a, role_id=e7c20cdfa0b64f71a716edf832519cbb)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:52.802592 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57105871-73fe-4fd0-9c76-a8fdb068e9ef None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:52.806282 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8890dee-76b9-461d-a8b0-bacd68358cb7 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:52.840789 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:52.871490 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 312/629] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 23 04:05:52 2022] PUT /identity/v3/projects/a7ada12a1e3a42949c00f483efd522ba/users/63190c62bc92403880ffaedc4737485a/roles/e7c20cdfa0b64f71a716edf832519cbb => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:05:52.873460 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c40f3f-2a53-4c4f-91f3-86783210d04c None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:52.873937 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c40f3f-2a53-4c4f-91f3-86783210d04c None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:52.874439 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c40f3f-2a53-4c4f-91f3-86783210d04c None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:52.881363 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 313/630] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:52.883583 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43517519-ef52-4c9d-80ff-044ebedafd3e None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:52.884079 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43517519-ef52-4c9d-80ff-044ebedafd3e None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:52.884994 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43517519-ef52-4c9d-80ff-044ebedafd3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:52.908406 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-43517519-ef52-4c9d-80ff-044ebedafd3e None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:52.910177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-43517519-ef52-4c9d-80ff-044ebedafd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:52.986724 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8890dee-76b9-461d-a8b0-bacd68358cb7 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:52.995881 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 314/631] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:53.001761 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43517519-ef52-4c9d-80ff-044ebedafd3e None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:53.031663 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606c896-6acc-4c1b-9087-736ebad313b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:53.032295 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606c896-6acc-4c1b-9087-736ebad313b9 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:53.032580 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606c896-6acc-4c1b-9087-736ebad313b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:53.032915 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606c896-6acc-4c1b-9087-736ebad313b9 None admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:53.034090 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c606c896-6acc-4c1b-9087-736ebad313b9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:53.034408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c606c896-6acc-4c1b-9087-736ebad313b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:53.036686 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c606c896-6acc-4c1b-9087-736ebad313b9 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:53.067215 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 318/632] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Aug 23 04:05:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:53.070115 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171ba96-f58f-40d7-8e30-ac7923ddc34f None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:53.072193 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171ba96-f58f-40d7-8e30-ac7923ddc34f None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:53.073427 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171ba96-f58f-40d7-8e30-ac7923ddc34f None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:53.074908 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 319/633] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:53.076997 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171ba96-f58f-40d7-8e30-ac7923ddc34f None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:53.127559 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:53.154240 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43517519-ef52-4c9d-80ff-044ebedafd3e None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:53.188652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:53.199665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076e4ea-f7fe-4b66-9db5-4d9f99c0f316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:53.200915 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076e4ea-f7fe-4b66-9db5-4d9f99c0f316 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:53.201246 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076e4ea-f7fe-4b66-9db5-4d9f99c0f316 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:53.201529 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076e4ea-f7fe-4b66-9db5-4d9f99c0f316 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:53.203653 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171ba96-f58f-40d7-8e30-ac7923ddc34f None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:53.216379 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076e4ea-f7fe-4b66-9db5-4d9f99c0f316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:53.224082 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-3076e4ea-f7fe-4b66-9db5-4d9f99c0f316 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:05:53.224082 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:53.224082 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:53.224082 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:53.224082 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:53.224082 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:53.224082 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:53.224082 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:53.224082 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:53.224082 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:53.224082 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:53.224082 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:53.224082 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:53.224082 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:53.224082 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:53.224082 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:53.225242 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:53.225242 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:53.225242 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:53.225242 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:53.225242 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:53.225242 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:53.225242 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:53.225242 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:53.225242 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:53.225242 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:53.225242 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:53.225242 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:53.225242 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:53.225242 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:53.225242 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:53.225242 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:53.226142 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:53.226142 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:53.226142 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:53.226142 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:53.226142 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:53.226142 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:53.226142 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:53.226142 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:53.226142 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:53.226142 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:53.226142 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:05:53.226142 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:53.226142 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 315/634] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 23 04:05:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:53.229061 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf54b5-16a6-41bf-adcb-9e56e7edd441 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:53.229061 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf54b5-16a6-41bf-adcb-9e56e7edd441 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:53.229061 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf54b5-16a6-41bf-adcb-9e56e7edd441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:53.246350 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068ade8-8691-4d3e-bc2f-228a8cb62efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:53.247101 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068ade8-8691-4d3e-bc2f-228a8cb62efd None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:53.247480 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068ade8-8691-4d3e-bc2f-228a8cb62efd None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:53.247849 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068ade8-8691-4d3e-bc2f-228a8cb62efd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:53.252786 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-52cf54b5-16a6-41bf-adcb-9e56e7edd441 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:53.254020 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-52cf54b5-16a6-41bf-adcb-9e56e7edd441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:53.324552 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068ade8-8691-4d3e-bc2f-228a8cb62efd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:53.325986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068ade8-8691-4d3e-bc2f-228a8cb62efd None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:53.341429 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 316/635] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:53.341429 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf54b5-16a6-41bf-adcb-9e56e7edd441 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:53.426014 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:53.446529 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:53.462030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 320/636] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:05:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:05:53.463235 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068ade8-8691-4d3e-bc2f-228a8cb62efd None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:53.474344 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf54b5-16a6-41bf-adcb-9e56e7edd441 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:53.521904 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724ec1c-53b0-48d1-9f69-c48bd9f38ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:53.522520 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724ec1c-53b0-48d1-9f69-c48bd9f38ab4 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:53.522835 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724ec1c-53b0-48d1-9f69-c48bd9f38ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:53.523648 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724ec1c-53b0-48d1-9f69-c48bd9f38ab4 None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:53.524338 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724ec1c-53b0-48d1-9f69-c48bd9f38ab4 None admin] RBAC: Adding query filter params (name=service) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:53.524646 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724ec1c-53b0-48d1-9f69-c48bd9f38ab4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:53.526322 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724ec1c-53b0-48d1-9f69-c48bd9f38ab4 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:53.541238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 317/637] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 23 04:05:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:53.542368 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724ec1c-53b0-48d1-9f69-c48bd9f38ab4 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:53.581142 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068ade8-8691-4d3e-bc2f-228a8cb62efd None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:53.620023 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc194dec-57a0-4ca2-8e85-788602f7322c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:53.620775 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc194dec-57a0-4ca2-8e85-788602f7322c None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:53.621060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc194dec-57a0-4ca2-8e85-788602f7322c None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:53.621372 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc194dec-57a0-4ca2-8e85-788602f7322c None admin] PATH_INFO: `/v3/roles/service` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:53.632474 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc194dec-57a0-4ca2-8e85-788602f7322c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:53.637280 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-fc194dec-57a0-4ca2-8e85-788602f7322c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:05:53.637280 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:53.637280 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:53.637280 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:53.637280 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:53.637280 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:53.637280 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:53.637280 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:53.637280 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:53.637280 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:53.637280 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:53.637280 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:53.637280 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:53.637280 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:53.637280 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:53.637280 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:53.638229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:53.638229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:53.638229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:53.638229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:53.638229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:53.638229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:53.638229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:53.638229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:53.638229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:53.638229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:53.638229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:53.638229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:53.638229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:53.638229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:53.638229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:53.638229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:53.639083 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:53.639083 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:53.639083 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:53.639083 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:53.639083 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:53.639083 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:53.639083 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:53.639083 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:53.639083 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:53.639083 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:53.639083 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:05:53.639083 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:53.639083 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 321/638] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 23 04:05:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:53.640230 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc194dec-57a0-4ca2-8e85-788602f7322c None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:53.673775 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724ec1c-53b0-48d1-9f69-c48bd9f38ab4 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:53.694934 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:53.709061 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:53.714987 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3f00b-f7f7-46a3-a206-73039b08866d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:53.715621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3f00b-f7f7-46a3-a206-73039b08866d None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:53.715898 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3f00b-f7f7-46a3-a206-73039b08866d None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:53.716189 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3f00b-f7f7-46a3-a206-73039b08866d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:53.726537 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e3f00b-f7f7-46a3-a206-73039b08866d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:53.730137 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e3f00b-f7f7-46a3-a206-73039b08866d None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:53.742448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-e2e3f00b-f7f7-46a3-a206-73039b08866d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:53.742448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:53.742448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:53.742448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:53.742448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:53.742448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:53.742448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:53.742448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:53.742448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:53.742448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:53.742448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:53.742448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:53.742448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:53.742448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:53.742448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:53.742448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:53.743586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:53.743586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:53.743586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:53.743586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:53.743586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:53.743586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:53.743586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:53.743586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:53.743586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:53.743586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:53.743586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:53.743586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:53.743586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:53.743586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:53.743586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:53.743586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:53.743586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:53.744502 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:53.744502 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:53.744502 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:53.751059 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 318/639] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:53.751059 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3f00b-f7f7-46a3-a206-73039b08866d None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:53.757426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc194dec-57a0-4ca2-8e85-788602f7322c None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:53.792706 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf604c71-dfee-497e-8d3f-9db7a7c98dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:53.795972 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf604c71-dfee-497e-8d3f-9db7a7c98dd6 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:53.795972 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf604c71-dfee-497e-8d3f-9db7a7c98dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:53.795972 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf604c71-dfee-497e-8d3f-9db7a7c98dd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:53.805631 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf604c71-dfee-497e-8d3f-9db7a7c98dd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:53.807195 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf604c71-dfee-497e-8d3f-9db7a7c98dd6 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:53.822652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-bf604c71-dfee-497e-8d3f-9db7a7c98dd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:53.822652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:53.822652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:53.822652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:53.822652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:53.822652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:53.822652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:53.822652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:53.822652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:53.822652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:53.822652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:53.822652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:53.822652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:53.822652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:53.822652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:53.822652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:53.832593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:53.832593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:53.832593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:53.832593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:53.832593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:53.832593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:53.832593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:53.832593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:53.832593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:53.832593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:53.832593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:53.832593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:53.832593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:53.832593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:53.832593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:53.832593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:53.832593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:53.834146 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:53.834146 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:53.834146 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:53.834146 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 322/640] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:53.834146 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf604c71-dfee-497e-8d3f-9db7a7c98dd6 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:53.862019 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3f00b-f7f7-46a3-a206-73039b08866d None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:53.896059 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f24814-25d7-4a0d-8558-9b7cfcab9a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:53.896696 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f24814-25d7-4a0d-8558-9b7cfcab9a37 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:53.896981 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f24814-25d7-4a0d-8558-9b7cfcab9a37 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:53.897303 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f24814-25d7-4a0d-8558-9b7cfcab9a37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:53.907294 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f24814-25d7-4a0d-8558-9b7cfcab9a37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:53.913072 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-c3f24814-25d7-4a0d-8558-9b7cfcab9a37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:05:53.913072 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:53.913072 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:53.913072 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:53.913072 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:53.913072 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:53.913072 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:53.913072 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:53.913072 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:53.913072 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:53.913072 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:53.913072 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:53.913072 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:53.913072 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:53.913072 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:53.913072 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:53.914106 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:53.914106 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:53.914106 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:53.914106 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:53.914106 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:53.914106 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:53.914106 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:53.914106 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:53.914106 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:53.914106 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:53.914106 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:53.914106 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:53.914106 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:53.914106 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:53.914106 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:53.914106 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:53.914989 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:53.914989 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:53.914989 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:53.914989 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:53.914989 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:53.914989 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:53.914989 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:53.914989 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:53.914989 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:53.914989 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:53.914989 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:05:53.914989 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:53.914989 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 319/641] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 23 04:05:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:53.914989 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f24814-25d7-4a0d-8558-9b7cfcab9a37 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:53.940978 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:53.944912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf604c71-dfee-497e-8d3f-9db7a7c98dd6 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:53.975602 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:53.985648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2345cdb-d80d-4086-88a8-c0257739378b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:53.986264 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2345cdb-d80d-4086-88a8-c0257739378b None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:53.986543 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2345cdb-d80d-4086-88a8-c0257739378b None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:53.986818 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2345cdb-d80d-4086-88a8-c0257739378b None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:53.987492 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2345cdb-d80d-4086-88a8-c0257739378b None admin] RBAC: Adding query filter params (name=service) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:53.987794 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2345cdb-d80d-4086-88a8-c0257739378b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:53.989212 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2345cdb-d80d-4086-88a8-c0257739378b None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:53.997909 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 323/642] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 23 04:05:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:53.998721 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2345cdb-d80d-4086-88a8-c0257739378b None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:54.038216 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f24814-25d7-4a0d-8558-9b7cfcab9a37 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:54.075240 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083db961-d414-4690-9415-7d28671e45f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:54.075867 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083db961-d414-4690-9415-7d28671e45f9 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:54.076150 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083db961-d414-4690-9415-7d28671e45f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:54.076437 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083db961-d414-4690-9415-7d28671e45f9 None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:54.077101 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083db961-d414-4690-9415-7d28671e45f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:54.077417 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083db961-d414-4690-9415-7d28671e45f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:54.078837 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083db961-d414-4690-9415-7d28671e45f9 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:54.097716 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 320/643] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:54.097716 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083db961-d414-4690-9415-7d28671e45f9 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:54.108007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2345cdb-d80d-4086-88a8-c0257739378b None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:54.142228 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e976f6-6556-4ebb-92a6-4a57f5578caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:54.142839 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e976f6-6556-4ebb-92a6-4a57f5578caa None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:54.143119 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e976f6-6556-4ebb-92a6-4a57f5578caa None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:54.143389 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e976f6-6556-4ebb-92a6-4a57f5578caa None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:54.144037 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e976f6-6556-4ebb-92a6-4a57f5578caa None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:54.144338 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e976f6-6556-4ebb-92a6-4a57f5578caa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:54.146271 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e976f6-6556-4ebb-92a6-4a57f5578caa None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:54.162263 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 324/644] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:54.162263 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e976f6-6556-4ebb-92a6-4a57f5578caa None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:54.185937 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:54.205444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083db961-d414-4690-9415-7d28671e45f9 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:54.207766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:54.240806 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a0513-09e8-4119-8a4e-262a2049e79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:54.241447 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a0513-09e8-4119-8a4e-262a2049e79a None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:54.241728 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a0513-09e8-4119-8a4e-262a2049e79a None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:54.242000 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a0513-09e8-4119-8a4e-262a2049e79a None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:54.242664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a0513-09e8-4119-8a4e-262a2049e79a None admin] RBAC: Adding query filter params (name=service) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:54.242968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a0513-09e8-4119-8a4e-262a2049e79a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:54.244335 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a0513-09e8-4119-8a4e-262a2049e79a None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:54.253351 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 321/645] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 23 04:05:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:54.257228 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a0513-09e8-4119-8a4e-262a2049e79a None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:54.269044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e976f6-6556-4ebb-92a6-4a57f5578caa None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:54.306095 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e83bcc-2cd7-4af2-8f4f-b0ca2944e446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:54.306727 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e83bcc-2cd7-4af2-8f4f-b0ca2944e446 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:54.307003 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e83bcc-2cd7-4af2-8f4f-b0ca2944e446 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:54.307275 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e83bcc-2cd7-4af2-8f4f-b0ca2944e446 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:54.319754 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e83bcc-2cd7-4af2-8f4f-b0ca2944e446 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:54.321261 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e83bcc-2cd7-4af2-8f4f-b0ca2944e446 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:54.335711 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-43e83bcc-2cd7-4af2-8f4f-b0ca2944e446 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:54.335711 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:54.335711 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:54.335711 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:54.335711 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:54.335711 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:54.335711 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:54.335711 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:54.335711 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:54.335711 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:54.335711 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:54.335711 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:54.335711 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:54.335711 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:54.335711 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:54.335711 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:54.337185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:54.337185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:54.337185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:54.337185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:54.337185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:54.337185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:54.337185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:54.337185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:54.337185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:54.337185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:54.337185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:54.337185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:54.337185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:54.337185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:54.337185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:54.337185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:54.337185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:54.338265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:54.338265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:54.338265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:54.338265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 325/646] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:54.338265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e83bcc-2cd7-4af2-8f4f-b0ca2944e446 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:54.364920 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a0513-09e8-4119-8a4e-262a2049e79a None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:54.399124 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d4f49-99c8-4fc2-8e45-40975bbbab61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:54.399764 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d4f49-99c8-4fc2-8e45-40975bbbab61 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:54.400045 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d4f49-99c8-4fc2-8e45-40975bbbab61 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:54.400320 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d4f49-99c8-4fc2-8e45-40975bbbab61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:54.407053 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d4f49-99c8-4fc2-8e45-40975bbbab61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:54.408496 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d4f49-99c8-4fc2-8e45-40975bbbab61 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:54.419473 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-212d4f49-99c8-4fc2-8e45-40975bbbab61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:05:54.419473 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:54.419473 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:54.419473 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:54.419473 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:54.419473 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:54.419473 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:54.419473 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:54.419473 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:54.419473 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:54.419473 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:54.419473 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:54.419473 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:05:54.419473 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:05:54.419473 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:05:54.420399 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:05:54.420399 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:54.420399 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:54.420399 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:54.420399 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:54.420399 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:54.420399 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:54.420399 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:54.420399 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:54.420399 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:54.420399 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:54.420399 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:54.420399 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:54.420399 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:54.420399 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:54.420399 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:54.420399 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:54.427248 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:05:54.427248 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:05:54.427248 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:05:54.427248 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:05:54.427248 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:05:54.427248 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:05:54.427248 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:05:54.427248 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:54.427248 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 322/647] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:05:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:54.427248 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d4f49-99c8-4fc2-8e45-40975bbbab61 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:54.427806 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:54.454897 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:54.455505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e83bcc-2cd7-4af2-8f4f-b0ca2944e446 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:54.491043 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468c0af-1c27-4f8d-ba48-13636cb03013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:54.491677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468c0af-1c27-4f8d-ba48-13636cb03013 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:54.491956 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468c0af-1c27-4f8d-ba48-13636cb03013 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:54.492225 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468c0af-1c27-4f8d-ba48-13636cb03013 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:54.500014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468c0af-1c27-4f8d-ba48-13636cb03013 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:54.501485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468c0af-1c27-4f8d-ba48-13636cb03013 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:54.514437 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-8468c0af-1c27-4f8d-ba48-13636cb03013 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 04:05:54.514437 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:54.514437 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:54.514437 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:54.514437 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:54.514437 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:54.514437 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:54.514437 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:54.514437 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:54.514437 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:54.514437 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:54.514437 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:54.514437 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:05:54.514437 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:05:54.514437 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:05:54.514437 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:05:54.515428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:54.515428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:54.515428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:05:54.515428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:05:54.515428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:05:54.515428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:05:54.515428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:54.515428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:54.515428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:54.515428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:54.515428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:54.515428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:54.515428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:54.515428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:54.515428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:54.515428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:54.515428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:54.515428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:54.516383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:54.516383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:54.516383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:05:54.516383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:05:54.516383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:05:54.516383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:05:54.516383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:05:54.516383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:05:54.516383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 04:05:54.516383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:54.516383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 326/648] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:05:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:54.516383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468c0af-1c27-4f8d-ba48-13636cb03013 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:54.539356 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d4f49-99c8-4fc2-8e45-40975bbbab61 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:54.575944 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6323f96-86b2-48e6-a874-fbdcdf6212d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:54.576579 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6323f96-86b2-48e6-a874-fbdcdf6212d1 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:54.576862 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6323f96-86b2-48e6-a874-fbdcdf6212d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:54.577161 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6323f96-86b2-48e6-a874-fbdcdf6212d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:54.587892 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6323f96-86b2-48e6-a874-fbdcdf6212d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:54.589361 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6323f96-86b2-48e6-a874-fbdcdf6212d1 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:54.603901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-d6323f96-86b2-48e6-a874-fbdcdf6212d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:54.603901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:54.603901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:54.603901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:54.603901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:54.603901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:54.603901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:54.603901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:54.603901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:54.603901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:54.603901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:54.603901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:54.603901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:54.603901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:54.603901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:54.603901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:54.604890 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:54.604890 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:54.604890 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:54.604890 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:54.604890 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:54.604890 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:54.604890 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:54.604890 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:54.604890 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:54.604890 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:54.604890 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:54.604890 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:54.604890 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:54.604890 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:54.604890 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:54.604890 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:54.604890 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:54.605844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:54.605844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:54.605844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:54.605844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 323/649] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:54.605844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6323f96-86b2-48e6-a874-fbdcdf6212d1 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:54.627514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468c0af-1c27-4f8d-ba48-13636cb03013 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:54.663655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa2c69-97ed-4529-ad1d-f3898dee208e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:54.664266 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa2c69-97ed-4529-ad1d-f3898dee208e None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:54.664547 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa2c69-97ed-4529-ad1d-f3898dee208e None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:54.664819 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa2c69-97ed-4529-ad1d-f3898dee208e None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:54.665496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa2c69-97ed-4529-ad1d-f3898dee208e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:54.665807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa2c69-97ed-4529-ad1d-f3898dee208e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:54.667173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa2c69-97ed-4529-ad1d-f3898dee208e None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:54.668727 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:54.685601 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 327/650] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:54.686492 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa2c69-97ed-4529-ad1d-f3898dee208e None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:54.694665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:54.716187 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6323f96-86b2-48e6-a874-fbdcdf6212d1 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:54.752022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6aa2a-7de7-46cd-aa10-15aeb65f7582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:54.752664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6aa2a-7de7-46cd-aa10-15aeb65f7582 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:54.752954 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6aa2a-7de7-46cd-aa10-15aeb65f7582 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:54.753284 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6aa2a-7de7-46cd-aa10-15aeb65f7582 None admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:54.753981 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6aa2a-7de7-46cd-aa10-15aeb65f7582 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:54.754291 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6aa2a-7de7-46cd-aa10-15aeb65f7582 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:54.755757 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6aa2a-7de7-46cd-aa10-15aeb65f7582 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:54.772557 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 324/651] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:05:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:54.772557 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6aa2a-7de7-46cd-aa10-15aeb65f7582 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:54.797749 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa2c69-97ed-4529-ad1d-f3898dee208e None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:54.832328 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09396d4d-9997-44cf-afac-0668c1adf6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:54.833024 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09396d4d-9997-44cf-afac-0668c1adf6c9 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:54.833331 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09396d4d-9997-44cf-afac-0668c1adf6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:54.833604 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09396d4d-9997-44cf-afac-0668c1adf6c9 None admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:54.834331 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09396d4d-9997-44cf-afac-0668c1adf6c9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:54.834636 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09396d4d-9997-44cf-afac-0668c1adf6c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:54.836058 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09396d4d-9997-44cf-afac-0668c1adf6c9 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:54.858167 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 328/652] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Aug 23 04:05:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:54.858167 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09396d4d-9997-44cf-afac-0668c1adf6c9 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:54.878408 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6aa2a-7de7-46cd-aa10-15aeb65f7582 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:54.913818 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:54.916268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3df90c-4a72-4bd7-b43e-21ae5bdc9c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:54.916884 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3df90c-4a72-4bd7-b43e-21ae5bdc9c8e None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:54.917192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3df90c-4a72-4bd7-b43e-21ae5bdc9c8e None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:54.917474 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3df90c-4a72-4bd7-b43e-21ae5bdc9c8e None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:54.918120 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3df90c-4a72-4bd7-b43e-21ae5bdc9c8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:54.918419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3df90c-4a72-4bd7-b43e-21ae5bdc9c8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:54.919893 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3df90c-4a72-4bd7-b43e-21ae5bdc9c8e None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:54.927350 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:54.933746 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 325/653] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:54.934534 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3df90c-4a72-4bd7-b43e-21ae5bdc9c8e None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:54.969901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09396d4d-9997-44cf-afac-0668c1adf6c9 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:55.004228 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2fb45-7ce7-4387-a43d-34c9c1ed66b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:55.004895 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2fb45-7ce7-4387-a43d-34c9c1ed66b2 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:55.005208 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2fb45-7ce7-4387-a43d-34c9c1ed66b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:55.005490 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2fb45-7ce7-4387-a43d-34c9c1ed66b2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:55.012375 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2fb45-7ce7-4387-a43d-34c9c1ed66b2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:55.013862 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2fb45-7ce7-4387-a43d-34c9c1ed66b2 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:55.025662 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-f3e2fb45-7ce7-4387-a43d-34c9c1ed66b2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 04:05:55.025662 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:55.025662 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:55.025662 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:55.025662 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:55.025662 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:55.025662 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:55.025662 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:55.025662 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:55.025662 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:55.025662 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:55.025662 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:55.025662 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:05:55.025662 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:05:55.025662 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:05:55.025662 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:05:55.026785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:55.026785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:55.026785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:05:55.026785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:05:55.026785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:05:55.026785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:05:55.026785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:55.026785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:55.026785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:55.026785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:55.026785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:55.026785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:55.026785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:55.026785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:55.026785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:55.026785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:55.026785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:55.026785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:55.028025 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:55.028025 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:55.028025 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:05:55.028025 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:05:55.028025 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:05:55.028025 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:05:55.028025 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:05:55.028025 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:05:55.028025 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 04:05:55.028025 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:55.028025 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 329/654] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:05:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:55.028025 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2fb45-7ce7-4387-a43d-34c9c1ed66b2 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:55.040906 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3df90c-4a72-4bd7-b43e-21ae5bdc9c8e None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:55.073558 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f065adf-080a-4a12-bb10-286f4f6a5e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:55.074166 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f065adf-080a-4a12-bb10-286f4f6a5e18 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:55.074448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f065adf-080a-4a12-bb10-286f4f6a5e18 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:55.074722 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f065adf-080a-4a12-bb10-286f4f6a5e18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:55.075450 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f065adf-080a-4a12-bb10-286f4f6a5e18 None admin] RBAC: Adding query filter params (role.id=e7c20cdfa0b64f71a716edf832519cbb, scope.project.id=a7ada12a1e3a42949c00f483efd522ba, user.id=1e0236a0acac4b87be977878b5186551) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:55.075773 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f065adf-080a-4a12-bb10-286f4f6a5e18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:55.077220 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f065adf-080a-4a12-bb10-286f4f6a5e18 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:55.083316 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 326/655] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:05:54 2022] GET /identity/v3/role_assignments?user.id=1e0236a0acac4b87be977878b5186551&scope.project.id=a7ada12a1e3a42949c00f483efd522ba&role.id=e7c20cdfa0b64f71a716edf832519cbb => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:55.084509 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac6a3a-da13-443b-9d80-17224694a26c None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:55.084795 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac6a3a-da13-443b-9d80-17224694a26c None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:55.085067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac6a3a-da13-443b-9d80-17224694a26c None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:55.086436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 327/656] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:55.086988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac6a3a-da13-443b-9d80-17224694a26c None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:55.150504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2fb45-7ce7-4387-a43d-34c9c1ed66b2 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:55.165440 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:55.166241 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:55.186979 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b351a-6776-4657-b75f-4acec0861b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:55.187611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b351a-6776-4657-b75f-4acec0861b7d None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:55.187885 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b351a-6776-4657-b75f-4acec0861b7d None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:55.188505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b351a-6776-4657-b75f-4acec0861b7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:55.212935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac6a3a-da13-443b-9d80-17224694a26c None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:55.256586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37883b1-96b8-4d8c-a68e-80e97adbcae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:55.257264 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37883b1-96b8-4d8c-a68e-80e97adbcae9 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:55.257549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37883b1-96b8-4d8c-a68e-80e97adbcae9 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:55.257825 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37883b1-96b8-4d8c-a68e-80e97adbcae9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:55.263113 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b351a-6776-4657-b75f-4acec0861b7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:55.264596 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b351a-6776-4657-b75f-4acec0861b7d None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:55.266274 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37883b1-96b8-4d8c-a68e-80e97adbcae9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:55.267969 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37883b1-96b8-4d8c-a68e-80e97adbcae9 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:55.279460 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-b37883b1-96b8-4d8c-a68e-80e97adbcae9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 04:05:55.279460 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:55.279460 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:55.279460 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:55.279460 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:55.279460 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:55.279460 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:55.279460 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:55.279460 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:55.279460 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:55.279460 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:55.279460 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:55.279460 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:05:55.279460 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:05:55.279460 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:05:55.279460 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:05:55.280607 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:55.280607 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:55.280607 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:05:55.280607 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:05:55.280607 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:05:55.280607 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:05:55.280607 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:55.280607 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:55.280607 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:55.280607 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:55.280607 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:55.280607 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:55.280607 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:55.280607 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:55.280607 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:55.280607 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:55.280607 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:55.280607 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:55.281986 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:55.281986 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:55.281986 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:05:55.281986 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:05:55.281986 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:05:55.281986 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:05:55.281986 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:05:55.281986 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:05:55.281986 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 04:05:55.281986 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:55.281986 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 328/657] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 23 04:05:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:55.283716 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37883b1-96b8-4d8c-a68e-80e97adbcae9 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:55.378437 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 330/658] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:05:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:05:55.378437 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b9587-25b7-4e09-b685-2167f6f26c8c None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:55.378437 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b9587-25b7-4e09-b685-2167f6f26c8c None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:55.378437 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b9587-25b7-4e09-b685-2167f6f26c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:55.393397 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-ef6b9587-25b7-4e09-b685-2167f6f26c8c None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:55.394606 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-ef6b9587-25b7-4e09-b685-2167f6f26c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:55.399702 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37883b1-96b8-4d8c-a68e-80e97adbcae9 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:55.402685 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:55.424758 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:55.438063 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0455e-da3b-4c24-9502-048f84efd35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:55.438882 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0455e-da3b-4c24-9502-048f84efd35e None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:55.439307 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0455e-da3b-4c24-9502-048f84efd35e None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:55.446254 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0455e-da3b-4c24-9502-048f84efd35e None admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:55.446254 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0455e-da3b-4c24-9502-048f84efd35e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:55.446254 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0455e-da3b-4c24-9502-048f84efd35e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:55.446254 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0455e-da3b-4c24-9502-048f84efd35e None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:55.461892 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 329/659] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Aug 23 04:05:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:55.462797 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0455e-da3b-4c24-9502-048f84efd35e None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:55.477401 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 331/660] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:55.478673 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b9587-25b7-4e09-b685-2167f6f26c8c None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:55.574046 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0455e-da3b-4c24-9502-048f84efd35e None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:55.611236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753b489-0245-4032-b6c7-bb8b1abe8701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:55.612119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753b489-0245-4032-b6c7-bb8b1abe8701 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:55.612548 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753b489-0245-4032-b6c7-bb8b1abe8701 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:55.612856 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b9587-25b7-4e09-b685-2167f6f26c8c None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:55.613189 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753b489-0245-4032-b6c7-bb8b1abe8701 None admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:55.614098 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753b489-0245-4032-b6c7-bb8b1abe8701 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:55.614548 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753b489-0245-4032-b6c7-bb8b1abe8701 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:55.617264 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753b489-0245-4032-b6c7-bb8b1abe8701 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:55.636269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 330/661] 10.222.0.42 () {56 vars in 1139 bytes} [Tue Aug 23 04:05:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:55.637572 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753b489-0245-4032-b6c7-bb8b1abe8701 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:55.655056 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b072826-df53-49b4-a30d-21830a7055de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:55.656051 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b072826-df53-49b4-a30d-21830a7055de None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:55.656433 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b072826-df53-49b4-a30d-21830a7055de None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:55.656816 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b072826-df53-49b4-a30d-21830a7055de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:55.670940 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b072826-df53-49b4-a30d-21830a7055de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:55.672784 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b072826-df53-49b4-a30d-21830a7055de None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:55.684074 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:55.685487 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:55.694693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-2b072826-df53-49b4-a30d-21830a7055de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:55.694693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:55.694693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:55.694693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:55.694693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:55.694693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:55.694693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:55.694693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:55.694693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:55.694693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:55.694693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:55.694693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:55.694693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:55.694693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:55.694693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:55.694693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:55.698759 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:55.698759 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:55.698759 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:55.698759 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:55.698759 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:55.698759 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:55.698759 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:55.698759 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:55.698759 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:55.698759 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:55.698759 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:55.698759 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:55.698759 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:55.698759 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:55.698759 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:55.698759 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:55.698759 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:55.699670 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:55.699670 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:55.699670 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:55.699670 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 332/662] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:55.699670 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b072826-df53-49b4-a30d-21830a7055de None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:55.763006 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753b489-0245-4032-b6c7-bb8b1abe8701 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:55.799053 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3972aca-bf59-4ce8-9af1-b2ec306c644a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:55.799668 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3972aca-bf59-4ce8-9af1-b2ec306c644a None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:55.799950 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3972aca-bf59-4ce8-9af1-b2ec306c644a None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:55.800216 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3972aca-bf59-4ce8-9af1-b2ec306c644a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:55.809878 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b072826-df53-49b4-a30d-21830a7055de None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:55.845446 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeeb2e9-f738-48d4-ae22-f3a1606c2db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:55.846057 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeeb2e9-f738-48d4-ae22-f3a1606c2db1 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:55.846419 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeeb2e9-f738-48d4-ae22-f3a1606c2db1 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:55.846617 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeeb2e9-f738-48d4-ae22-f3a1606c2db1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:55.870648 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3972aca-bf59-4ce8-9af1-b2ec306c644a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:55.872097 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3972aca-bf59-4ce8-9af1-b2ec306c644a None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:55.910576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:55.911142 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:55.919497 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeeb2e9-f738-48d4-ae22-f3a1606c2db1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:55.920969 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeeb2e9-f738-48d4-ae22-f3a1606c2db1 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:55.977979 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 331/663] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:05:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:05:55.979084 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3972aca-bf59-4ce8-9af1-b2ec306c644a None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:56.040091 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 333/664] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:05:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:05:56.041035 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeeb2e9-f738-48d4-ae22-f3a1606c2db1 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:56.090725 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3972aca-bf59-4ce8-9af1-b2ec306c644a None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:56.138070 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82a9cf-63ce-41ff-9e75-2050d0ebde11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:56.138773 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82a9cf-63ce-41ff-9e75-2050d0ebde11 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:56.139028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82a9cf-63ce-41ff-9e75-2050d0ebde11 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:56.139220 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82a9cf-63ce-41ff-9e75-2050d0ebde11 None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:56.139867 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82a9cf-63ce-41ff-9e75-2050d0ebde11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:56.140249 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:56.140928 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82a9cf-63ce-41ff-9e75-2050d0ebde11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:56.142329 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82a9cf-63ce-41ff-9e75-2050d0ebde11 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:56.147569 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeeb2e9-f738-48d4-ae22-f3a1606c2db1 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:56.151886 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:56.159455 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 332/665] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:56.159455 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82a9cf-63ce-41ff-9e75-2050d0ebde11 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:56.193009 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5659b0-e1d4-48bf-8950-3c5a910c52f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:56.193608 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5659b0-e1d4-48bf-8950-3c5a910c52f5 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:56.193894 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5659b0-e1d4-48bf-8950-3c5a910c52f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:56.194170 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5659b0-e1d4-48bf-8950-3c5a910c52f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:56.205330 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5659b0-e1d4-48bf-8950-3c5a910c52f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:56.210888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-dd5659b0-e1d4-48bf-8950-3c5a910c52f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:05:56.210888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:56.210888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:56.210888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:56.210888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:56.210888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:56.210888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:56.210888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:56.210888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:56.210888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:56.210888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:56.210888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:56.210888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:56.210888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:56.210888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:56.210888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:56.212098 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:56.212098 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:56.212098 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:56.212098 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:56.212098 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:56.212098 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:56.212098 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:56.212098 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:56.212098 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:56.212098 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:56.212098 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:56.212098 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:56.212098 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:56.212098 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:56.212098 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:56.212098 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:56.212986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:56.212986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:56.212986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:56.212986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:56.212986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:56.212986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:56.212986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:56.212986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:56.212986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:56.212986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:56.212986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:05:56.212986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:56.212986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 334/666] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 23 04:05:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:56.213955 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5659b0-e1d4-48bf-8950-3c5a910c52f5 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:56.268047 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82a9cf-63ce-41ff-9e75-2050d0ebde11 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:56.304814 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310f2b9-d3c9-4e28-87d9-f4a0aa759c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:56.305646 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310f2b9-d3c9-4e28-87d9-f4a0aa759c6a None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:56.306028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310f2b9-d3c9-4e28-87d9-f4a0aa759c6a None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:56.306426 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310f2b9-d3c9-4e28-87d9-f4a0aa759c6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:56.318156 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310f2b9-d3c9-4e28-87d9-f4a0aa759c6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:56.319727 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310f2b9-d3c9-4e28-87d9-f4a0aa759c6a None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:56.321913 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5659b0-e1d4-48bf-8950-3c5a910c52f5 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:56.334110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-9310f2b9-d3c9-4e28-87d9-f4a0aa759c6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:56.334110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:56.334110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:56.334110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:56.334110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:56.334110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:56.334110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:56.334110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:56.334110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:56.334110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:56.334110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:56.334110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:56.334110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:56.334110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:56.334110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:56.334110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:56.335265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:56.335265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:56.335265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:56.335265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:56.335265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:56.335265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:56.335265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:56.335265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:56.335265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:56.335265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:56.335265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:56.335265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:56.335265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:56.335265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:56.335265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:56.335265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:56.335265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:56.336321 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:56.336321 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:56.336321 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:56.336321 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 333/667] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:56.336321 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310f2b9-d3c9-4e28-87d9-f4a0aa759c6a None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:56.367187 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839308f7-f6fb-4c4d-b5b4-6c64fc5716c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:56.367827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839308f7-f6fb-4c4d-b5b4-6c64fc5716c6 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:56.368425 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839308f7-f6fb-4c4d-b5b4-6c64fc5716c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:56.368701 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839308f7-f6fb-4c4d-b5b4-6c64fc5716c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:56.380153 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839308f7-f6fb-4c4d-b5b4-6c64fc5716c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:56.381767 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839308f7-f6fb-4c4d-b5b4-6c64fc5716c6 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:56.392136 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:56.396790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-839308f7-f6fb-4c4d-b5b4-6c64fc5716c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:56.396790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:56.396790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:56.396790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:56.396790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:56.396790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:56.396790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:56.396790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:56.396790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:56.396790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:56.396790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:56.396790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:56.396790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:56.396790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:56.396790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:56.396790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:56.397940 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:56.397940 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:56.397940 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:56.397940 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:56.397940 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:56.397940 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:56.397940 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:56.397940 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:56.397940 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:56.397940 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:56.397940 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:56.397940 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:56.397940 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:56.397940 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:56.397940 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:56.397940 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:56.397940 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:56.398853 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:56.398853 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:56.398853 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:56.398853 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 335/668] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:56.398853 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839308f7-f6fb-4c4d-b5b4-6c64fc5716c6 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:56.408474 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:56.452161 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310f2b9-d3c9-4e28-87d9-f4a0aa759c6a None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:56.488953 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6fd35-8dbf-4ac1-a75a-7ce6a3961a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:56.489695 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6fd35-8dbf-4ac1-a75a-7ce6a3961a0d None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:56.490045 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6fd35-8dbf-4ac1-a75a-7ce6a3961a0d None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:56.490393 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6fd35-8dbf-4ac1-a75a-7ce6a3961a0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:56.497238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6fd35-8dbf-4ac1-a75a-7ce6a3961a0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:56.498802 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6fd35-8dbf-4ac1-a75a-7ce6a3961a0d None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:56.503242 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839308f7-f6fb-4c4d-b5b4-6c64fc5716c6 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:56.510992 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-bae6fd35-8dbf-4ac1-a75a-7ce6a3961a0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:05:56.510992 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:56.510992 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:56.510992 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:56.510992 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:56.510992 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:56.510992 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:56.510992 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:56.510992 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:56.510992 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:56.510992 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:56.510992 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:56.510992 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:05:56.510992 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:05:56.510992 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:05:56.512104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:05:56.512104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:56.512104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:56.512104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:56.512104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:56.512104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:56.512104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:56.512104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:56.512104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:56.512104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:56.512104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:56.512104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:56.512104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:56.512104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:56.512104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:56.512104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:56.512104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:56.513231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:05:56.513231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:05:56.513231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:05:56.513231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:05:56.513231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:05:56.513231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:05:56.513231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:05:56.513231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:56.517499 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 334/669] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:05:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:56.518170 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6fd35-8dbf-4ac1-a75a-7ce6a3961a0d None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:56.542503 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0ed71-cd36-4582-9efd-5cbd647a976e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:56.543764 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0ed71-cd36-4582-9efd-5cbd647a976e None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:56.544073 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0ed71-cd36-4582-9efd-5cbd647a976e None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:56.544449 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0ed71-cd36-4582-9efd-5cbd647a976e None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:56.545049 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0ed71-cd36-4582-9efd-5cbd647a976e None admin] RBAC: Adding query filter params (name=service) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:56.545393 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0ed71-cd36-4582-9efd-5cbd647a976e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:56.546767 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0ed71-cd36-4582-9efd-5cbd647a976e None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:56.555667 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 336/670] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 23 04:05:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:56.560887 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0ed71-cd36-4582-9efd-5cbd647a976e None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:56.625328 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6fd35-8dbf-4ac1-a75a-7ce6a3961a0d None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:56.635756 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:56.636589 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:56.660354 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d9c0e-9ef0-442f-bdd9-83790ae5b614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:56.661541 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d9c0e-9ef0-442f-bdd9-83790ae5b614 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:56.661825 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d9c0e-9ef0-442f-bdd9-83790ae5b614 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:56.662095 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d9c0e-9ef0-442f-bdd9-83790ae5b614 None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:56.662748 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d9c0e-9ef0-442f-bdd9-83790ae5b614 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:56.663057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d9c0e-9ef0-442f-bdd9-83790ae5b614 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:56.664440 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d9c0e-9ef0-442f-bdd9-83790ae5b614 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:56.676706 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0ed71-cd36-4582-9efd-5cbd647a976e None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:56.676872 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 335/671] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:56.677735 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d9c0e-9ef0-442f-bdd9-83790ae5b614 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:56.714710 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96163f5d-7c21-4d11-9be0-b19cfe87d9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:56.715487 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96163f5d-7c21-4d11-9be0-b19cfe87d9e5 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:56.715838 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96163f5d-7c21-4d11-9be0-b19cfe87d9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:56.716112 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96163f5d-7c21-4d11-9be0-b19cfe87d9e5 None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:56.716759 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96163f5d-7c21-4d11-9be0-b19cfe87d9e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:56.717061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96163f5d-7c21-4d11-9be0-b19cfe87d9e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:56.718526 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96163f5d-7c21-4d11-9be0-b19cfe87d9e5 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:56.731822 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 337/672] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:56.732961 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96163f5d-7c21-4d11-9be0-b19cfe87d9e5 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:56.795413 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d9c0e-9ef0-442f-bdd9-83790ae5b614 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:56.834409 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9f160-69e0-44d6-a304-796d1d0b8d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:56.835543 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9f160-69e0-44d6-a304-796d1d0b8d22 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:56.836155 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9f160-69e0-44d6-a304-796d1d0b8d22 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:56.836505 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9f160-69e0-44d6-a304-796d1d0b8d22 None admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:56.837404 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9f160-69e0-44d6-a304-796d1d0b8d22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:56.837788 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9f160-69e0-44d6-a304-796d1d0b8d22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:56.838170 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96163f5d-7c21-4d11-9be0-b19cfe87d9e5 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:56.839380 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9f160-69e0-44d6-a304-796d1d0b8d22 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:56.852651 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 336/673] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:05:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:56.853691 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9f160-69e0-44d6-a304-796d1d0b8d22 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:56.872983 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:56.880996 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a387d08-403c-41fe-a277-d91680a59748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:56.881673 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a387d08-403c-41fe-a277-d91680a59748 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:56.884954 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a387d08-403c-41fe-a277-d91680a59748 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:56.884954 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a387d08-403c-41fe-a277-d91680a59748 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:56.886929 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:56.892323 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a387d08-403c-41fe-a277-d91680a59748 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:56.893606 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a387d08-403c-41fe-a277-d91680a59748 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:56.909205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-1a387d08-403c-41fe-a277-d91680a59748 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:56.909205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:56.909205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:56.909205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:56.909205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:56.909205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:56.909205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:56.909205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:56.909205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:56.909205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:56.909205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:56.909205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:56.909205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:56.909205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:56.909205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:56.909205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:56.910253 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:56.910253 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:56.910253 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:56.910253 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:56.910253 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:56.910253 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:56.910253 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:56.910253 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:56.910253 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:56.910253 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:56.910253 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:56.910253 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:56.910253 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:56.910253 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:56.910253 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:56.910253 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:56.910253 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:56.916779 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:56.916779 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:56.916779 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:56.916779 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 338/674] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:56.916779 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a387d08-403c-41fe-a277-d91680a59748 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:56.974997 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9f160-69e0-44d6-a304-796d1d0b8d22 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:57.009105 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf53d9d-bc94-40b9-8990-ae4688aab7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:57.009912 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf53d9d-bc94-40b9-8990-ae4688aab7e6 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:57.010200 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf53d9d-bc94-40b9-8990-ae4688aab7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:57.010843 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf53d9d-bc94-40b9-8990-ae4688aab7e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:57.018790 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf53d9d-bc94-40b9-8990-ae4688aab7e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:57.021312 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf53d9d-bc94-40b9-8990-ae4688aab7e6 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:57.029929 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a387d08-403c-41fe-a277-d91680a59748 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:57.032697 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-7bf53d9d-bc94-40b9-8990-ae4688aab7e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:05:57.032697 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:57.032697 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:57.032697 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:57.032697 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:57.032697 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:57.032697 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:57.032697 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:57.032697 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:57.032697 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:57.032697 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:57.032697 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:57.032697 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:05:57.032697 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:05:57.032697 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:05:57.033661 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:05:57.033661 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:57.033661 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:57.033661 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:57.033661 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:57.033661 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:57.033661 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:57.033661 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:57.033661 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:57.033661 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:57.033661 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:57.033661 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:57.033661 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:57.033661 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:57.033661 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:57.033661 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:57.033661 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:57.034567 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:05:57.034567 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:05:57.034567 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:05:57.034567 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:05:57.034567 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:05:57.034567 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:05:57.034567 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:05:57.034567 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:57.034567 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 337/675] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:05:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:57.034567 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf53d9d-bc94-40b9-8990-ae4688aab7e6 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:57.069211 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7f677-7797-4e16-a75f-5217282fcf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:57.069847 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7f677-7797-4e16-a75f-5217282fcf67 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:57.070131 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7f677-7797-4e16-a75f-5217282fcf67 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:57.070404 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7f677-7797-4e16-a75f-5217282fcf67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:57.076923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7f677-7797-4e16-a75f-5217282fcf67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:57.078391 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7f677-7797-4e16-a75f-5217282fcf67 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:57.089842 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-34c7f677-7797-4e16-a75f-5217282fcf67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:05:57.089842 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:57.089842 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:57.089842 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:57.089842 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:57.089842 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:57.089842 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:57.089842 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:57.089842 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:57.089842 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:57.089842 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:57.089842 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:57.089842 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:05:57.089842 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:05:57.089842 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:05:57.090901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:05:57.090901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:57.090901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:57.090901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:57.090901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:57.090901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:57.090901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:57.090901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:57.090901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:57.090901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:57.090901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:57.090901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:57.090901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:57.090901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:57.090901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:57.090901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:57.090901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:57.092022 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:05:57.092022 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:05:57.092022 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:05:57.092022 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:05:57.092022 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:05:57.092022 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:05:57.092022 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:05:57.092022 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:57.092022 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 339/676] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:05:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:57.092022 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7f677-7797-4e16-a75f-5217282fcf67 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:57.132921 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:57.134438 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:57.144003 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf53d9d-bc94-40b9-8990-ae4688aab7e6 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:57.177982 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbe7be-45bd-4bd3-a2b8-19f937120004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:57.178593 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbe7be-45bd-4bd3-a2b8-19f937120004 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:57.179140 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbe7be-45bd-4bd3-a2b8-19f937120004 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:57.179421 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbe7be-45bd-4bd3-a2b8-19f937120004 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:57.180151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccbe7be-45bd-4bd3-a2b8-19f937120004 None admin] RBAC: Adding query filter params (role.id=e7c20cdfa0b64f71a716edf832519cbb, scope.project.id=a7ada12a1e3a42949c00f483efd522ba, user.id=a0b0ac2dd135450c9bfe918f98c19425) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:57.180465 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccbe7be-45bd-4bd3-a2b8-19f937120004 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:57.181931 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccbe7be-45bd-4bd3-a2b8-19f937120004 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:57.187553 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 338/677] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:05:57 2022] GET /identity/v3/role_assignments?user.id=a0b0ac2dd135450c9bfe918f98c19425&scope.project.id=a7ada12a1e3a42949c00f483efd522ba&role.id=e7c20cdfa0b64f71a716edf832519cbb => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:57.188341 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbe7be-45bd-4bd3-a2b8-19f937120004 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:57.192617 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7f677-7797-4e16-a75f-5217282fcf67 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:57.234441 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4564b-5b9f-4c08-a19a-4e1f95b15eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:57.235945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4564b-5b9f-4c08-a19a-4e1f95b15eb4 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:57.236186 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4564b-5b9f-4c08-a19a-4e1f95b15eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:57.236457 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4564b-5b9f-4c08-a19a-4e1f95b15eb4 None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:57.237172 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4564b-5b9f-4c08-a19a-4e1f95b15eb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:57.237481 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4564b-5b9f-4c08-a19a-4e1f95b15eb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:57.238944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4564b-5b9f-4c08-a19a-4e1f95b15eb4 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:57.253027 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 340/678] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:57.254996 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af8054-ff4d-4c76-913c-df263b125aa3 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:57.255287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af8054-ff4d-4c76-913c-df263b125aa3 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:57.255565 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af8054-ff4d-4c76-913c-df263b125aa3 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:57.257003 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 341/679] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:57.257776 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af8054-ff4d-4c76-913c-df263b125aa3 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:57.323540 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbe7be-45bd-4bd3-a2b8-19f937120004 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:57.364703 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049efff-e6ba-435d-af49-0a1b174fd24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:57.365448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049efff-e6ba-435d-af49-0a1b174fd24d None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:57.365805 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049efff-e6ba-435d-af49-0a1b174fd24d None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:57.366087 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049efff-e6ba-435d-af49-0a1b174fd24d None admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:57.367254 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049efff-e6ba-435d-af49-0a1b174fd24d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:57.367254 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049efff-e6ba-435d-af49-0a1b174fd24d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:57.368641 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049efff-e6ba-435d-af49-0a1b174fd24d None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:57.377245 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:57.382846 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af8054-ff4d-4c76-913c-df263b125aa3 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:57.383540 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 339/680] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:05:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:57.384379 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049efff-e6ba-435d-af49-0a1b174fd24d None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:57.400690 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:57.419736 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3481c30-5555-4ca7-8a17-5b848e8e618a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:57.420358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3481c30-5555-4ca7-8a17-5b848e8e618a None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:57.420638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3481c30-5555-4ca7-8a17-5b848e8e618a None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:57.420911 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3481c30-5555-4ca7-8a17-5b848e8e618a None admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:57.421641 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3481c30-5555-4ca7-8a17-5b848e8e618a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:57.421948 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3481c30-5555-4ca7-8a17-5b848e8e618a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:57.423408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3481c30-5555-4ca7-8a17-5b848e8e618a None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:57.436221 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 342/681] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:05:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:57.437595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287688e6-c65d-44e3-83bf-0a5e5630b2d8 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:57.437982 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287688e6-c65d-44e3-83bf-0a5e5630b2d8 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:57.438355 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287688e6-c65d-44e3-83bf-0a5e5630b2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:57.459318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-287688e6-c65d-44e3-83bf-0a5e5630b2d8 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:57.460763 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-287688e6-c65d-44e3-83bf-0a5e5630b2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:57.493840 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049efff-e6ba-435d-af49-0a1b174fd24d None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:57.529473 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e78b3-9fb6-45d0-a715-abe152f931af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:57.530154 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e78b3-9fb6-45d0-a715-abe152f931af None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:57.530431 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e78b3-9fb6-45d0-a715-abe152f931af None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:57.530699 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e78b3-9fb6-45d0-a715-abe152f931af None admin] PATH_INFO: `/v3/users/swift` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:57.537276 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 343/682] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:57.537276 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287688e6-c65d-44e3-83bf-0a5e5630b2d8 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:57.551947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e78b3-9fb6-45d0-a715-abe152f931af None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:57.554701 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e78b3-9fb6-45d0-a715-abe152f931af None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:57.571185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-2d9e78b3-9fb6-45d0-a715-abe152f931af None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 04:05:57.571185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:57.571185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:57.571185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:57.571185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:57.571185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:57.571185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:57.571185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:57.571185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:57.571185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:57.571185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:57.571185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:57.571185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:05:57.571185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:05:57.571185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:05:57.571185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:05:57.572355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:57.572355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:57.572355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:05:57.572355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:05:57.572355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:05:57.572355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:05:57.572355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:57.572355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:57.572355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:57.572355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:57.572355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:57.572355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:57.572355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:57.572355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:57.572355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:57.572355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:57.572355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:57.572355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:57.573372 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:57.573372 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:57.573372 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:05:57.573372 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:05:57.573372 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:05:57.573372 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:05:57.573372 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:05:57.573372 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:05:57.573372 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 04:05:57.573372 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:57.573372 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 340/683] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:05:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:57.576555 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e78b3-9fb6-45d0-a715-abe152f931af None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:57.637415 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:57.652304 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287688e6-c65d-44e3-83bf-0a5e5630b2d8 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:57.699577 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:57.705281 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f22ad0-038a-4ca2-b3b6-e61af0827266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:57.706277 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f22ad0-038a-4ca2-b3b6-e61af0827266 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:57.707050 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f22ad0-038a-4ca2-b3b6-e61af0827266 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:57.707499 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f22ad0-038a-4ca2-b3b6-e61af0827266 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:57.709236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f22ad0-038a-4ca2-b3b6-e61af0827266 None admin] RBAC: Adding query filter params (role.id=e7c20cdfa0b64f71a716edf832519cbb, scope.project.id=a7ada12a1e3a42949c00f483efd522ba, user.id=020af86302e447a6b3973df4abbabafa) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:57.709695 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f22ad0-038a-4ca2-b3b6-e61af0827266 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:57.711692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f22ad0-038a-4ca2-b3b6-e61af0827266 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:57.720442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 344/684] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:05:57 2022] GET /identity/v3/role_assignments?user.id=020af86302e447a6b3973df4abbabafa&scope.project.id=a7ada12a1e3a42949c00f483efd522ba&role.id=e7c20cdfa0b64f71a716edf832519cbb => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:57.721596 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f22ad0-038a-4ca2-b3b6-e61af0827266 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:57.741755 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e78b3-9fb6-45d0-a715-abe152f931af None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:57.835341 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2218ec-e80c-4abf-9246-b36ac0b53fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:57.836225 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2218ec-e80c-4abf-9246-b36ac0b53fbc None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:57.836660 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2218ec-e80c-4abf-9246-b36ac0b53fbc None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:57.837121 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2218ec-e80c-4abf-9246-b36ac0b53fbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:57.838053 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2218ec-e80c-4abf-9246-b36ac0b53fbc None admin] RBAC: Adding query filter params (role.id=e7c20cdfa0b64f71a716edf832519cbb, scope.project.id=a7ada12a1e3a42949c00f483efd522ba, user.id=8304ca06f82742ef8ce74396884e90b4) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:57.838527 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2218ec-e80c-4abf-9246-b36ac0b53fbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:57.840165 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2218ec-e80c-4abf-9246-b36ac0b53fbc None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:57.847299 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 341/685] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:05:57 2022] GET /identity/v3/role_assignments?user.id=8304ca06f82742ef8ce74396884e90b4&scope.project.id=a7ada12a1e3a42949c00f483efd522ba&role.id=e7c20cdfa0b64f71a716edf832519cbb => generated 608 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:57.857119 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f22ad0-038a-4ca2-b3b6-e61af0827266 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:57.857535 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2218ec-e80c-4abf-9246-b36ac0b53fbc None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:57.907822 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1d5d6-c01d-4d36-a04b-0278823cf543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:57.908671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1d5d6-c01d-4d36-a04b-0278823cf543 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:57.908953 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1d5d6-c01d-4d36-a04b-0278823cf543 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:57.909252 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1d5d6-c01d-4d36-a04b-0278823cf543 None admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:57.910005 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca1d5d6-c01d-4d36-a04b-0278823cf543 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:57.910312 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca1d5d6-c01d-4d36-a04b-0278823cf543 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:57.911829 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca1d5d6-c01d-4d36-a04b-0278823cf543 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:57.933409 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 345/686] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Aug 23 04:05:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:57.938939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1d5d6-c01d-4d36-a04b-0278823cf543 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:57.963610 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:58.024018 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2218ec-e80c-4abf-9246-b36ac0b53fbc None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:58.067989 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfa22e-efd0-47fa-a01e-c613f6e17158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:58.068629 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfa22e-efd0-47fa-a01e-c613f6e17158 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:58.068908 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfa22e-efd0-47fa-a01e-c613f6e17158 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:58.069211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfa22e-efd0-47fa-a01e-c613f6e17158 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:58.079466 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:58.090422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfa22e-efd0-47fa-a01e-c613f6e17158 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:05:58.090582 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1d5d6-c01d-4d36-a04b-0278823cf543 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:58.090706 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-abdfa22e-efd0-47fa-a01e-c613f6e17158 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:05:58.090706 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:58.090706 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:58.090706 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:58.090706 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:58.090706 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:58.090706 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:58.090706 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:58.090706 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:58.090706 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:58.090706 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:58.090706 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:58.090706 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:05:58.090706 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:05:58.090706 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:05:58.090706 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:05:58.091907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:05:58.091907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:05:58.091907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:05:58.091907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:05:58.091907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:58.091907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:58.091907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:58.091907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:58.091907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:58.091907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:58.091907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:58.091907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:58.091907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:58.091907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:58.091907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:58.091907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:58.093061 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:58.093061 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:58.093061 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:58.093061 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:58.093061 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:05:58.093061 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:05:58.093061 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:05:58.093061 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:05:58.093061 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:05:58.093061 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:05:58.093061 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:05:58.093061 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:58.093061 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 342/687] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:05:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:58.097451 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfa22e-efd0-47fa-a01e-c613f6e17158 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:58.132250 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8fa37-51fc-426e-8c66-0893daafe267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:58.133336 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8fa37-51fc-426e-8c66-0893daafe267 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:58.133336 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8fa37-51fc-426e-8c66-0893daafe267 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:58.133532 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8fa37-51fc-426e-8c66-0893daafe267 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:58.225855 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8fa37-51fc-426e-8c66-0893daafe267 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:58.227727 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8fa37-51fc-426e-8c66-0893daafe267 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:58.229605 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfa22e-efd0-47fa-a01e-c613f6e17158 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:58.268419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af5f2c-1632-4abd-9dfa-0dc1b8652f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:58.268419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af5f2c-1632-4abd-9dfa-0dc1b8652f2f None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:58.268419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af5f2c-1632-4abd-9dfa-0dc1b8652f2f None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:58.268419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af5f2c-1632-4abd-9dfa-0dc1b8652f2f None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:58.268892 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:58.268988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af5f2c-1632-4abd-9dfa-0dc1b8652f2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:58.268988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af5f2c-1632-4abd-9dfa-0dc1b8652f2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:58.268988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af5f2c-1632-4abd-9dfa-0dc1b8652f2f None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:58.276742 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 343/688] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:05:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:58.283045 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af5f2c-1632-4abd-9dfa-0dc1b8652f2f None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:58.357952 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:58.405959 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af5f2c-1632-4abd-9dfa-0dc1b8652f2f None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:58.448649 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 346/689] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:05:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:05:58.454420 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8fa37-51fc-426e-8c66-0893daafe267 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:58.469576 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6c687-f8a6-4eaa-8045-4f416df55493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:58.470588 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6c687-f8a6-4eaa-8045-4f416df55493 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:58.473266 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6c687-f8a6-4eaa-8045-4f416df55493 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:58.473877 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6c687-f8a6-4eaa-8045-4f416df55493 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:58.492512 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6c687-f8a6-4eaa-8045-4f416df55493 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:58.494748 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6c687-f8a6-4eaa-8045-4f416df55493 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:58.514472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-0ad6c687-f8a6-4eaa-8045-4f416df55493 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:58.514472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:58.514472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:58.514472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:58.514472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:58.514472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:58.514472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:58.514472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:58.514472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:58.514472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:58.514472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:58.514472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:58.514472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:58.514472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:58.514472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:58.514472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:58.515664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:58.515664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:58.515664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:58.515664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:58.515664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:58.515664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:58.515664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:58.515664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:58.515664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:58.515664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:58.515664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:58.515664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:58.515664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:58.515664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:58.515664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:58.515664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:58.515664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:58.516811 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:58.516811 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:58.516811 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:58.518569 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 344/690] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:58.525368 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6c687-f8a6-4eaa-8045-4f416df55493 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:58.679177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6c687-f8a6-4eaa-8045-4f416df55493 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:58.681495 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8fa37-51fc-426e-8c66-0893daafe267 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:58.695103 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:58.719185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:58.723809 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06522e-09ff-4d13-a428-0e45365b61f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:58.724937 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06522e-09ff-4d13-a428-0e45365b61f5 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:58.726946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06522e-09ff-4d13-a428-0e45365b61f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:58.727379 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06522e-09ff-4d13-a428-0e45365b61f5 None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:58.728191 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06522e-09ff-4d13-a428-0e45365b61f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:58.729167 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06522e-09ff-4d13-a428-0e45365b61f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:58.731382 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06522e-09ff-4d13-a428-0e45365b61f5 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:58.753941 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 345/691] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:58.760605 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06522e-09ff-4d13-a428-0e45365b61f5 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:58.760741 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7ab43-094c-49f7-ac3c-c4ed6550eaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:58.761348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7ab43-094c-49f7-ac3c-c4ed6550eaf4 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:58.761620 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7ab43-094c-49f7-ac3c-c4ed6550eaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:58.761895 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7ab43-094c-49f7-ac3c-c4ed6550eaf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:58.780534 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7ab43-094c-49f7-ac3c-c4ed6550eaf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:58.782016 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7ab43-094c-49f7-ac3c-c4ed6550eaf4 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:58.810693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-2cf7ab43-094c-49f7-ac3c-c4ed6550eaf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:58.810693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:58.810693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:58.810693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:58.810693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:58.810693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:58.810693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:58.810693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:58.810693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:58.810693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:58.810693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:58.810693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:58.810693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:05:58.810693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:05:58.810693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:05:58.810693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:05:58.811956 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:58.811956 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:58.811956 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:58.811956 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:58.811956 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:58.811956 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:58.811956 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:58.811956 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:58.811956 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:58.811956 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:58.811956 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:58.811956 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:58.811956 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:58.811956 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:58.811956 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:58.811956 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:58.811956 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:05:58.813076 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:05:58.813076 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:05:58.813076 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:58.813076 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 347/692] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:05:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:58.819076 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7ab43-094c-49f7-ac3c-c4ed6550eaf4 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:58.955065 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06522e-09ff-4d13-a428-0e45365b61f5 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:59.008899 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7ab43-094c-49f7-ac3c-c4ed6550eaf4 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:59.024848 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea69f0d-6127-4f57-ae82-d77ca72c0dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:59.025656 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea69f0d-6127-4f57-ae82-d77ca72c0dc9 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:59.026031 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea69f0d-6127-4f57-ae82-d77ca72c0dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:59.026393 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea69f0d-6127-4f57-ae82-d77ca72c0dc9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:59.039659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea69f0d-6127-4f57-ae82-d77ca72c0dc9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:59.041423 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea69f0d-6127-4f57-ae82-d77ca72c0dc9 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:59.062657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-eea69f0d-6127-4f57-ae82-d77ca72c0dc9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 04:05:59.062657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:59.062657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:59.062657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:59.062657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:59.062657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:59.062657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:59.062657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:59.062657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:59.062657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:59.062657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:59.062657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:59.062657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:05:59.062657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:05:59.062657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:05:59.062657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:05:59.063844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:59.063844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:59.063844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:05:59.063844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:05:59.063844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:05:59.063844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:05:59.063844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:59.063844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:59.063844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:59.063844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:59.063844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:59.063844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:59.063844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:59.063844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:59.063844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:59.063844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:59.063844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:59.063844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:59.065018 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:59.065018 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:59.065018 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:05:59.065018 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:05:59.065018 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:05:59.065018 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:05:59.065018 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:05:59.065018 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:05:59.065018 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 04:05:59.065018 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:05:59.067557 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 346/693] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Aug 23 04:05:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:05:59.073775 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea69f0d-6127-4f57-ae82-d77ca72c0dc9 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:59.084008 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab4c95-8170-4099-9d55-c23c2d5bfda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:59.084818 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab4c95-8170-4099-9d55-c23c2d5bfda6 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:59.085240 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab4c95-8170-4099-9d55-c23c2d5bfda6 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:59.085613 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab4c95-8170-4099-9d55-c23c2d5bfda6 None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:59.086377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab4c95-8170-4099-9d55-c23c2d5bfda6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:59.086822 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab4c95-8170-4099-9d55-c23c2d5bfda6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:59.088322 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab4c95-8170-4099-9d55-c23c2d5bfda6 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:59.112994 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 348/694] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:59.118525 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab4c95-8170-4099-9d55-c23c2d5bfda6 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:59.128726 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:59.149355 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:59.260457 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab4c95-8170-4099-9d55-c23c2d5bfda6 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:59.266576 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea69f0d-6127-4f57-ae82-d77ca72c0dc9 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:59.308133 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d316b8c-a070-4242-a39b-2d1cc989015e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:59.311901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d316b8c-a070-4242-a39b-2d1cc989015e None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:59.312183 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d316b8c-a070-4242-a39b-2d1cc989015e None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:59.312448 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d316b8c-a070-4242-a39b-2d1cc989015e None admin] PATH_INFO: `/v3/projects/service` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:59.324185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d316b8c-a070-4242-a39b-2d1cc989015e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:59.325678 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d316b8c-a070-4242-a39b-2d1cc989015e None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:59.343671 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12152abc-39d3-4330-93c3-998a64945e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:59.344286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-9d316b8c-a070-4242-a39b-2d1cc989015e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:05:59.344286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:05:59.344286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:05:59.344286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:05:59.344286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:05:59.344286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:05:59.344286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:05:59.344286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:05:59.344286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:05:59.344286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:05:59.344286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:05:59.344286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:05:59.344286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:05:59.344286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:05:59.344286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:05:59.345195 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:05:59.345195 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:05:59.345195 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:05:59.345195 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:05:59.345195 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:05:59.345195 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:05:59.345195 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:05:59.345195 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:05:59.345195 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:05:59.345195 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:05:59.345195 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:05:59.345195 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:05:59.345195 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:05:59.345195 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:05:59.345195 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:05:59.345195 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:05:59.345195 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:05:59.346111 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:05:59.346111 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:05:59.346111 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:05:59.346111 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:05:59.346111 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:05:59.346111 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:05:59.346111 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:05:59.346111 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:05:59.346544 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12152abc-39d3-4330-93c3-998a64945e52 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:59.346544 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12152abc-39d3-4330-93c3-998a64945e52 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:59.346544 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12152abc-39d3-4330-93c3-998a64945e52 None admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:59.346544 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12152abc-39d3-4330-93c3-998a64945e52 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:59.346776 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 349/695] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:05:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:05:59.346851 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12152abc-39d3-4330-93c3-998a64945e52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:59.346921 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813a395-322b-4a1d-bef7-250c19a12d28 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:59.349041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813a395-322b-4a1d-bef7-250c19a12d28 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:59.349041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813a395-322b-4a1d-bef7-250c19a12d28 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:59.349297 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12152abc-39d3-4330-93c3-998a64945e52 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:59.353485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 350/696] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:05:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:05:59.354314 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813a395-322b-4a1d-bef7-250c19a12d28 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:59.382283 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 347/697] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Aug 23 04:05:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:59.383640 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246a5cc-cde7-4951-86b5-ce9e469a6ae4 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:59.383937 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246a5cc-cde7-4951-86b5-ce9e469a6ae4 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:59.384216 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246a5cc-cde7-4951-86b5-ce9e469a6ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:59.406871 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-4246a5cc-cde7-4951-86b5-ce9e469a6ae4 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:05:59.408175 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-4246a5cc-cde7-4951-86b5-ce9e469a6ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:05:59.463262 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:59.485196 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813a395-322b-4a1d-bef7-250c19a12d28 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:59.492105 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 348/698] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:05:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:05:59.493019 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246a5cc-cde7-4951-86b5-ce9e469a6ae4 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:59.524382 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:59.528364 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19452b90-d346-4451-b4a3-7c8c290ab642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:59.529477 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19452b90-d346-4451-b4a3-7c8c290ab642 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:59.529980 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19452b90-d346-4451-b4a3-7c8c290ab642 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:59.530537 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19452b90-d346-4451-b4a3-7c8c290ab642 None admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:59.531402 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19452b90-d346-4451-b4a3-7c8c290ab642 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:59.531870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19452b90-d346-4451-b4a3-7c8c290ab642 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:59.533542 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19452b90-d346-4451-b4a3-7c8c290ab642 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:59.547360 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 351/699] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:05:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:05:59.554367 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19452b90-d346-4451-b4a3-7c8c290ab642 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:59.667624 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19452b90-d346-4451-b4a3-7c8c290ab642 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:59.705253 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1d21b-194b-4ebe-ab71-6d16ac2bec5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:59.706167 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1d21b-194b-4ebe-ab71-6d16ac2bec5e None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:59.706595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1d21b-194b-4ebe-ab71-6d16ac2bec5e None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:59.707041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1d21b-194b-4ebe-ab71-6d16ac2bec5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:59.708984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e1d21b-194b-4ebe-ab71-6d16ac2bec5e None admin] RBAC: Adding query filter params (role.id=e7c20cdfa0b64f71a716edf832519cbb, scope.project.id=a7ada12a1e3a42949c00f483efd522ba, user.id=63190c62bc92403880ffaedc4737485a) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:05:59.709539 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e1d21b-194b-4ebe-ab71-6d16ac2bec5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:59.711542 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e1d21b-194b-4ebe-ab71-6d16ac2bec5e None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:59.718420 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 352/700] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:05:59 2022] GET /identity/v3/role_assignments?user.id=63190c62bc92403880ffaedc4737485a&scope.project.id=a7ada12a1e3a42949c00f483efd522ba&role.id=e7c20cdfa0b64f71a716edf832519cbb => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:05:59.779606 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246a5cc-cde7-4951-86b5-ce9e469a6ae4 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:59.780114 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1d21b-194b-4ebe-ab71-6d16ac2bec5e None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:05:59.792150 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:05:59.849137 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88965177-6a25-41a0-a1bf-72e241cdc673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:59.851590 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88965177-6a25-41a0-a1bf-72e241cdc673 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:59.852346 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88965177-6a25-41a0-a1bf-72e241cdc673 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:59.853610 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88965177-6a25-41a0-a1bf-72e241cdc673 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:59.944773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1d21b-194b-4ebe-ab71-6d16ac2bec5e None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:05:59.969435 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88965177-6a25-41a0-a1bf-72e241cdc673 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:59.971327 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88965177-6a25-41a0-a1bf-72e241cdc673 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:59.994265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089c8d6-4c13-4194-898f-b08a74489d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:05:59.995242 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089c8d6-4c13-4194-898f-b08a74489d3a None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:05:59.995770 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089c8d6-4c13-4194-898f-b08a74489d3a None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:05:59.996234 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089c8d6-4c13-4194-898f-b08a74489d3a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:05:59.997030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6089c8d6-4c13-4194-898f-b08a74489d3a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:05:59.998588 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6089c8d6-4c13-4194-898f-b08a74489d3a None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:05:59.999105 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:00.012236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-6089c8d6-4c13-4194-898f-b08a74489d3a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 04:06:00.012236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:00.012236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 04:06:00.012236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 04:06:00.012236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 04:06:00.012236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 04:06:00.012236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 04:06:00.012236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:00.012236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 04:06:00.012236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:00.012236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 04:06:00.012236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:00.012236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:00.012236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:00.012236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:00.012236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:00.012236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:00.013542 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:00.013542 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:00.013542 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:00.013542 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:00.013542 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:00.013542 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:00.013542 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 04:06:00.013542 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 04:06:00.013542 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 04:06:00.013542 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 04:06:00.013542 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:00.013542 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:00.013542 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:00.013542 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:00.013542 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:00.013542 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:00.014501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:00.014501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:00.014501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:00.014501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:00.014501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:00.014501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:00.014501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:00.014501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:00.014501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:00.014501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:00.014501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 04:06:00.014501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:00.014501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 04:06:00.014501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:00.018434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 353/701] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Aug 23 04:05:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:06:00.025798 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089c8d6-4c13-4194-898f-b08a74489d3a None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:00.101719 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 349/702] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:05:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:06:00.108167 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88965177-6a25-41a0-a1bf-72e241cdc673 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:00.120046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:00.156111 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089c8d6-4c13-4194-898f-b08a74489d3a None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:00.199141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ceb4b-4502-43c6-ba1c-b7b7e70ef5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:00.205537 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ceb4b-4502-43c6-ba1c-b7b7e70ef5dc None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:00.205537 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ceb4b-4502-43c6-ba1c-b7b7e70ef5dc None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:00.205537 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ceb4b-4502-43c6-ba1c-b7b7e70ef5dc None admin] PATH_INFO: `/v3/services` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:00.205537 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ceb4b-4502-43c6-ba1c-b7b7e70ef5dc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:00.205537 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ceb4b-4502-43c6-ba1c-b7b7e70ef5dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:00.205537 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ceb4b-4502-43c6-ba1c-b7b7e70ef5dc None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:00.210994 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 354/703] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Aug 23 04:06:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:00.212408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0877dba-cc98-40cd-80f8-b8486a1fa12a None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:00.212765 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0877dba-cc98-40cd-80f8-b8486a1fa12a None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:00.213124 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0877dba-cc98-40cd-80f8-b8486a1fa12a None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:00.215133 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 355/704] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:00.218589 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0877dba-cc98-40cd-80f8-b8486a1fa12a None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:00.228484 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88965177-6a25-41a0-a1bf-72e241cdc673 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:00.256585 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:00.265819 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afe286-4228-4d4a-833f-e69827ed7534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:00.267400 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afe286-4228-4d4a-833f-e69827ed7534 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:00.267698 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afe286-4228-4d4a-833f-e69827ed7534 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:00.267985 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afe286-4228-4d4a-833f-e69827ed7534 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:00.280579 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afe286-4228-4d4a-833f-e69827ed7534 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:00.282139 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afe286-4228-4d4a-833f-e69827ed7534 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:00.298766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-b7afe286-4228-4d4a-833f-e69827ed7534 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:00.298766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:00.298766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:00.298766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:00.298766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:00.298766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:00.298766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:00.298766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:00.298766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:00.298766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:00.298766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:00.298766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:00.298766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:06:00.298766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:06:00.298766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:06:00.298766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:06:00.299978 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:00.299978 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:00.299978 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:00.299978 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:00.299978 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:00.299978 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:00.299978 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:00.299978 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:00.299978 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:00.299978 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:00.299978 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:00.299978 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:00.299978 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:00.299978 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:00.299978 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:00.299978 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:00.299978 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:06:00.300893 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:06:00.300893 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:00.300893 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:00.300893 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 350/705] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:06:00.305131 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e13be-ee9d-4ac6-8ae6-8df339f25032 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:00.305131 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e13be-ee9d-4ac6-8ae6-8df339f25032 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:00.305131 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e13be-ee9d-4ac6-8ae6-8df339f25032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:00.322686 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-471e13be-ee9d-4ac6-8ae6-8df339f25032 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:00.324154 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-471e13be-ee9d-4ac6-8ae6-8df339f25032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:00.344228 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0877dba-cc98-40cd-80f8-b8486a1fa12a None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:00.381011 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3ed08-f68a-4a85-b4e3-378bac10a270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:00.381654 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3ed08-f68a-4a85-b4e3-378bac10a270 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:00.381943 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3ed08-f68a-4a85-b4e3-378bac10a270 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:00.382213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3ed08-f68a-4a85-b4e3-378bac10a270 None admin] PATH_INFO: `/v3/services` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:00.382846 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3ed08-f68a-4a85-b4e3-378bac10a270 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:00.383153 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3ed08-f68a-4a85-b4e3-378bac10a270 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:00.384515 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3ed08-f68a-4a85-b4e3-378bac10a270 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:00.387494 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:00.390606 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 356/706] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Aug 23 04:06:00 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:00.391722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc44a84-38a6-4547-88ba-9a358768d979 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:00.392009 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc44a84-38a6-4547-88ba-9a358768d979 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:00.392295 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc44a84-38a6-4547-88ba-9a358768d979 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:00.397706 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 357/707] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:00.397706 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc44a84-38a6-4547-88ba-9a358768d979 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:00.408796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 351/708] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:06:00.410174 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9790700-7e57-4def-804e-544893667dfe None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:00.410504 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9790700-7e57-4def-804e-544893667dfe None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:00.410781 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9790700-7e57-4def-804e-544893667dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:00.430723 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-e9790700-7e57-4def-804e-544893667dfe None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:00.431954 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-e9790700-7e57-4def-804e-544893667dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:00.570642 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 352/709] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:06:00.583686 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc44a84-38a6-4547-88ba-9a358768d979 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:00.624490 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba19c00-e408-4d33-9815-6272aa740691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:00.625178 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba19c00-e408-4d33-9815-6272aa740691 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:00.625467 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba19c00-e408-4d33-9815-6272aa740691 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:00.625744 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba19c00-e408-4d33-9815-6272aa740691 None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:00.626524 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba19c00-e408-4d33-9815-6272aa740691 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:00.626834 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba19c00-e408-4d33-9815-6272aa740691 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:00.628339 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba19c00-e408-4d33-9815-6272aa740691 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:00.642762 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 358/710] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:00.648251 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9790700-7e57-4def-804e-544893667dfe None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:00.682421 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:00.750245 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba19c00-e408-4d33-9815-6272aa740691 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:00.783502 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9790700-7e57-4def-804e-544893667dfe None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:00.848697 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca0744-6d81-4808-b247-2b89f8e9292b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:00.849673 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca0744-6d81-4808-b247-2b89f8e9292b None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:00.850161 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca0744-6d81-4808-b247-2b89f8e9292b None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:00.850754 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca0744-6d81-4808-b247-2b89f8e9292b None admin] PATH_INFO: `/v3/projects/service` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:00.853844 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:00.859076 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca0744-6d81-4808-b247-2b89f8e9292b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:00.860767 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca0744-6d81-4808-b247-2b89f8e9292b None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:00.879758 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-97ca0744-6d81-4808-b247-2b89f8e9292b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:06:00.879758 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:00.879758 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:00.879758 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:00.879758 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:00.879758 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:00.879758 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:00.879758 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:00.879758 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:00.879758 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:00.879758 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:00.879758 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:00.879758 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:06:00.879758 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:06:00.879758 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:06:00.880738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:06:00.880738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:00.880738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:00.880738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:00.880738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:00.880738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:00.880738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:00.880738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:00.880738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:00.880738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:00.880738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:00.880738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:00.880738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:00.880738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:00.880738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:00.880738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:00.880738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:00.881696 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:06:00.881696 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:06:00.881696 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:06:00.881696 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:06:00.881696 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:06:00.881696 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:06:00.881696 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:06:00.881696 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:00.881696 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 353/711] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:06:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:00.882211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca0744-6d81-4808-b247-2b89f8e9292b None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:00.920363 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba19c00-e408-4d33-9815-6272aa740691 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:00.966274 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3e2a3-8f22-4bf2-a214-6b3322c2a602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:00.967106 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3e2a3-8f22-4bf2-a214-6b3322c2a602 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:00.967568 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3e2a3-8f22-4bf2-a214-6b3322c2a602 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:00.968411 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3e2a3-8f22-4bf2-a214-6b3322c2a602 None admin] PATH_INFO: `/v3/services/network` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:00.969217 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c3e2a3-8f22-4bf2-a214-6b3322c2a602 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:00.971159 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c3e2a3-8f22-4bf2-a214-6b3322c2a602 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:00.983594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-64c3e2a3-8f22-4bf2-a214-6b3322c2a602 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 04:06:00.983594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:00.983594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 04:06:00.983594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 04:06:00.983594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 04:06:00.983594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 04:06:00.983594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 04:06:00.983594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:00.983594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 04:06:00.983594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:00.983594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 04:06:00.983594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:00.983594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:00.983594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:00.983594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:00.983594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:00.983594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:00.984870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:00.984870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:00.984870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:00.984870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:00.984870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:00.984870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:00.984870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 04:06:00.984870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 04:06:00.984870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 04:06:00.984870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 04:06:00.984870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:00.984870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:00.984870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:00.984870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:00.984870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:00.984870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:00.985988 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:00.985988 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:00.985988 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:00.985988 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:00.985988 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:00.985988 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:00.985988 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:00.985988 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:00.985988 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:00.985988 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:00.985988 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 04:06:00.985988 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:00.985988 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 04:06:00.985988 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:00.989747 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:00.993227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 359/712] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:06:00 2022] GET /identity/v3/services/network => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:06:00.994477 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3e2a3-8f22-4bf2-a214-6b3322c2a602 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:01.003131 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca0744-6d81-4808-b247-2b89f8e9292b None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:01.039868 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e107df-e79e-4669-a53c-f2ad20b958b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:01.040236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e107df-e79e-4669-a53c-f2ad20b958b9 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:01.040520 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e107df-e79e-4669-a53c-f2ad20b958b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:01.040852 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e107df-e79e-4669-a53c-f2ad20b958b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:01.052319 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e107df-e79e-4669-a53c-f2ad20b958b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:01.054335 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e107df-e79e-4669-a53c-f2ad20b958b9 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:01.069275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-f6e107df-e79e-4669-a53c-f2ad20b958b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:01.069275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:01.069275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:01.069275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:01.069275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:01.069275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:01.069275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:01.069275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:01.069275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:01.069275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:01.069275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:01.069275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:01.069275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:06:01.069275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:06:01.069275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:06:01.069275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:06:01.070293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:01.070293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:01.070293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:01.070293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:01.070293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:01.070293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:01.070293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:01.070293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:01.070293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:01.070293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:01.070293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:01.070293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:01.070293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:01.070293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:01.070293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:01.070293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:01.070293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:06:01.071216 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:06:01.071216 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:01.071216 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:01.075289 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 354/713] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:01.076103 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e107df-e79e-4669-a53c-f2ad20b958b9 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:01.113224 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3e2a3-8f22-4bf2-a214-6b3322c2a602 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:01.145540 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:01.148232 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84faab-cf21-4b4d-adef-f52b5e191097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:01.149207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84faab-cf21-4b4d-adef-f52b5e191097 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:01.149743 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84faab-cf21-4b4d-adef-f52b5e191097 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:01.150233 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84faab-cf21-4b4d-adef-f52b5e191097 None admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:01.151145 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84faab-cf21-4b4d-adef-f52b5e191097 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:01.151669 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84faab-cf21-4b4d-adef-f52b5e191097 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:01.153386 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84faab-cf21-4b4d-adef-f52b5e191097 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:01.172770 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 360/714] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:06:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:01.174081 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84faab-cf21-4b4d-adef-f52b5e191097 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:01.181469 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e107df-e79e-4669-a53c-f2ad20b958b9 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:01.216840 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aedb8a-a528-46a5-b6e9-2c286f1d9d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:01.217487 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aedb8a-a528-46a5-b6e9-2c286f1d9d5d None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:01.217766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aedb8a-a528-46a5-b6e9-2c286f1d9d5d None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:01.218091 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aedb8a-a528-46a5-b6e9-2c286f1d9d5d None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:01.218893 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aedb8a-a528-46a5-b6e9-2c286f1d9d5d None admin] RBAC: Adding query filter params (name=network) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:01.219095 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aedb8a-a528-46a5-b6e9-2c286f1d9d5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:01.220479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aedb8a-a528-46a5-b6e9-2c286f1d9d5d None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:01.230376 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 355/715] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 23 04:06:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:01.230376 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aedb8a-a528-46a5-b6e9-2c286f1d9d5d None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:01.242676 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:01.294801 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84faab-cf21-4b4d-adef-f52b5e191097 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:01.332691 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2f4b3-c90e-485a-a38e-43a3e62b0202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:01.333678 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2f4b3-c90e-485a-a38e-43a3e62b0202 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:01.334113 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2f4b3-c90e-485a-a38e-43a3e62b0202 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:01.334626 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2f4b3-c90e-485a-a38e-43a3e62b0202 None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:01.335413 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2f4b3-c90e-485a-a38e-43a3e62b0202 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:01.335929 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2f4b3-c90e-485a-a38e-43a3e62b0202 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:01.337723 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2f4b3-c90e-485a-a38e-43a3e62b0202 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:01.340578 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aedb8a-a528-46a5-b6e9-2c286f1d9d5d None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:01.351105 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 361/716] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:01.352217 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2f4b3-c90e-485a-a38e-43a3e62b0202 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:01.381151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb84213-6505-4554-a336-4253aaf7d76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:01.381908 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb84213-6505-4554-a336-4253aaf7d76b None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:01.382176 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb84213-6505-4554-a336-4253aaf7d76b None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:01.382450 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb84213-6505-4554-a336-4253aaf7d76b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:01.383181 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb84213-6505-4554-a336-4253aaf7d76b None admin] RBAC: Adding query filter params (role.id=255d9e4004c54505a7cda1b8af74e5f1, scope.project.id=a7ada12a1e3a42949c00f483efd522ba, user.id=1e0236a0acac4b87be977878b5186551) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:01.383510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb84213-6505-4554-a336-4253aaf7d76b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:01.384925 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb84213-6505-4554-a336-4253aaf7d76b None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:01.397115 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 356/717] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:06:01 2022] GET /identity/v3/role_assignments?user.id=1e0236a0acac4b87be977878b5186551&scope.project.id=a7ada12a1e3a42949c00f483efd522ba&role.id=255d9e4004c54505a7cda1b8af74e5f1 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:01.397115 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb84213-6505-4554-a336-4253aaf7d76b None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:01.439599 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:01.515874 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:01.552369 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb84213-6505-4554-a336-4253aaf7d76b None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:01.577843 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2f4b3-c90e-485a-a38e-43a3e62b0202 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:01.599468 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8b2b2-495f-4179-8ec1-cfbbd3a3440b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:01.600082 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8b2b2-495f-4179-8ec1-cfbbd3a3440b None admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:01.600392 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8b2b2-495f-4179-8ec1-cfbbd3a3440b None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:01.600662 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8b2b2-495f-4179-8ec1-cfbbd3a3440b None admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:01.609196 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8b2b2-495f-4179-8ec1-cfbbd3a3440b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:01.609196 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8b2b2-495f-4179-8ec1-cfbbd3a3440b None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:01.636091 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bdb78-d7e0-4e9d-a014-c0c8ec5268c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:01.637483 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bdb78-d7e0-4e9d-a014-c0c8ec5268c8 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:01.643632 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bdb78-d7e0-4e9d-a014-c0c8ec5268c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:01.643632 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bdb78-d7e0-4e9d-a014-c0c8ec5268c8 None admin] PATH_INFO: `/v3/services` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:01.643632 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bdb78-d7e0-4e9d-a014-c0c8ec5268c8 None admin] RBAC: Adding query filter params (type=network) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:01.643632 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bdb78-d7e0-4e9d-a014-c0c8ec5268c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:01.643632 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bdb78-d7e0-4e9d-a014-c0c8ec5268c8 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:01.647488 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 362/718] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 23 04:06:01 2022] GET /identity/v3/services?type=network => generated 124 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:01.711382 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 357/719] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 23 04:06:01 2022] POST /identity/v3/users => generated 254 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:06:02.196668 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc7a72-5801-4961-9e56-a5753fddf374 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:02.196957 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc7a72-5801-4961-9e56-a5753fddf374 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:02.197269 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc7a72-5801-4961-9e56-a5753fddf374 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:02.198628 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 363/720] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:02.204119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7f0f0-0dc5-4e2a-97f6-d32a6ec2a45a None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:02.204575 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7f0f0-0dc5-4e2a-97f6-d32a6ec2a45a None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:02.204758 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7f0f0-0dc5-4e2a-97f6-d32a6ec2a45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:02.224757 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-55e7f0f0-0dc5-4e2a-97f6-d32a6ec2a45a None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:02.226010 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-55e7f0f0-0dc5-4e2a-97f6-d32a6ec2a45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:02.319409 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 358/721] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 04:06:02.673936 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c12f56-6d5e-4576-b207-83a5dac62610 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:02.674898 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c12f56-6d5e-4576-b207-83a5dac62610 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:02.675398 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c12f56-6d5e-4576-b207-83a5dac62610 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:02.677709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 364/722] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:02.683504 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1370faa-12a0-4081-aa26-56d3c3f38fe9 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:02.684011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1370faa-12a0-4081-aa26-56d3c3f38fe9 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:02.684485 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1370faa-12a0-4081-aa26-56d3c3f38fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:02.703459 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-e1370faa-12a0-4081-aa26-56d3c3f38fe9 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:02.704919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-e1370faa-12a0-4081-aa26-56d3c3f38fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:02.760508 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c12f56-6d5e-4576-b207-83a5dac62610 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:02.770784 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:02.787244 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 359/723] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 04:06:02.908781 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c12f56-6d5e-4576-b207-83a5dac62610 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:02.923185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:02.959296 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21034439-683c-40d3-9436-e6891c2a5488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:02.959872 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21034439-683c-40d3-9436-e6891c2a5488 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:02.960616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21034439-683c-40d3-9436-e6891c2a5488 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:02.960616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21034439-683c-40d3-9436-e6891c2a5488 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:02.977435 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21034439-683c-40d3-9436-e6891c2a5488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:06:02.982265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-21034439-683c-40d3-9436-e6891c2a5488 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:06:02.982265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:02.982265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:02.982265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:02.982265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:02.982265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:02.982265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:02.982265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:02.982265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:02.982265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:02.982265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:02.982265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:02.982265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:06:02.982265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:06:02.982265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:06:02.982265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:06:02.983461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:06:02.983461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:06:02.983461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:06:02.983461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:06:02.983461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:02.983461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:02.983461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:02.983461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:02.983461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:02.983461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:02.983461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:02.983461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:02.983461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:02.983461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:02.983461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:02.983461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:02.984389 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:02.984389 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:02.984389 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:02.984389 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:02.984389 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:06:02.984389 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:06:02.984389 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:06:02.984389 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:06:02.984389 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:06:02.984389 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:06:02.984389 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:06:02.984389 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:02.986730 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 365/724] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:06:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:02.989211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1370faa-12a0-4081-aa26-56d3c3f38fe9 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:03.107765 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1370faa-12a0-4081-aa26-56d3c3f38fe9 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:03.138151 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21034439-683c-40d3-9436-e6891c2a5488 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:03.142756 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdbeda-6e37-4b65-a127-f3cd97be0493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:03.143383 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdbeda-6e37-4b65-a127-f3cd97be0493 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:03.143666 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdbeda-6e37-4b65-a127-f3cd97be0493 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:03.143938 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdbeda-6e37-4b65-a127-f3cd97be0493 None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:03.145240 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccdbeda-6e37-4b65-a127-f3cd97be0493 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:03.145555 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccdbeda-6e37-4b65-a127-f3cd97be0493 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:03.146937 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccdbeda-6e37-4b65-a127-f3cd97be0493 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:03.155743 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 360/725] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:06:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:03.161066 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdbeda-6e37-4b65-a127-f3cd97be0493 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:03.252613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:03.299616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21034439-683c-40d3-9436-e6891c2a5488 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:03.339449 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdbeda-6e37-4b65-a127-f3cd97be0493 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:03.370567 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1ffc5-7ff8-4734-bb8d-85161bc56850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:03.371217 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1ffc5-7ff8-4734-bb8d-85161bc56850 None admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:03.371502 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1ffc5-7ff8-4734-bb8d-85161bc56850 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:03.371779 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1ffc5-7ff8-4734-bb8d-85161bc56850 None admin] PATH_INFO: `/v3/services` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:03.372474 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1ffc5-7ff8-4734-bb8d-85161bc56850 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:03.373943 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1ffc5-7ff8-4734-bb8d-85161bc56850 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:03.379901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219631c7-d83f-434e-875e-9004b3022f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:03.381032 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219631c7-d83f-434e-875e-9004b3022f42 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:03.381032 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219631c7-d83f-434e-875e-9004b3022f42 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:03.381327 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219631c7-d83f-434e-875e-9004b3022f42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:03.393071 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219631c7-d83f-434e-875e-9004b3022f42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:03.395311 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219631c7-d83f-434e-875e-9004b3022f42 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:03.411057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-219631c7-d83f-434e-875e-9004b3022f42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:03.411057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:03.411057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:03.411057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:03.411057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:03.411057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:03.411057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:03.411057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:03.411057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:03.411057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:03.411057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:03.411057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:03.411057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:06:03.411057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:06:03.411057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:06:03.411057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:06:03.412976 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:03.412976 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:03.412976 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:03.412976 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:03.412976 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:03.412976 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:03.412976 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:03.412976 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:03.412976 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:03.412976 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:03.412976 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:03.412976 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:03.412976 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:03.412976 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:03.412976 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:03.412976 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:03.412976 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:06:03.413918 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:06:03.413918 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:03.413918 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:03.413918 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 361/726] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:06:03.418201 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219631c7-d83f-434e-875e-9004b3022f42 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:03.482942 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 366/727] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 23 04:06:03 2022] POST /identity/v3/services => generated 251 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:06:03.531689 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219631c7-d83f-434e-875e-9004b3022f42 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:03.533275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:03.623252 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11e6ca-c5a0-42b3-b51e-933c5fedeec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:03.623880 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11e6ca-c5a0-42b3-b51e-933c5fedeec5 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:03.624277 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11e6ca-c5a0-42b3-b51e-933c5fedeec5 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:03.624563 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11e6ca-c5a0-42b3-b51e-933c5fedeec5 None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:03.625307 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11e6ca-c5a0-42b3-b51e-933c5fedeec5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:03.625620 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11e6ca-c5a0-42b3-b51e-933c5fedeec5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:03.627038 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11e6ca-c5a0-42b3-b51e-933c5fedeec5 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:03.638346 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0526ae-ba5d-4b99-bf7b-39687efe6465 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:03.638981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0526ae-ba5d-4b99-bf7b-39687efe6465 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:03.639462 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0526ae-ba5d-4b99-bf7b-39687efe6465 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:03.641137 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 362/728] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:03.641509 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 367/729] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:03.646538 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11e6ca-c5a0-42b3-b51e-933c5fedeec5 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:03.647389 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a66ef4-60a7-49c4-aadb-905b5effb44d None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:03.647874 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a66ef4-60a7-49c4-aadb-905b5effb44d None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:03.648357 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a66ef4-60a7-49c4-aadb-905b5effb44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:03.668522 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-97a66ef4-60a7-49c4-aadb-905b5effb44d None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:03.670157 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-97a66ef4-60a7-49c4-aadb-905b5effb44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:03.718083 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:03.780607 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 368/730] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:03 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 04:06:03.804404 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11e6ca-c5a0-42b3-b51e-933c5fedeec5 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:03.841601 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ff475-04a2-4067-8bc2-d53daac35795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:03.842243 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ff475-04a2-4067-8bc2-d53daac35795 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:03.842528 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ff475-04a2-4067-8bc2-d53daac35795 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:03.842804 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ff475-04a2-4067-8bc2-d53daac35795 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:03.851114 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ff475-04a2-4067-8bc2-d53daac35795 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:03.852691 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ff475-04a2-4067-8bc2-d53daac35795 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:03.864772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-c07ff475-04a2-4067-8bc2-d53daac35795 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 04:06:03.864772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:03.864772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:03.864772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:03.864772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:03.864772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:03.864772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:03.864772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:03.864772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:03.864772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:03.864772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:03.864772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:03.864772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:06:03.864772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:06:03.864772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:06:03.864772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:06:03.865839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:03.865839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:03.865839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:06:03.865839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:06:03.865839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:06:03.865839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:06:03.865839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:03.865839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:03.865839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:03.865839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:03.865839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:03.865839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:03.865839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:03.865839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:03.865839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:03.865839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:03.865839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:03.865839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:03.866903 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:03.866903 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:03.866903 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:06:03.866903 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:06:03.866903 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:06:03.866903 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:06:03.866903 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:06:03.866903 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:06:03.866903 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 04:06:03.866903 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:03.866903 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 363/731] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:06:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:03.871620 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a66ef4-60a7-49c4-aadb-905b5effb44d None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:03.978126 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a66ef4-60a7-49c4-aadb-905b5effb44d None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:04.014430 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191ba9f-be3a-49e0-8ec1-8e35d68a5795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:04.015084 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191ba9f-be3a-49e0-8ec1-8e35d68a5795 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:04.015367 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191ba9f-be3a-49e0-8ec1-8e35d68a5795 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:04.015644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191ba9f-be3a-49e0-8ec1-8e35d68a5795 None admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:04.016466 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191ba9f-be3a-49e0-8ec1-8e35d68a5795 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:04.016775 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191ba9f-be3a-49e0-8ec1-8e35d68a5795 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:04.018267 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191ba9f-be3a-49e0-8ec1-8e35d68a5795 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:04.028806 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92eb12-21e6-4854-8c59-82b5a84bc390 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:04.029082 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92eb12-21e6-4854-8c59-82b5a84bc390 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:04.029386 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92eb12-21e6-4854-8c59-82b5a84bc390 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:04.030884 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 364/732] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 04:06:04.036066 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d846671-424c-47cd-9d9d-a01153868116 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:04.036594 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d846671-424c-47cd-9d9d-a01153868116 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:04.037137 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d846671-424c-47cd-9d9d-a01153868116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:04.041937 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 369/733] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Aug 23 04:06:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:04.050156 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191ba9f-be3a-49e0-8ec1-8e35d68a5795 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:04.057342 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-1d846671-424c-47cd-9d9d-a01153868116 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:04.058802 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-1d846671-424c-47cd-9d9d-a01153868116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:04.072948 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:04.074420 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:04.151318 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 365/734] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:04 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 04:06:04.152311 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d846671-424c-47cd-9d9d-a01153868116 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:04.183523 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191ba9f-be3a-49e0-8ec1-8e35d68a5795 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:04.258551 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c4d2e-3561-41a9-b21f-d48746bae7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:04.260705 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c4d2e-3561-41a9-b21f-d48746bae7b4 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:04.261189 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c4d2e-3561-41a9-b21f-d48746bae7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:04.262582 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c4d2e-3561-41a9-b21f-d48746bae7b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:04.365319 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d846671-424c-47cd-9d9d-a01153868116 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:04.406679 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c4d2e-3561-41a9-b21f-d48746bae7b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:04.408465 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c4d2e-3561-41a9-b21f-d48746bae7b4 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:04.409112 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cdb61-b798-4485-b2e3-a9c144876f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:04.410667 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cdb61-b798-4485-b2e3-a9c144876f4e None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:04.411364 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cdb61-b798-4485-b2e3-a9c144876f4e None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:04.412979 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cdb61-b798-4485-b2e3-a9c144876f4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:04.427424 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cdb61-b798-4485-b2e3-a9c144876f4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:06:04.429357 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:04.437573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-a70cdb61-b798-4485-b2e3-a9c144876f4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:06:04.437573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:04.437573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:04.437573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:04.437573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:04.437573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:04.437573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:04.437573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:04.437573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:04.437573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:04.437573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:04.437573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:04.437573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:06:04.437573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:06:04.437573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:06:04.437573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:06:04.440560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:06:04.440560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:06:04.440560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:06:04.440560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:06:04.440560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:04.440560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:04.440560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:04.440560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:04.440560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:04.440560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:04.440560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:04.440560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:04.440560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:04.440560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:04.440560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:04.440560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:04.441990 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:04.441990 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:04.441990 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:04.441990 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:04.441990 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:06:04.441990 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:06:04.441990 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:06:04.441990 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:06:04.441990 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:06:04.441990 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:06:04.441990 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:06:04.441990 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:04.441990 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 366/735] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:06:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:04.441990 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca753b-cbc3-4784-9ddd-372a6afe1542 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:04.442757 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca753b-cbc3-4784-9ddd-372a6afe1542 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:04.442757 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca753b-cbc3-4784-9ddd-372a6afe1542 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:04.442757 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 367/736] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:04.443440 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca753b-cbc3-4784-9ddd-372a6afe1542 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:04.455524 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:04.523184 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 370/737] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:06:04 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 04:06:04.524032 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c4d2e-3561-41a9-b21f-d48746bae7b4 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:04.563479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca753b-cbc3-4784-9ddd-372a6afe1542 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:04.599531 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f677a-28dd-4da1-bb9a-92a928cad363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:04.600147 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f677a-28dd-4da1-bb9a-92a928cad363 None admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:04.600433 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f677a-28dd-4da1-bb9a-92a928cad363 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:04.600713 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f677a-28dd-4da1-bb9a-92a928cad363 None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:04.601392 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f677a-28dd-4da1-bb9a-92a928cad363 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:04.602764 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f677a-28dd-4da1-bb9a-92a928cad363 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:04.626508 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c4d2e-3561-41a9-b21f-d48746bae7b4 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:04.642862 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:04.660294 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26648dc1-9b02-456b-ab4c-fda18cd6c34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:04.660897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26648dc1-9b02-456b-ab4c-fda18cd6c34d None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:04.661207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26648dc1-9b02-456b-ab4c-fda18cd6c34d None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:04.661480 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26648dc1-9b02-456b-ab4c-fda18cd6c34d None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:04.662146 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26648dc1-9b02-456b-ab4c-fda18cd6c34d None admin] RBAC: Adding query filter params (name=admin) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:04.662449 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26648dc1-9b02-456b-ab4c-fda18cd6c34d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:04.663830 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26648dc1-9b02-456b-ab4c-fda18cd6c34d None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:04.670803 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 368/738] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 23 04:06:04 2022] POST /identity/v3/services => generated 240 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:06:04.675621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556368df-2af8-4df8-b2da-de12dad1b89d None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:04.675621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556368df-2af8-4df8-b2da-de12dad1b89d None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:04.675621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556368df-2af8-4df8-b2da-de12dad1b89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:04.677109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 371/739] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:06:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:04.678107 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26648dc1-9b02-456b-ab4c-fda18cd6c34d None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:04.709652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-556368df-2af8-4df8-b2da-de12dad1b89d None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:04.711921 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-556368df-2af8-4df8-b2da-de12dad1b89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:04.797801 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26648dc1-9b02-456b-ab4c-fda18cd6c34d None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:04.800191 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:04.815947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 369/740] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:04.817949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556368df-2af8-4df8-b2da-de12dad1b89d None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:04.865249 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f94ba-2f33-4d3a-8e42-12e23301f0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:04.865901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f94ba-2f33-4d3a-8e42-12e23301f0e4 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:04.866184 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f94ba-2f33-4d3a-8e42-12e23301f0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:04.866460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f94ba-2f33-4d3a-8e42-12e23301f0e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:04.881274 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f94ba-2f33-4d3a-8e42-12e23301f0e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:04.882741 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f94ba-2f33-4d3a-8e42-12e23301f0e4 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:04.903523 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-0b9f94ba-2f33-4d3a-8e42-12e23301f0e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:04.903523 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:04.903523 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:04.903523 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:04.903523 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:04.903523 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:04.903523 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:04.903523 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:04.903523 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:04.903523 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:04.903523 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:04.903523 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:04.903523 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:06:04.903523 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:06:04.903523 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:06:04.903523 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:06:04.904575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:04.904575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:04.904575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:04.904575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:04.904575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:04.904575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:04.904575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:04.904575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:04.904575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:04.904575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:04.904575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:04.904575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:04.904575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:04.904575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:04.904575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:04.904575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:04.904575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:06:04.906139 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:06:04.906139 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:04.906139 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:04.906139 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 372/741] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:04.910967 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f94ba-2f33-4d3a-8e42-12e23301f0e4 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:04.943807 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556368df-2af8-4df8-b2da-de12dad1b89d None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:04.950120 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:04.992686 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc60f47-9cc1-4c12-b744-6323c842b133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:04.993519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc60f47-9cc1-4c12-b744-6323c842b133 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:04.993963 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc60f47-9cc1-4c12-b744-6323c842b133 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:04.994312 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc60f47-9cc1-4c12-b744-6323c842b133 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:05.006569 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc60f47-9cc1-4c12-b744-6323c842b133 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:05.008030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc60f47-9cc1-4c12-b744-6323c842b133 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:05.026552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-efc60f47-9cc1-4c12-b744-6323c842b133 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:05.026552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:05.026552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:05.026552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:05.026552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:05.026552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:05.026552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:05.026552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:05.026552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:05.026552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:05.026552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:05.026552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:05.026552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:06:05.026552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:06:05.026552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:06:05.026552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:06:05.028562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:05.028562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:05.028562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:05.028562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:05.028562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:05.028562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:05.028562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:05.028562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:05.028562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:05.028562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:05.028562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:05.028562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:05.028562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:05.028562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:05.028562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:05.028562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:05.028562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:06:05.030709 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:06:05.030709 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:05.030709 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:05.030709 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 370/742] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:05.037514 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc60f47-9cc1-4c12-b744-6323c842b133 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:05.040865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f94ba-2f33-4d3a-8e42-12e23301f0e4 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:05.084596 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387ff20-64b6-4c10-9691-0131444d525b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:05.085307 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387ff20-64b6-4c10-9691-0131444d525b None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:05.086658 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387ff20-64b6-4c10-9691-0131444d525b None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:05.088303 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387ff20-64b6-4c10-9691-0131444d525b None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:05.089748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387ff20-64b6-4c10-9691-0131444d525b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:05.090056 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387ff20-64b6-4c10-9691-0131444d525b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:05.092117 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387ff20-64b6-4c10-9691-0131444d525b None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:05.119884 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 373/743] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:05.126195 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387ff20-64b6-4c10-9691-0131444d525b None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:05.132467 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:05.192670 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc60f47-9cc1-4c12-b744-6323c842b133 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:05.228246 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e997dd-b8e0-459f-b94b-542df63ee532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:05.228855 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e997dd-b8e0-459f-b94b-542df63ee532 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:05.229173 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e997dd-b8e0-459f-b94b-542df63ee532 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:05.229453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e997dd-b8e0-459f-b94b-542df63ee532 None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:05.230103 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e997dd-b8e0-459f-b94b-542df63ee532 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:05.230406 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e997dd-b8e0-459f-b94b-542df63ee532 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:05.231909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e997dd-b8e0-459f-b94b-542df63ee532 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:05.245475 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 371/744] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:05.250832 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:05.250984 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e997dd-b8e0-459f-b94b-542df63ee532 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:05.263476 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387ff20-64b6-4c10-9691-0131444d525b None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:05.312852 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff114d9-5892-492a-a3f5-c91acb09c602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:05.314044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff114d9-5892-492a-a3f5-c91acb09c602 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:05.315047 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff114d9-5892-492a-a3f5-c91acb09c602 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:05.315707 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff114d9-5892-492a-a3f5-c91acb09c602 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:05.325436 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff114d9-5892-492a-a3f5-c91acb09c602 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:05.327941 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff114d9-5892-492a-a3f5-c91acb09c602 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:05.344071 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-aff114d9-5892-492a-a3f5-c91acb09c602 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:06:05.344071 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:05.344071 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:05.344071 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:05.344071 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:05.344071 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:05.344071 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:05.344071 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:05.344071 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:05.344071 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:05.344071 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:05.344071 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:05.344071 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:06:05.344071 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:06:05.344071 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:06:05.345204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:06:05.345204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:05.345204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:05.345204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:05.345204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:05.345204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:05.345204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:05.345204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:05.345204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:05.345204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:05.345204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:05.345204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:05.345204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:05.345204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:05.345204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:05.345204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:05.345204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:05.346127 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:06:05.346127 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:06:05.346127 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:06:05.346127 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:06:05.346127 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:06:05.346127 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:06:05.346127 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:06:05.346127 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:05.346579 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 374/745] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:06:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:05.347527 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff114d9-5892-492a-a3f5-c91acb09c602 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:05.368601 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e997dd-b8e0-459f-b94b-542df63ee532 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:05.381976 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:05.414653 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92c339-9c43-48af-8656-d612c4d842e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:05.415589 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92c339-9c43-48af-8656-d612c4d842e8 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:05.415875 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92c339-9c43-48af-8656-d612c4d842e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:05.416550 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92c339-9c43-48af-8656-d612c4d842e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:05.429875 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92c339-9c43-48af-8656-d612c4d842e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:06:05.436268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-0b92c339-9c43-48af-8656-d612c4d842e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:06:05.436268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:05.436268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:05.436268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:05.436268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:05.436268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:05.436268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:05.436268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:05.436268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:05.436268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:05.436268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:05.436268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:05.436268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:06:05.436268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:06:05.436268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:06:05.436268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:06:05.437269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:06:05.437269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:06:05.437269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:06:05.437269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:06:05.437269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:05.437269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:05.437269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:05.437269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:05.437269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:05.437269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:05.437269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:05.437269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:05.437269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:05.437269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:05.437269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:05.437269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:05.438144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:05.438144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:05.438144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:05.438144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:05.438144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:06:05.438144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:06:05.438144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:06:05.438144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:06:05.438144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:06:05.438144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:06:05.438144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:06:05.438144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:05.438144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 372/746] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 23 04:06:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:05.439041 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92c339-9c43-48af-8656-d612c4d842e8 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:05.469652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff114d9-5892-492a-a3f5-c91acb09c602 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:05.510697 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4032e1f-6fdb-4e51-a683-a09b0c224037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:05.511436 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4032e1f-6fdb-4e51-a683-a09b0c224037 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:05.511771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4032e1f-6fdb-4e51-a683-a09b0c224037 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:05.512045 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4032e1f-6fdb-4e51-a683-a09b0c224037 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:05.521611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4032e1f-6fdb-4e51-a683-a09b0c224037 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:05.523091 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4032e1f-6fdb-4e51-a683-a09b0c224037 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:05.535830 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-c4032e1f-6fdb-4e51-a683-a09b0c224037 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 04:06:05.535830 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:05.535830 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:05.535830 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:05.535830 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:05.535830 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:05.535830 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:05.535830 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:05.535830 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:05.535830 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:05.535830 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:05.535830 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:05.535830 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:06:05.535830 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:06:05.535830 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:06:05.535830 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:06:05.536944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:05.536944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:05.536944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:06:05.536944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:06:05.536944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:06:05.536944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:06:05.536944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:05.536944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:05.536944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:05.536944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:05.536944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:05.536944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:05.536944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:05.536944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:05.536944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:05.536944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:05.536944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:05.536944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:05.537930 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:05.537930 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:05.537930 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:06:05.537930 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:06:05.537930 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:06:05.537930 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:06:05.537930 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:06:05.537930 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:06:05.537930 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 04:06:05.537930 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:05.541617 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 375/747] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Aug 23 04:06:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:05.542469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4032e1f-6fdb-4e51-a683-a09b0c224037 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:05.556049 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:05.582798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92c339-9c43-48af-8656-d612c4d842e8 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:05.631829 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed99017-0430-45fb-96b1-799227482634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:05.633062 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed99017-0430-45fb-96b1-799227482634 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:05.633581 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed99017-0430-45fb-96b1-799227482634 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:05.634072 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed99017-0430-45fb-96b1-799227482634 None admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:05.635677 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed99017-0430-45fb-96b1-799227482634 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:05.636189 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed99017-0430-45fb-96b1-799227482634 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:05.638331 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed99017-0430-45fb-96b1-799227482634 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:05.654738 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4032e1f-6fdb-4e51-a683-a09b0c224037 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:05.655688 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 373/748] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:06:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:05.656691 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed99017-0430-45fb-96b1-799227482634 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:05.693363 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:05.698195 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0cbcab-81b6-4d8f-bc49-cf753cfd15a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:05.698904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0cbcab-81b6-4d8f-bc49-cf753cfd15a8 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:05.699387 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0cbcab-81b6-4d8f-bc49-cf753cfd15a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:05.699623 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0cbcab-81b6-4d8f-bc49-cf753cfd15a8 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:05.700404 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0cbcab-81b6-4d8f-bc49-cf753cfd15a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:05.700779 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0cbcab-81b6-4d8f-bc49-cf753cfd15a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:05.702334 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0cbcab-81b6-4d8f-bc49-cf753cfd15a8 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:05.715558 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 376/749] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 23 04:06:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:05.715558 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0cbcab-81b6-4d8f-bc49-cf753cfd15a8 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:05.791364 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:05.799504 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed99017-0430-45fb-96b1-799227482634 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:05.824141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0cbcab-81b6-4d8f-bc49-cf753cfd15a8 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:05.846562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897f1dc-e164-4650-a02a-68d23943a5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:05.847670 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897f1dc-e164-4650-a02a-68d23943a5da None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:05.848127 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897f1dc-e164-4650-a02a-68d23943a5da None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:05.848723 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897f1dc-e164-4650-a02a-68d23943a5da None admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:05.849947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897f1dc-e164-4650-a02a-68d23943a5da None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:05.850669 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897f1dc-e164-4650-a02a-68d23943a5da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:05.852881 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897f1dc-e164-4650-a02a-68d23943a5da None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:05.861133 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4f615-bc19-41ce-939e-b5534b32b67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:05.861872 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4f615-bc19-41ce-939e-b5534b32b67f None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:05.862271 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4f615-bc19-41ce-939e-b5534b32b67f None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:05.862750 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4f615-bc19-41ce-939e-b5534b32b67f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:05.864192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4f615-bc19-41ce-939e-b5534b32b67f None admin] RBAC: Adding query filter params (role.id=255d9e4004c54505a7cda1b8af74e5f1, scope.project.id=a7ada12a1e3a42949c00f483efd522ba, user.id=63190c62bc92403880ffaedc4737485a) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:05.864607 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4f615-bc19-41ce-939e-b5534b32b67f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:05.866373 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4f615-bc19-41ce-939e-b5534b32b67f None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:05.881472 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 377/750] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:06:05 2022] GET /identity/v3/role_assignments?user.id=63190c62bc92403880ffaedc4737485a&scope.project.id=a7ada12a1e3a42949c00f483efd522ba&role.id=255d9e4004c54505a7cda1b8af74e5f1 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:05.882717 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4f615-bc19-41ce-939e-b5534b32b67f None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:06.001884 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 374/751] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Aug 23 04:06:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:06.003337 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbeecb-7edd-422f-9f06-b1d4bf56aa07 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:06.003521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbeecb-7edd-422f-9f06-b1d4bf56aa07 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:06.003856 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbeecb-7edd-422f-9f06-b1d4bf56aa07 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:06.009411 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 375/752] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:06.010356 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cbeecb-7edd-422f-9f06-b1d4bf56aa07 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:06.013937 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4f615-bc19-41ce-939e-b5534b32b67f None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:06.073128 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f8572-62f7-4e5d-9ec0-9507fb9e821f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:06.073791 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f8572-62f7-4e5d-9ec0-9507fb9e821f None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:06.074340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f8572-62f7-4e5d-9ec0-9507fb9e821f None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:06.074624 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f8572-62f7-4e5d-9ec0-9507fb9e821f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:06.078494 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:06.089878 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f8572-62f7-4e5d-9ec0-9507fb9e821f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:06.092088 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f8572-62f7-4e5d-9ec0-9507fb9e821f None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:06.111451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-ae3f8572-62f7-4e5d-9ec0-9507fb9e821f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:06.111451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:06.111451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:06.111451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:06.111451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:06.111451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:06.111451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:06.111451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:06.111451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:06.111451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:06.111451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:06.111451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:06.111451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:06:06.111451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:06:06.111451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:06:06.111451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:06:06.112463 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:06.112463 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:06.112463 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:06.112463 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:06.112463 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:06.112463 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:06.112463 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:06.112463 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:06.112463 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:06.112463 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:06.112463 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:06.112463 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:06.112463 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:06.112463 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:06.112463 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:06.112463 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:06.112463 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:06:06.113439 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:06:06.113439 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:06.113439 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:06.113613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:06.114108 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 378/753] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:06.116095 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd00b8-882a-47c2-94cf-150bd8eecc39 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:06.116598 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd00b8-882a-47c2-94cf-150bd8eecc39 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:06.117064 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd00b8-882a-47c2-94cf-150bd8eecc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:06.136571 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cbeecb-7edd-422f-9f06-b1d4bf56aa07 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:06.141762 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-b0fd00b8-882a-47c2-94cf-150bd8eecc39 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:06.143382 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-b0fd00b8-882a-47c2-94cf-150bd8eecc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:06.179026 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73320455-e6a8-4c50-aab5-3894cb0ffb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:06.179780 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73320455-e6a8-4c50-aab5-3894cb0ffb5a None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:06.180061 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73320455-e6a8-4c50-aab5-3894cb0ffb5a None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:06.180335 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73320455-e6a8-4c50-aab5-3894cb0ffb5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:06.191919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73320455-e6a8-4c50-aab5-3894cb0ffb5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:06.193401 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73320455-e6a8-4c50-aab5-3894cb0ffb5a None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:06.210115 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-73320455-e6a8-4c50-aab5-3894cb0ffb5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:06.210115 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:06.210115 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:06.210115 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:06.210115 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:06.210115 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:06.210115 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:06.210115 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:06.210115 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:06.210115 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:06.210115 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:06.210115 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:06.210115 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:06:06.210115 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:06:06.210115 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:06:06.210115 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:06:06.211153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:06.211153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:06.211153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:06.211153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:06.211153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:06.211153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:06.211153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:06.211153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:06.211153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:06.211153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:06.211153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:06.211153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:06.211153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:06.211153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:06.211153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:06.211153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:06.211153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:06:06.212093 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:06:06.212093 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:06.212093 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:06.216104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 376/754] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:06.217369 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73320455-e6a8-4c50-aab5-3894cb0ffb5a None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:06.233212 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 379/755] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:06.234417 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd00b8-882a-47c2-94cf-150bd8eecc39 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:06.327416 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73320455-e6a8-4c50-aab5-3894cb0ffb5a None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:06.364329 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3f3f2-36ad-4be0-8d97-b09161386229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:06.364950 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3f3f2-36ad-4be0-8d97-b09161386229 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:06.365264 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3f3f2-36ad-4be0-8d97-b09161386229 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:06.365538 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3f3f2-36ad-4be0-8d97-b09161386229 None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:06.366196 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3f3f2-36ad-4be0-8d97-b09161386229 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:06.366502 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3f3f2-36ad-4be0-8d97-b09161386229 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:06.367929 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3f3f2-36ad-4be0-8d97-b09161386229 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:06.370580 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:06.382519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 377/756] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:06.390268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3f3f2-36ad-4be0-8d97-b09161386229 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:06.428368 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd00b8-882a-47c2-94cf-150bd8eecc39 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:06.467122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:06.496549 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd1544-cd7d-4284-b5c2-467d2f7c918e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:06.497107 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd1544-cd7d-4284-b5c2-467d2f7c918e None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:06.497421 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd1544-cd7d-4284-b5c2-467d2f7c918e None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:06.498572 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd1544-cd7d-4284-b5c2-467d2f7c918e None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:06.499591 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd1544-cd7d-4284-b5c2-467d2f7c918e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:06.501202 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd1544-cd7d-4284-b5c2-467d2f7c918e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:06.502618 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd1544-cd7d-4284-b5c2-467d2f7c918e None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:06.525072 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 380/757] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:06.526480 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd1544-cd7d-4284-b5c2-467d2f7c918e None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:06.584666 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3f3f2-36ad-4be0-8d97-b09161386229 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:06.630870 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8dbbab-31c1-4c14-81b8-98d702e5db5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:06.631513 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dbbab-31c1-4c14-81b8-98d702e5db5a None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:06.631797 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dbbab-31c1-4c14-81b8-98d702e5db5a None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:06.632068 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dbbab-31c1-4c14-81b8-98d702e5db5a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:06.640485 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8dbbab-31c1-4c14-81b8-98d702e5db5a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:06.641965 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8dbbab-31c1-4c14-81b8-98d702e5db5a None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:06.654632 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-9e8dbbab-31c1-4c14-81b8-98d702e5db5a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 04:06:06.654632 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:06.654632 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:06.654632 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:06.654632 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:06.654632 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:06.654632 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:06.654632 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:06.654632 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:06.654632 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:06.654632 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:06.654632 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:06.654632 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:06:06.654632 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:06:06.654632 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:06:06.654632 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:06:06.655683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:06.655683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:06.655683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:06:06.655683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:06:06.655683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:06:06.655683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:06:06.655683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:06.655683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:06.655683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:06.655683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:06.655683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:06.655683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:06.655683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:06.655683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:06.655683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:06.655683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:06.655683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:06.655683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:06.656646 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:06.656646 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:06.656646 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:06:06.656646 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:06:06.656646 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:06:06.656646 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:06:06.656646 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:06:06.656646 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:06:06.656646 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 04:06:06.656646 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:06.656646 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 378/758] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Aug 23 04:06:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:06.657310 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8dbbab-31c1-4c14-81b8-98d702e5db5a None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:06.673147 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd1544-cd7d-4284-b5c2-467d2f7c918e None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:06.716853 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b290c-c8f6-40b8-b38f-27ac13c2a573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:06.717931 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b290c-c8f6-40b8-b38f-27ac13c2a573 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:06.718226 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b290c-c8f6-40b8-b38f-27ac13c2a573 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:06.718506 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b290c-c8f6-40b8-b38f-27ac13c2a573 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:06.725715 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:06.728921 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b290c-c8f6-40b8-b38f-27ac13c2a573 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:06.731027 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b290c-c8f6-40b8-b38f-27ac13c2a573 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:06.745504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-c32b290c-c8f6-40b8-b38f-27ac13c2a573 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:06:06.745504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:06.745504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:06.745504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:06.745504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:06.745504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:06.745504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:06.745504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:06.745504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:06.745504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:06.745504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:06.745504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:06.745504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:06:06.745504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:06:06.745504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:06:06.746408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:06:06.746408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:06.746408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:06.746408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:06.746408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:06.746408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:06.746408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:06.746408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:06.746408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:06.746408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:06.746408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:06.746408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:06.746408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:06.746408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:06.746408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:06.746408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:06.746408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:06.747377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:06:06.747377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:06:06.747377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:06:06.747377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:06:06.747377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:06:06.747377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:06:06.747377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:06:06.747377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:06.751399 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 381/759] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:06:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:06.752256 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b290c-c8f6-40b8-b38f-27ac13c2a573 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:06.781719 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8dbbab-31c1-4c14-81b8-98d702e5db5a None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:06.795898 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:06.829245 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b048c-ac92-4501-a5fc-69b2d2a96cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:06.830137 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b048c-ac92-4501-a5fc-69b2d2a96cd4 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:06.830606 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b048c-ac92-4501-a5fc-69b2d2a96cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:06.830879 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b048c-ac92-4501-a5fc-69b2d2a96cd4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:06.831499 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b048c-ac92-4501-a5fc-69b2d2a96cd4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:06.832970 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b048c-ac92-4501-a5fc-69b2d2a96cd4 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:06.845424 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-9b9b048c-ac92-4501-a5fc-69b2d2a96cd4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 04:06:06.845424 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:06.845424 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 04:06:06.845424 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 04:06:06.845424 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 04:06:06.845424 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 04:06:06.845424 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 04:06:06.845424 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:06.845424 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 04:06:06.845424 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:06.845424 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 04:06:06.845424 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:06.845424 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:06.845424 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:06.845424 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:06.845424 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:06.845424 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:06.846549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:06.846549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:06.846549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:06.846549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:06.846549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:06.846549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:06.846549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 04:06:06.846549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 04:06:06.846549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 04:06:06.846549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 04:06:06.846549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:06.846549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:06.846549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:06.846549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:06.846549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:06.846549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:06.847956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:06.847956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:06.847956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:06.847956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:06.847956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:06.847956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:06.847956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:06.847956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:06.847956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:06.847956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:06.847956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 04:06:06.847956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:06.847956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 04:06:06.847956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:06.847956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 379/760] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Aug 23 04:06:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:06.849354 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b048c-ac92-4501-a5fc-69b2d2a96cd4 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:06.905735 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b290c-c8f6-40b8-b38f-27ac13c2a573 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:06.949710 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8846b33-bd9f-4e3f-8d16-c02029061dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:06.950236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8846b33-bd9f-4e3f-8d16-c02029061dce None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:06.950633 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8846b33-bd9f-4e3f-8d16-c02029061dce None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:06.950920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8846b33-bd9f-4e3f-8d16-c02029061dce None admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:06.951673 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8846b33-bd9f-4e3f-8d16-c02029061dce None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:06.951985 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8846b33-bd9f-4e3f-8d16-c02029061dce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:06.953528 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8846b33-bd9f-4e3f-8d16-c02029061dce None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:06.969189 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b048c-ac92-4501-a5fc-69b2d2a96cd4 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:06.979209 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 382/761] 10.222.0.42 () {56 vars in 1149 bytes} [Tue Aug 23 04:06:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:06.979209 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8846b33-bd9f-4e3f-8d16-c02029061dce None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:06.997829 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:07.015443 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16865b53-b48a-4c8e-ab9a-b0647a603aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:07.016164 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16865b53-b48a-4c8e-ab9a-b0647a603aa6 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:07.016511 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16865b53-b48a-4c8e-ab9a-b0647a603aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:07.016850 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16865b53-b48a-4c8e-ab9a-b0647a603aa6 None admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:07.017718 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16865b53-b48a-4c8e-ab9a-b0647a603aa6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:07.018100 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16865b53-b48a-4c8e-ab9a-b0647a603aa6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:07.020156 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16865b53-b48a-4c8e-ab9a-b0647a603aa6 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:07.040786 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 380/762] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:06:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:07.040786 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f51a6f-a7e4-4c91-9047-c3db8cd2f814 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:07.040786 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f51a6f-a7e4-4c91-9047-c3db8cd2f814 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:07.040786 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f51a6f-a7e4-4c91-9047-c3db8cd2f814 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:07.040786 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 381/763] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:07.041982 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f51a6f-a7e4-4c91-9047-c3db8cd2f814 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:07.083865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:07.089977 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8846b33-bd9f-4e3f-8d16-c02029061dce None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:07.124331 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6754943-67cb-48fc-96cb-443d0c23de8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:07.125070 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6754943-67cb-48fc-96cb-443d0c23de8a None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:07.125472 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6754943-67cb-48fc-96cb-443d0c23de8a None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:07.125809 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6754943-67cb-48fc-96cb-443d0c23de8a None admin] PATH_INFO: `/v3/services` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:07.126525 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6754943-67cb-48fc-96cb-443d0c23de8a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:07.126894 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6754943-67cb-48fc-96cb-443d0c23de8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:07.128327 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6754943-67cb-48fc-96cb-443d0c23de8a None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:07.137171 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 383/764] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Aug 23 04:06:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:07.137171 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6754943-67cb-48fc-96cb-443d0c23de8a None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:07.164189 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f51a6f-a7e4-4c91-9047-c3db8cd2f814 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:07.199867 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5faa611-de3c-4a35-9b05-90e7790f4ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:07.200688 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5faa611-de3c-4a35-9b05-90e7790f4ca2 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:07.201033 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5faa611-de3c-4a35-9b05-90e7790f4ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:07.201426 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5faa611-de3c-4a35-9b05-90e7790f4ca2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:07.234017 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6754943-67cb-48fc-96cb-443d0c23de8a None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:07.252332 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:07.267245 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386b648-926a-48a4-ab5a-494098a775eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:07.267907 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386b648-926a-48a4-ab5a-494098a775eb None admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:07.268191 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386b648-926a-48a4-ab5a-494098a775eb None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:07.268465 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386b648-926a-48a4-ab5a-494098a775eb None admin] PATH_INFO: `/v3/projects/a7ada12a1e3a42949c00f483efd522ba/users/1e0236a0acac4b87be977878b5186551/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:07.273300 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386b648-926a-48a4-ab5a-494098a775eb None admin] RBAC: Authorizing `identity:create_grant(project_id=a7ada12a1e3a42949c00f483efd522ba, user_id=1e0236a0acac4b87be977878b5186551, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:07.274470 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5faa611-de3c-4a35-9b05-90e7790f4ca2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:07.274733 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386b648-926a-48a4-ab5a-494098a775eb None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:07.276376 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5faa611-de3c-4a35-9b05-90e7790f4ca2 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:07.346688 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 384/765] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 23 04:06:07 2022] PUT /identity/v3/projects/a7ada12a1e3a42949c00f483efd522ba/users/1e0236a0acac4b87be977878b5186551/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:06:07.349115 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243651c-5276-4b39-b66d-59cf521f1684 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:07.349652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243651c-5276-4b39-b66d-59cf521f1684 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:07.350657 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243651c-5276-4b39-b66d-59cf521f1684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:07.380653 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-c243651c-5276-4b39-b66d-59cf521f1684 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:07.382330 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-c243651c-5276-4b39-b66d-59cf521f1684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:07.402772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 382/766] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:06:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 04:06:07.403724 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5faa611-de3c-4a35-9b05-90e7790f4ca2 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:07.415205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:07.506696 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 385/767] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:07.506696 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243651c-5276-4b39-b66d-59cf521f1684 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:07.511172 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:07.536866 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5faa611-de3c-4a35-9b05-90e7790f4ca2 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:07.578294 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351db68-42a5-4675-8123-02a43c80607c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:07.579360 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351db68-42a5-4675-8123-02a43c80607c None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:07.579937 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351db68-42a5-4675-8123-02a43c80607c None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:07.580215 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351db68-42a5-4675-8123-02a43c80607c None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:07.580854 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351db68-42a5-4675-8123-02a43c80607c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:07.581199 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351db68-42a5-4675-8123-02a43c80607c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:07.583152 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351db68-42a5-4675-8123-02a43c80607c None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:07.593115 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 383/768] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Aug 23 04:06:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:07.595826 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351db68-42a5-4675-8123-02a43c80607c None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:07.654038 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243651c-5276-4b39-b66d-59cf521f1684 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:07.697231 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d05e19-5c04-4076-9824-0b1e7753d6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:07.698266 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d05e19-5c04-4076-9824-0b1e7753d6df None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:07.698816 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d05e19-5c04-4076-9824-0b1e7753d6df None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:07.699302 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d05e19-5c04-4076-9824-0b1e7753d6df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:07.711850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d05e19-5c04-4076-9824-0b1e7753d6df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:07.713784 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d05e19-5c04-4076-9824-0b1e7753d6df None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:07.731193 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-68d05e19-5c04-4076-9824-0b1e7753d6df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:07.731193 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:07.731193 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:07.731193 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:07.731193 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:07.731193 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:07.731193 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:07.731193 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:07.731193 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:07.731193 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:07.731193 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:07.731193 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:07.731193 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:06:07.731193 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:06:07.731193 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:06:07.731193 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:06:07.732210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:07.732210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:07.732210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:07.732210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:07.732210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:07.732210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:07.732210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:07.732210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:07.732210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:07.732210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:07.732210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:07.732210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:07.732210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:07.732210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:07.732210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:07.732210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:07.732210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:06:07.733152 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:06:07.733152 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:07.733152 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:07.735697 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 386/769] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:07.741562 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d05e19-5c04-4076-9824-0b1e7753d6df None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:07.745058 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:07.761442 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351db68-42a5-4675-8123-02a43c80607c None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:07.817131 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c0d45-16cd-4d36-89cb-6806b0a78740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:07.818387 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c0d45-16cd-4d36-89cb-6806b0a78740 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:07.818877 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c0d45-16cd-4d36-89cb-6806b0a78740 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:07.819382 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c0d45-16cd-4d36-89cb-6806b0a78740 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:07.820387 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c0d45-16cd-4d36-89cb-6806b0a78740 None admin] RBAC: Adding query filter params (interface=public, service_id=8978b9bd624a4527a54d47afee3af8c1, region_id=RegionOne) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:07.820915 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c0d45-16cd-4d36-89cb-6806b0a78740 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:07.822504 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c0d45-16cd-4d36-89cb-6806b0a78740 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:07.832799 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 384/770] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Aug 23 04:06:07 2022] GET /identity/v3/endpoints?service_id=8978b9bd624a4527a54d47afee3af8c1&interface=public®ion_id=RegionOne => generated 194 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:07.838538 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c0d45-16cd-4d36-89cb-6806b0a78740 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:07.893512 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:07.921250 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d05e19-5c04-4076-9824-0b1e7753d6df None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:07.972865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e74bc9-960d-4b87-85fe-40aeed780d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:07.973523 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e74bc9-960d-4b87-85fe-40aeed780d1a None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:07.973807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e74bc9-960d-4b87-85fe-40aeed780d1a None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:07.974295 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e74bc9-960d-4b87-85fe-40aeed780d1a None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:07.974724 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e74bc9-960d-4b87-85fe-40aeed780d1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:07.975029 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e74bc9-960d-4b87-85fe-40aeed780d1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:07.976407 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e74bc9-960d-4b87-85fe-40aeed780d1a None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:07.996450 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 387/771] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:07.996450 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e74bc9-960d-4b87-85fe-40aeed780d1a None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:08.043060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c0d45-16cd-4d36-89cb-6806b0a78740 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:08.074383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:08.091198 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffbdc70-c984-4131-baaf-1437b73769e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:08.091824 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbdc70-c984-4131-baaf-1437b73769e1 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:08.092105 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbdc70-c984-4131-baaf-1437b73769e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:08.092436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbdc70-c984-4131-baaf-1437b73769e1 None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:08.093514 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffbdc70-c984-4131-baaf-1437b73769e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:08.095270 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffbdc70-c984-4131-baaf-1437b73769e1 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:08.109505 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 385/772] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Aug 23 04:06:07 2022] GET /identity/v3/services => generated 772 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:08.109505 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372355a-b4c0-4a1c-a1fc-81f9908c0ce2 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:08.109505 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372355a-b4c0-4a1c-a1fc-81f9908c0ce2 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:08.109505 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372355a-b4c0-4a1c-a1fc-81f9908c0ce2 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:08.109505 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 386/773] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:08.109505 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372355a-b4c0-4a1c-a1fc-81f9908c0ce2 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:08.144704 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e74bc9-960d-4b87-85fe-40aeed780d1a None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:08.197635 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec82b7-6f86-42b5-a541-117a094763ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:08.198401 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec82b7-6f86-42b5-a541-117a094763ab None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:08.198575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec82b7-6f86-42b5-a541-117a094763ab None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:08.201116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec82b7-6f86-42b5-a541-117a094763ab None admin] PATH_INFO: `/v3/services/network` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:08.201116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec82b7-6f86-42b5-a541-117a094763ab None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:08.201116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec82b7-6f86-42b5-a541-117a094763ab None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:08.218764 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-e2ec82b7-6f86-42b5-a541-117a094763ab None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 04:06:08.218764 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:08.218764 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 04:06:08.218764 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 04:06:08.218764 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 04:06:08.218764 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 04:06:08.218764 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 04:06:08.218764 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:08.218764 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 04:06:08.218764 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:08.218764 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 04:06:08.218764 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:08.218764 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:08.218764 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:08.218764 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:08.218764 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:08.218764 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:08.219859 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:08.219859 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:08.219859 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:08.219859 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:08.219859 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:08.219859 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:08.219859 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 04:06:08.219859 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 04:06:08.219859 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 04:06:08.219859 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 04:06:08.219859 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:08.219859 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:08.219859 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:08.219859 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:08.219859 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:08.219859 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:08.220748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:08.220748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:08.220748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:08.220748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:08.220748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:08.220748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:08.220748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:08.220748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:08.220748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:08.220748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:08.220748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 04:06:08.220748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:08.220748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 04:06:08.220748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:08.229121 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 388/774] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:06:07 2022] GET /identity/v3/services/network => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:08.231373 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189406d-c7e4-4ae3-ad36-8c225888914c None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:08.237124 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189406d-c7e4-4ae3-ad36-8c225888914c None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:08.237124 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189406d-c7e4-4ae3-ad36-8c225888914c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:08.245494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:08.272229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-4189406d-c7e4-4ae3-ad36-8c225888914c None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:08.273336 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-4189406d-c7e4-4ae3-ad36-8c225888914c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:08.301076 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372355a-b4c0-4a1c-a1fc-81f9908c0ce2 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:08.352224 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a03897-05f0-48ed-a6ae-922f2cc8fb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:08.353196 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a03897-05f0-48ed-a6ae-922f2cc8fb03 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:08.353510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a03897-05f0-48ed-a6ae-922f2cc8fb03 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:08.353789 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a03897-05f0-48ed-a6ae-922f2cc8fb03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:08.361708 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a03897-05f0-48ed-a6ae-922f2cc8fb03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:08.362219 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 389/775] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:08.363368 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a03897-05f0-48ed-a6ae-922f2cc8fb03 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:08.363664 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189406d-c7e4-4ae3-ad36-8c225888914c None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:08.377937 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-d8a03897-05f0-48ed-a6ae-922f2cc8fb03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:06:08.377937 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:08.377937 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:08.377937 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:08.377937 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:08.377937 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:08.377937 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:08.377937 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:08.377937 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:08.377937 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:08.377937 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:08.377937 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:08.377937 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:06:08.377937 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:06:08.377937 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:06:08.379414 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:06:08.379414 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:08.379414 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:08.379414 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:08.379414 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:08.379414 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:08.379414 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:08.379414 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:08.379414 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:08.379414 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:08.379414 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:08.379414 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:08.379414 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:08.379414 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:08.379414 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:08.379414 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:08.379414 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:08.380334 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:06:08.380334 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:06:08.380334 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:06:08.380334 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:06:08.380334 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:06:08.380334 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:06:08.380334 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:06:08.380334 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:08.380334 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 387/776] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:06:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:08.385594 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a03897-05f0-48ed-a6ae-922f2cc8fb03 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:08.437662 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:08.498741 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189406d-c7e4-4ae3-ad36-8c225888914c None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:08.541219 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a03897-05f0-48ed-a6ae-922f2cc8fb03 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:08.576135 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f17186-1af8-41ed-82c9-995771b27863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:08.577198 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f17186-1af8-41ed-82c9-995771b27863 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:08.577682 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f17186-1af8-41ed-82c9-995771b27863 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:08.578194 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f17186-1af8-41ed-82c9-995771b27863 None admin] PATH_INFO: `/v3/services` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:08.579022 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f17186-1af8-41ed-82c9-995771b27863 None admin] RBAC: Adding query filter params (name=network) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:08.579505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f17186-1af8-41ed-82c9-995771b27863 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:08.581201 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f17186-1af8-41ed-82c9-995771b27863 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:08.592284 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 390/777] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 23 04:06:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:08.598443 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f17186-1af8-41ed-82c9-995771b27863 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:08.606165 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:08.616768 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105503c-ff00-4c3c-bf3c-42af6744c94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:08.617505 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105503c-ff00-4c3c-bf3c-42af6744c94e None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:08.617778 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105503c-ff00-4c3c-bf3c-42af6744c94e None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:08.618054 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105503c-ff00-4c3c-bf3c-42af6744c94e None admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:08.618761 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105503c-ff00-4c3c-bf3c-42af6744c94e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:08.619068 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105503c-ff00-4c3c-bf3c-42af6744c94e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:08.620645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105503c-ff00-4c3c-bf3c-42af6744c94e None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:08.648303 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 388/778] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:06:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:08.658045 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105503c-ff00-4c3c-bf3c-42af6744c94e None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:08.718648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f17186-1af8-41ed-82c9-995771b27863 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:08.742667 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:08.759987 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2fedb6-0e67-42e6-9e14-d30e730d34b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:08.766624 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fedb6-0e67-42e6-9e14-d30e730d34b1 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:08.766624 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fedb6-0e67-42e6-9e14-d30e730d34b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:08.766624 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fedb6-0e67-42e6-9e14-d30e730d34b1 None admin] PATH_INFO: `/v3/services` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:08.766624 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2fedb6-0e67-42e6-9e14-d30e730d34b1 None admin] RBAC: Adding query filter params (type=network) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:08.766624 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2fedb6-0e67-42e6-9e14-d30e730d34b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:08.766624 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2fedb6-0e67-42e6-9e14-d30e730d34b1 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:08.773900 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 391/779] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 23 04:06:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:08.774854 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2fedb6-0e67-42e6-9e14-d30e730d34b1 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:08.805575 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105503c-ff00-4c3c-bf3c-42af6744c94e None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:08.843069 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe1176-d7b8-4d86-a806-44599b0fcc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:08.843796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe1176-d7b8-4d86-a806-44599b0fcc79 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:08.844168 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe1176-d7b8-4d86-a806-44599b0fcc79 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:08.844504 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe1176-d7b8-4d86-a806-44599b0fcc79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:08.845326 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe1176-d7b8-4d86-a806-44599b0fcc79 None admin] RBAC: Adding query filter params (role.id=e7c20cdfa0b64f71a716edf832519cbb, scope.project.id=a7ada12a1e3a42949c00f483efd522ba, user.id=826b9a7c343b4dbc9aeb3dbc0b75fc92) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:08.845722 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe1176-d7b8-4d86-a806-44599b0fcc79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:08.847337 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe1176-d7b8-4d86-a806-44599b0fcc79 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:08.853509 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 389/780] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:06:08 2022] GET /identity/v3/role_assignments?user.id=826b9a7c343b4dbc9aeb3dbc0b75fc92&scope.project.id=a7ada12a1e3a42949c00f483efd522ba&role.id=e7c20cdfa0b64f71a716edf832519cbb => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:08.854202 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe1176-d7b8-4d86-a806-44599b0fcc79 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:08.888354 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2fedb6-0e67-42e6-9e14-d30e730d34b1 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:08.918871 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:08.929800 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bbac0a-bc81-4633-89d0-4b24a4a28693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:08.930442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbac0a-bc81-4633-89d0-4b24a4a28693 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:08.930726 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbac0a-bc81-4633-89d0-4b24a4a28693 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:08.931002 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbac0a-bc81-4633-89d0-4b24a4a28693 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:08.943056 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bbac0a-bc81-4633-89d0-4b24a4a28693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:06:08.951508 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-98bbac0a-bc81-4633-89d0-4b24a4a28693 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:06:08.951508 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:08.951508 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:08.951508 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:08.951508 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:08.951508 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:08.951508 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:08.951508 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:08.951508 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:08.951508 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:08.951508 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:08.951508 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:08.951508 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:06:08.951508 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:06:08.951508 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:06:08.951508 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:06:08.953803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:06:08.953803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:06:08.953803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:06:08.953803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:06:08.953803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:08.953803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:08.953803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:08.953803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:08.953803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:08.953803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:08.953803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:08.953803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:08.953803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:08.953803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:08.953803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:08.953803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:08.955801 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:08.955801 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:08.955801 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:08.955801 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:08.955801 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:06:08.955801 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:06:08.955801 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:06:08.955801 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:06:08.955801 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:06:08.955801 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:06:08.955801 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:06:08.955801 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:08.955801 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 392/781] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:06:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:08.966188 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bbac0a-bc81-4633-89d0-4b24a4a28693 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:08.976173 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe1176-d7b8-4d86-a806-44599b0fcc79 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:09.014142 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3fd5f-9e9c-4ebd-81d8-483963b00f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:09.014788 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3fd5f-9e9c-4ebd-81d8-483963b00f19 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:09.015158 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3fd5f-9e9c-4ebd-81d8-483963b00f19 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:09.015434 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3fd5f-9e9c-4ebd-81d8-483963b00f19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:09.016153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a3fd5f-9e9c-4ebd-81d8-483963b00f19 None admin] RBAC: Adding query filter params (interface=public, service_id=50290b7665e040aaaed56f7bb9c70dad, region_id=RegionOne) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:09.016466 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a3fd5f-9e9c-4ebd-81d8-483963b00f19 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:09.026122 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a3fd5f-9e9c-4ebd-81d8-483963b00f19 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:09.038430 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 390/782] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Aug 23 04:06:08 2022] GET /identity/v3/endpoints?service_id=50290b7665e040aaaed56f7bb9c70dad&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:09.045444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3fd5f-9e9c-4ebd-81d8-483963b00f19 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:09.072685 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:09.171128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3fd5f-9e9c-4ebd-81d8-483963b00f19 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:09.194224 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:09.209582 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbcccab-8a52-4cda-b9c3-9c586934439e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:09.210239 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcccab-8a52-4cda-b9c3-9c586934439e None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:09.210838 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcccab-8a52-4cda-b9c3-9c586934439e None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:09.211116 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcccab-8a52-4cda-b9c3-9c586934439e None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:09.211776 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbcccab-8a52-4cda-b9c3-9c586934439e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:09.216616 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbcccab-8a52-4cda-b9c3-9c586934439e None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:09.219528 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 391/783] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Aug 23 04:06:09 2022] GET /identity/v3/services => generated 772 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:09.229018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bbac0a-bc81-4633-89d0-4b24a4a28693 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:09.273276 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ac632-0d50-4de4-b869-09121615df79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:09.273967 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ac632-0d50-4de4-b869-09121615df79 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:09.274256 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ac632-0d50-4de4-b869-09121615df79 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:09.274529 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ac632-0d50-4de4-b869-09121615df79 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:09.275223 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ac632-0d50-4de4-b869-09121615df79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:09.275528 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ac632-0d50-4de4-b869-09121615df79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:09.276965 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ac632-0d50-4de4-b869-09121615df79 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:09.291229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 393/784] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:06:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:09.296623 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbcccab-8a52-4cda-b9c3-9c586934439e None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:09.409411 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbcccab-8a52-4cda-b9c3-9c586934439e None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:09.447441 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9aa4e1-f3fe-4bb9-8a36-96e45ee6e03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:09.448005 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9aa4e1-f3fe-4bb9-8a36-96e45ee6e03d None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:09.448286 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9aa4e1-f3fe-4bb9-8a36-96e45ee6e03d None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:09.448561 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9aa4e1-f3fe-4bb9-8a36-96e45ee6e03d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:09.461432 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9aa4e1-f3fe-4bb9-8a36-96e45ee6e03d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:09.462933 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9aa4e1-f3fe-4bb9-8a36-96e45ee6e03d None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:09.479261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-8d9aa4e1-f3fe-4bb9-8a36-96e45ee6e03d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:09.479261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:09.479261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:09.479261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:09.479261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:09.479261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:09.479261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:09.479261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:09.479261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:09.479261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:09.479261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:09.479261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:09.479261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:06:09.479261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:06:09.479261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:06:09.479261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:06:09.480281 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:09.480281 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:09.480281 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:09.480281 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:09.480281 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:09.480281 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:09.480281 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:09.480281 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:09.480281 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:09.480281 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:09.480281 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:09.480281 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:09.480281 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:09.480281 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:09.480281 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:09.480281 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:09.480281 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:06:09.481226 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:06:09.481226 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:09.481226 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:09.481226 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 392/785] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:09.486442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ac632-0d50-4de4-b869-09121615df79 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:09.593063 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ac632-0d50-4de4-b869-09121615df79 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:09.600870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:09.631686 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d3c45-b327-45ab-b502-084392ce31f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:09.632324 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d3c45-b327-45ab-b502-084392ce31f7 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:09.632604 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d3c45-b327-45ab-b502-084392ce31f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:09.632875 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d3c45-b327-45ab-b502-084392ce31f7 None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:09.633569 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d3c45-b327-45ab-b502-084392ce31f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:09.633910 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d3c45-b327-45ab-b502-084392ce31f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:09.635352 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d3c45-b327-45ab-b502-084392ce31f7 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:09.649163 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 394/786] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:09.654769 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9aa4e1-f3fe-4bb9-8a36-96e45ee6e03d None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:09.672517 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f8b38-939a-4ce9-aa66-fa48938105a4 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:09.672816 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f8b38-939a-4ce9-aa66-fa48938105a4 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:09.673058 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f8b38-939a-4ce9-aa66-fa48938105a4 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:09.674587 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 395/787] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 04:06:09.681591 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dbff0-9fda-4c3d-8d0d-70980f37bc30 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:09.681873 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dbff0-9fda-4c3d-8d0d-70980f37bc30 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:09.682150 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dbff0-9fda-4c3d-8d0d-70980f37bc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:09.699720 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:09.713420 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-a50dbff0-9fda-4c3d-8d0d-70980f37bc30 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:09.715080 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-a50dbff0-9fda-4c3d-8d0d-70980f37bc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:09.815011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9aa4e1-f3fe-4bb9-8a36-96e45ee6e03d None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:09.843418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 396/788] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 04:06:09.872246 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236a0a9-6615-45c0-b83e-f096a8ff9b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:09.873333 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236a0a9-6615-45c0-b83e-f096a8ff9b08 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:09.873830 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236a0a9-6615-45c0-b83e-f096a8ff9b08 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:09.874299 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236a0a9-6615-45c0-b83e-f096a8ff9b08 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:09.886512 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236a0a9-6615-45c0-b83e-f096a8ff9b08 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:09.888278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236a0a9-6615-45c0-b83e-f096a8ff9b08 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:09.905002 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-d236a0a9-6615-45c0-b83e-f096a8ff9b08 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 04:06:09.905002 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:09.905002 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:09.905002 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:09.905002 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:09.905002 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:09.905002 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:09.905002 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:09.905002 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:09.905002 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:09.905002 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:09.905002 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:09.905002 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:06:09.905002 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:06:09.905002 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:06:09.905002 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:06:09.906068 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:09.906068 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:09.906068 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:06:09.906068 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:06:09.906068 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:06:09.906068 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:06:09.906068 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:09.906068 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:09.906068 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:09.906068 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:09.906068 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:09.906068 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:09.906068 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:09.906068 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:09.906068 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:09.906068 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:09.906068 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:09.906068 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:09.907022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:09.907022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:09.907022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:06:09.907022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:06:09.907022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:06:09.907022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:06:09.907022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:06:09.907022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:06:09.907022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 04:06:09.907022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:09.909656 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 393/789] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:06:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:09.914915 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50dbff0-9fda-4c3d-8d0d-70980f37bc30 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:10.034375 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:10.040297 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50dbff0-9fda-4c3d-8d0d-70980f37bc30 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:10.085859 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b28029-27aa-4bb2-9535-afff39e7d398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:10.086492 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b28029-27aa-4bb2-9535-afff39e7d398 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:10.086814 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b28029-27aa-4bb2-9535-afff39e7d398 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:10.087090 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b28029-27aa-4bb2-9535-afff39e7d398 None admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:10.087833 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b28029-27aa-4bb2-9535-afff39e7d398 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:10.088136 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b28029-27aa-4bb2-9535-afff39e7d398 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:10.089605 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b28029-27aa-4bb2-9535-afff39e7d398 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:10.114559 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 397/790] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Aug 23 04:06:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:10.120266 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236a0a9-6615-45c0-b83e-f096a8ff9b08 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:10.236341 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:10.243262 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236a0a9-6615-45c0-b83e-f096a8ff9b08 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:10.278189 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c5a24-c4ef-4c73-aa73-4cab2184b786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:10.278885 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c5a24-c4ef-4c73-aa73-4cab2184b786 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:10.279174 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c5a24-c4ef-4c73-aa73-4cab2184b786 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:10.279453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c5a24-c4ef-4c73-aa73-4cab2184b786 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:10.290441 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c5a24-c4ef-4c73-aa73-4cab2184b786 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:10.291901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c5a24-c4ef-4c73-aa73-4cab2184b786 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:10.307305 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-d29c5a24-c4ef-4c73-aa73-4cab2184b786 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:10.307305 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:10.307305 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:10.307305 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:10.307305 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:10.307305 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:10.307305 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:10.307305 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:10.307305 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:10.307305 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:10.307305 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:10.307305 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:10.307305 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:06:10.307305 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:06:10.307305 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:06:10.307305 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:06:10.308279 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:10.308279 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:10.308279 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:10.308279 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:10.308279 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:10.308279 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:10.308279 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:10.308279 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:10.308279 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:10.308279 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:10.308279 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:10.308279 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:10.308279 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:10.308279 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:10.308279 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:10.308279 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:10.308279 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:06:10.309228 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:06:10.309228 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:10.309228 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:10.309228 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 394/791] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:10.314590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b28029-27aa-4bb2-9535-afff39e7d398 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:10.398471 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c5a24-c4ef-4c73-aa73-4cab2184b786 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:10.457316 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b28029-27aa-4bb2-9535-afff39e7d398 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:10.502839 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cacb9b-d91f-4e0b-9ad4-9c8406586cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:10.504721 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cacb9b-d91f-4e0b-9ad4-9c8406586cd6 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:10.504721 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cacb9b-d91f-4e0b-9ad4-9c8406586cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:10.504721 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cacb9b-d91f-4e0b-9ad4-9c8406586cd6 None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:10.505283 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cacb9b-d91f-4e0b-9ad4-9c8406586cd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:10.505435 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cacb9b-d91f-4e0b-9ad4-9c8406586cd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:10.506734 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cacb9b-d91f-4e0b-9ad4-9c8406586cd6 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:10.522184 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 398/792] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:10.523471 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae6b5c-7659-43a2-8442-b559c3fb4963 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:10.523756 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae6b5c-7659-43a2-8442-b559c3fb4963 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:10.524029 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae6b5c-7659-43a2-8442-b559c3fb4963 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:10.525491 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 399/793] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:10.527414 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae6b5c-7659-43a2-8442-b559c3fb4963 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:10.543971 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c5a24-c4ef-4c73-aa73-4cab2184b786 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:10.544676 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:10.594702 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c7aa2-c86b-464b-a616-1013084a18f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:10.596032 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c7aa2-c86b-464b-a616-1013084a18f1 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:10.596638 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c7aa2-c86b-464b-a616-1013084a18f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:10.597213 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c7aa2-c86b-464b-a616-1013084a18f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:10.610455 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c7aa2-c86b-464b-a616-1013084a18f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:06:10.617631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-310c7aa2-c86b-464b-a616-1013084a18f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:06:10.617631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:10.617631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:10.617631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:10.617631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:10.617631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:10.617631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:10.617631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:10.617631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:10.617631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:10.617631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:10.617631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:10.617631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:06:10.617631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:06:10.617631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:06:10.617631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:06:10.618678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:06:10.618678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:06:10.618678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:06:10.618678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:06:10.618678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:10.618678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:10.618678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:10.618678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:10.618678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:10.618678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:10.618678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:10.618678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:10.618678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:10.618678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:10.618678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:10.618678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:10.619546 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:10.619546 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:10.619546 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:10.619546 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:10.619546 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:06:10.619546 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:06:10.619546 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:06:10.619546 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:06:10.619546 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:06:10.619546 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:06:10.619546 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:06:10.619546 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:10.622292 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 395/794] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:06:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:06:10.624154 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932e1ca-8cff-4fff-a31d-859a0f388720 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:10.624610 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932e1ca-8cff-4fff-a31d-859a0f388720 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:10.625353 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932e1ca-8cff-4fff-a31d-859a0f388720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:10.643852 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae6b5c-7659-43a2-8442-b559c3fb4963 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:10.653710 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-e932e1ca-8cff-4fff-a31d-859a0f388720 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:10.656501 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-e932e1ca-8cff-4fff-a31d-859a0f388720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:10.659304 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:10.696058 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ca2ea-7265-4a34-9bdf-900cd4242bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:10.697746 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ca2ea-7265-4a34-9bdf-900cd4242bbd None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:10.698369 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ca2ea-7265-4a34-9bdf-900cd4242bbd None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:10.698959 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ca2ea-7265-4a34-9bdf-900cd4242bbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:10.708231 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ca2ea-7265-4a34-9bdf-900cd4242bbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:10.710043 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ca2ea-7265-4a34-9bdf-900cd4242bbd None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:10.725362 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-fe0ca2ea-7265-4a34-9bdf-900cd4242bbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:06:10.725362 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:10.725362 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:10.725362 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:10.725362 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:10.725362 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:10.725362 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:10.725362 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:10.725362 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:10.725362 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:10.725362 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:10.725362 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:10.725362 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:06:10.725362 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:06:10.725362 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:06:10.726313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:06:10.726313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:10.726313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:10.726313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:10.726313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:10.726313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:10.726313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:10.726313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:10.726313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:10.726313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:10.726313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:10.726313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:10.726313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:10.726313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:10.726313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:10.726313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:10.726313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:10.727211 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:06:10.727211 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:06:10.727211 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:06:10.727211 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:06:10.727211 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:06:10.727211 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:06:10.727211 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:06:10.727211 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:10.730403 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 400/795] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:06:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:10.731661 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ca2ea-7265-4a34-9bdf-900cd4242bbd None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:10.749182 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 396/796] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:10.750499 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932e1ca-8cff-4fff-a31d-859a0f388720 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:10.854598 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:10.883722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ca2ea-7265-4a34-9bdf-900cd4242bbd None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:10.943287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932e1ca-8cff-4fff-a31d-859a0f388720 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:10.963631 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51df31-0ed5-4b9c-b791-76d02a526215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:10.964462 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51df31-0ed5-4b9c-b791-76d02a526215 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:10.964877 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51df31-0ed5-4b9c-b791-76d02a526215 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:10.965321 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51df31-0ed5-4b9c-b791-76d02a526215 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:10.966138 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51df31-0ed5-4b9c-b791-76d02a526215 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:10.966595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51df31-0ed5-4b9c-b791-76d02a526215 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:10.968116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51df31-0ed5-4b9c-b791-76d02a526215 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:10.978890 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 401/797] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:06:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:10.985238 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51df31-0ed5-4b9c-b791-76d02a526215 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:11.030177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97239bc6-09b1-4312-a5fa-e1a889b72d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:11.030805 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97239bc6-09b1-4312-a5fa-e1a889b72d1f None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:11.031086 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97239bc6-09b1-4312-a5fa-e1a889b72d1f None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:11.031357 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97239bc6-09b1-4312-a5fa-e1a889b72d1f None admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:11.032056 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97239bc6-09b1-4312-a5fa-e1a889b72d1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:11.032355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97239bc6-09b1-4312-a5fa-e1a889b72d1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:11.033816 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97239bc6-09b1-4312-a5fa-e1a889b72d1f None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:11.042883 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:11.053826 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 397/798] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:06:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:11.055260 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c4529-3936-4257-bef0-a6156424daba None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:11.055650 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c4529-3936-4257-bef0-a6156424daba None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:11.055931 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c4529-3936-4257-bef0-a6156424daba None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:11.057625 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 398/799] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:11.061997 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c4529-3936-4257-bef0-a6156424daba None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:11.116624 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51df31-0ed5-4b9c-b791-76d02a526215 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:11.152642 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfac35-7c58-4cf4-bfca-ac1a7f16ee21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:11.153312 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfac35-7c58-4cf4-bfca-ac1a7f16ee21 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:11.153595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfac35-7c58-4cf4-bfca-ac1a7f16ee21 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:11.153866 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfac35-7c58-4cf4-bfca-ac1a7f16ee21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:11.156594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:11.165861 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bfac35-7c58-4cf4-bfca-ac1a7f16ee21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:11.167370 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bfac35-7c58-4cf4-bfca-ac1a7f16ee21 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:11.181376 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-12bfac35-7c58-4cf4-bfca-ac1a7f16ee21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:11.181376 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:11.181376 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:11.181376 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:11.181376 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:11.181376 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:11.181376 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:11.181376 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:11.181376 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:11.181376 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:11.181376 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:11.181376 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:11.181376 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:06:11.181376 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:06:11.181376 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:06:11.181376 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:06:11.182390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:11.182390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:11.182390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:11.182390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:11.182390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:11.182390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:11.182390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:11.182390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:11.182390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:11.182390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:11.182390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:11.182390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:11.182390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:11.182390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:11.182390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:11.182390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:11.182390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:06:11.183422 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:06:11.183422 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:11.183422 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:11.185316 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c4529-3936-4257-bef0-a6156424daba None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:11.187435 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 402/800] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:11.188566 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbb8c4-2e08-4b8d-be7e-b146ccfbb976 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:11.188858 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbb8c4-2e08-4b8d-be7e-b146ccfbb976 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:11.189156 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbb8c4-2e08-4b8d-be7e-b146ccfbb976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:11.207907 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-86bbb8c4-2e08-4b8d-be7e-b146ccfbb976 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:11.209120 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-86bbb8c4-2e08-4b8d-be7e-b146ccfbb976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:11.223057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d606a69-a7f8-4c42-beea-3508ef3111b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:11.223812 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d606a69-a7f8-4c42-beea-3508ef3111b5 None admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:11.224097 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d606a69-a7f8-4c42-beea-3508ef3111b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:11.224425 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d606a69-a7f8-4c42-beea-3508ef3111b5 None admin] PATH_INFO: `/v3/projects/a7ada12a1e3a42949c00f483efd522ba/users/63190c62bc92403880ffaedc4737485a/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:11.226404 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d606a69-a7f8-4c42-beea-3508ef3111b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7ada12a1e3a42949c00f483efd522ba, user_id=63190c62bc92403880ffaedc4737485a, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:11.227947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d606a69-a7f8-4c42-beea-3508ef3111b5 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:11.276256 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 403/801] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:11.277100 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbb8c4-2e08-4b8d-be7e-b146ccfbb976 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:11.297450 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 399/802] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 23 04:06:11 2022] PUT /identity/v3/projects/a7ada12a1e3a42949c00f483efd522ba/users/63190c62bc92403880ffaedc4737485a/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:06:11.302234 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d606a69-a7f8-4c42-beea-3508ef3111b5 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:11.433274 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:11.454913 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbb8c4-2e08-4b8d-be7e-b146ccfbb976 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:11.492628 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:11.508938 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d606a69-a7f8-4c42-beea-3508ef3111b5 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:11.515802 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6f886-db3e-4608-8468-6d0c557954dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:11.516517 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6f886-db3e-4608-8468-6d0c557954dc None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:11.516801 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6f886-db3e-4608-8468-6d0c557954dc None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:11.517072 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6f886-db3e-4608-8468-6d0c557954dc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:11.517681 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6f886-db3e-4608-8468-6d0c557954dc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:11.519748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6f886-db3e-4608-8468-6d0c557954dc None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:11.533155 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-14a6f886-db3e-4608-8468-6d0c557954dc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 04:06:11.533155 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:11.533155 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 04:06:11.533155 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 04:06:11.533155 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 04:06:11.533155 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 04:06:11.533155 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 04:06:11.533155 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:11.533155 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 04:06:11.533155 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:11.533155 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 04:06:11.533155 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:11.533155 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:11.533155 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:11.533155 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:11.533155 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:11.533155 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:11.534197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:11.534197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:11.534197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:11.534197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:11.534197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:11.534197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:11.534197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 04:06:11.534197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 04:06:11.534197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 04:06:11.534197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 04:06:11.534197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:11.534197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:11.534197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:11.534197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:11.534197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:11.534197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:11.535700 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:11.535700 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:11.535700 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:11.535700 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:11.535700 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:11.535700 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:11.535700 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:11.535700 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:11.535700 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:11.535700 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:11.535700 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 04:06:11.535700 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:11.535700 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 04:06:11.535700 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:11.535700 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 404/803] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Aug 23 04:06:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:11.541480 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6f886-db3e-4608-8468-6d0c557954dc None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:11.557575 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44545b-14ea-4061-afbd-dcdb3db9e815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:11.558917 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44545b-14ea-4061-afbd-dcdb3db9e815 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:11.559532 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44545b-14ea-4061-afbd-dcdb3db9e815 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:11.560057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44545b-14ea-4061-afbd-dcdb3db9e815 None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:11.560849 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44545b-14ea-4061-afbd-dcdb3db9e815 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:11.561584 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44545b-14ea-4061-afbd-dcdb3db9e815 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:11.563851 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44545b-14ea-4061-afbd-dcdb3db9e815 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:11.580198 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 400/804] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:11.589944 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44545b-14ea-4061-afbd-dcdb3db9e815 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:11.670273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6f886-db3e-4608-8468-6d0c557954dc None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:11.696279 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44545b-14ea-4061-afbd-dcdb3db9e815 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:11.704986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25aa266-eed5-4a30-ac90-84d1bf4c96ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:11.705635 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25aa266-eed5-4a30-ac90-84d1bf4c96ef None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:11.705917 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25aa266-eed5-4a30-ac90-84d1bf4c96ef None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:11.706717 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25aa266-eed5-4a30-ac90-84d1bf4c96ef None admin] PATH_INFO: `/v3/services` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:11.707358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25aa266-eed5-4a30-ac90-84d1bf4c96ef None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:11.707663 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25aa266-eed5-4a30-ac90-84d1bf4c96ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:11.709065 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25aa266-eed5-4a30-ac90-84d1bf4c96ef None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:11.717155 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 405/805] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Aug 23 04:06:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:11.717155 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25aa266-eed5-4a30-ac90-84d1bf4c96ef None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:11.719236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:11.738480 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3d8af-cf02-4ce9-bbbe-39783d361a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:11.739436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3d8af-cf02-4ce9-bbbe-39783d361a1e None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:11.740306 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3d8af-cf02-4ce9-bbbe-39783d361a1e None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:11.740801 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3d8af-cf02-4ce9-bbbe-39783d361a1e None admin] PATH_INFO: `/v3/users/nova` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:11.750835 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3d8af-cf02-4ce9-bbbe-39783d361a1e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:11.752664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3d8af-cf02-4ce9-bbbe-39783d361a1e None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:11.765404 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:11.766494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-94a3d8af-cf02-4ce9-bbbe-39783d361a1e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 04:06:11.766494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:11.766494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:11.766494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:11.766494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:11.766494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:11.766494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:11.766494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:11.766494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:11.766494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:11.766494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:11.766494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:11.766494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:06:11.766494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:06:11.766494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:06:11.766494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:06:11.767485 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:11.767485 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:11.767485 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:06:11.767485 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:06:11.767485 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:06:11.767485 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:06:11.767485 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:11.767485 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:11.767485 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:11.767485 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:11.767485 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:11.767485 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:11.767485 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:11.767485 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:11.767485 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:11.767485 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:11.767485 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:11.767485 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:11.768452 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:11.768452 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:11.768452 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:06:11.768452 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:06:11.768452 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:06:11.768452 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:06:11.768452 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:06:11.768452 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:06:11.768452 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 04:06:11.768452 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:11.768452 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 401/806] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Aug 23 04:06:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:11.770157 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bc805-92f7-481d-ba33-edb65915fc6c None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:11.770157 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bc805-92f7-481d-ba33-edb65915fc6c None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:11.770157 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bc805-92f7-481d-ba33-edb65915fc6c None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:11.775535 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 402/807] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:11.775535 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bc805-92f7-481d-ba33-edb65915fc6c None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:11.831608 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25aa266-eed5-4a30-ac90-84d1bf4c96ef None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:11.869721 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9345ed8-edf1-4576-9503-33cb0ffd3730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:11.870695 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9345ed8-edf1-4576-9503-33cb0ffd3730 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:11.871010 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9345ed8-edf1-4576-9503-33cb0ffd3730 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:11.871273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9345ed8-edf1-4576-9503-33cb0ffd3730 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:11.881688 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bc805-92f7-481d-ba33-edb65915fc6c None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:11.881971 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9345ed8-edf1-4576-9503-33cb0ffd3730 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:06:11.887160 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-b9345ed8-edf1-4576-9503-33cb0ffd3730 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:06:11.887160 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:11.887160 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:11.887160 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:11.887160 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:11.887160 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:11.887160 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:11.887160 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:11.887160 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:11.887160 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:11.887160 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:11.887160 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:11.887160 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:06:11.887160 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:06:11.887160 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:06:11.887160 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:06:11.888122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:06:11.888122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:06:11.888122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:06:11.888122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:06:11.888122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:11.888122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:11.888122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:11.888122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:11.888122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:11.888122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:11.888122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:11.888122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:11.888122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:11.888122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:11.888122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:11.888122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:11.889000 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:11.889000 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:11.889000 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:11.889000 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:11.889000 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:06:11.889000 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:06:11.889000 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:06:11.889000 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:06:11.889000 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:06:11.889000 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:06:11.889000 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:06:11.889000 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:11.889000 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 406/808] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 23 04:06:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:11.889786 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9345ed8-edf1-4576-9503-33cb0ffd3730 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:11.923892 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9171c-8a58-4f12-8709-2938a60c4792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:11.924500 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9171c-8a58-4f12-8709-2938a60c4792 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:11.924780 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9171c-8a58-4f12-8709-2938a60c4792 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:11.925122 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9171c-8a58-4f12-8709-2938a60c4792 None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:11.925732 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9171c-8a58-4f12-8709-2938a60c4792 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:11.926031 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9171c-8a58-4f12-8709-2938a60c4792 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:11.927383 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9171c-8a58-4f12-8709-2938a60c4792 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:11.936934 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 403/809] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Aug 23 04:06:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:11.936934 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3c436-28b3-44ef-bd81-cded3fc431c6 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:11.936934 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3c436-28b3-44ef-bd81-cded3fc431c6 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:11.936934 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3c436-28b3-44ef-bd81-cded3fc431c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:11.952408 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-add3c436-28b3-44ef-bd81-cded3fc431c6 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:11.953528 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-add3c436-28b3-44ef-bd81-cded3fc431c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:11.991856 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:12.017370 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9345ed8-edf1-4576-9503-33cb0ffd3730 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:12.025843 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:12.037321 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 404/810] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:12.037321 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3c436-28b3-44ef-bd81-cded3fc431c6 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:12.060599 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450f673-ba46-4d60-9469-268bf46f14c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:12.061800 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450f673-ba46-4d60-9469-268bf46f14c5 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:12.062077 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450f673-ba46-4d60-9469-268bf46f14c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:12.062346 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450f673-ba46-4d60-9469-268bf46f14c5 None admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:12.063077 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450f673-ba46-4d60-9469-268bf46f14c5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:12.063381 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450f673-ba46-4d60-9469-268bf46f14c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:12.064811 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450f673-ba46-4d60-9469-268bf46f14c5 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:12.089318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 407/811] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Aug 23 04:06:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:12.089318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450f673-ba46-4d60-9469-268bf46f14c5 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:12.157414 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3c436-28b3-44ef-bd81-cded3fc431c6 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:12.185279 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450f673-ba46-4d60-9469-268bf46f14c5 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:12.194478 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f138bb-b580-48d8-9bf4-0ce1f5c878ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:12.195379 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f138bb-b580-48d8-9bf4-0ce1f5c878ca None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:12.195917 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f138bb-b580-48d8-9bf4-0ce1f5c878ca None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:12.196409 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f138bb-b580-48d8-9bf4-0ce1f5c878ca None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:12.197308 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f138bb-b580-48d8-9bf4-0ce1f5c878ca None admin] RBAC: Adding query filter params (name=service) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:12.197829 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f138bb-b580-48d8-9bf4-0ce1f5c878ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:12.199386 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f138bb-b580-48d8-9bf4-0ce1f5c878ca None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:12.208548 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 405/812] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 23 04:06:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:12.209746 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f138bb-b580-48d8-9bf4-0ce1f5c878ca None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:12.224694 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358af4a9-54e1-4b14-a1c9-626e190ebdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:12.225348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358af4a9-54e1-4b14-a1c9-626e190ebdb8 None admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:12.225629 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358af4a9-54e1-4b14-a1c9-626e190ebdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:12.225902 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358af4a9-54e1-4b14-a1c9-626e190ebdb8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:12.226564 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358af4a9-54e1-4b14-a1c9-626e190ebdb8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:12.228080 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358af4a9-54e1-4b14-a1c9-626e190ebdb8 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:12.247761 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:12.313422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f138bb-b580-48d8-9bf4-0ce1f5c878ca None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:12.348978 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173a9fd-5fd3-4e61-acab-8c415290940d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:12.349621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173a9fd-5fd3-4e61-acab-8c415290940d None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:12.349956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173a9fd-5fd3-4e61-acab-8c415290940d None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:12.350270 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173a9fd-5fd3-4e61-acab-8c415290940d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:12.357501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 408/813] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:06:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:06:12.358396 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358af4a9-54e1-4b14-a1c9-626e190ebdb8 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:12.392039 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:12.442916 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173a9fd-5fd3-4e61-acab-8c415290940d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:12.444507 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173a9fd-5fd3-4e61-acab-8c415290940d None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:12.484141 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:12.508179 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358af4a9-54e1-4b14-a1c9-626e190ebdb8 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:12.552965 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b7b02-6c41-4065-91a1-869de79b6899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:12.553897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b7b02-6c41-4065-91a1-869de79b6899 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:12.554474 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b7b02-6c41-4065-91a1-869de79b6899 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:12.554474 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b7b02-6c41-4065-91a1-869de79b6899 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:12.567728 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b7b02-6c41-4065-91a1-869de79b6899 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:12.569572 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b7b02-6c41-4065-91a1-869de79b6899 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:12.573937 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 406/814] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:06:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 04:06:12.574808 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173a9fd-5fd3-4e61-acab-8c415290940d None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:12.586710 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-072b7b02-6c41-4065-91a1-869de79b6899 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:12.586710 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:12.586710 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:12.586710 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:12.586710 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:12.586710 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:12.586710 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:12.586710 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:12.586710 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:12.586710 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:12.586710 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:12.586710 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:12.586710 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:06:12.586710 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:06:12.586710 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:06:12.586710 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:06:12.587709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:12.587709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:12.587709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:12.587709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:12.587709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:12.587709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:12.587709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:12.587709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:12.587709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:12.587709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:12.587709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:12.587709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:12.587709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:12.587709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:12.587709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:12.587709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:12.587709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:06:12.588620 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:06:12.588620 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:12.588620 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:12.589279 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 409/815] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:12.590291 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b7b02-6c41-4065-91a1-869de79b6899 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:12.688009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173a9fd-5fd3-4e61-acab-8c415290940d None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:12.692627 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:12.726168 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031cf28-d927-41b2-ae39-e94778a77748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:12.726847 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031cf28-d927-41b2-ae39-e94778a77748 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:12.727111 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031cf28-d927-41b2-ae39-e94778a77748 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:12.727386 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031cf28-d927-41b2-ae39-e94778a77748 None admin] PATH_INFO: `/v3/services/network` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:12.728000 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031cf28-d927-41b2-ae39-e94778a77748 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:12.729507 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031cf28-d927-41b2-ae39-e94778a77748 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:12.731719 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:12.740998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-3031cf28-d927-41b2-ae39-e94778a77748 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 04:06:12.740998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:12.740998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 04:06:12.740998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 04:06:12.740998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 04:06:12.740998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 04:06:12.740998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 04:06:12.740998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:12.740998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 04:06:12.740998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:12.740998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 04:06:12.740998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:12.740998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:12.740998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:12.740998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:12.740998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:12.740998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:12.742092 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:12.742092 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:12.742092 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:12.742092 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:12.742092 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:12.742092 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:12.742092 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 04:06:12.742092 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 04:06:12.742092 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 04:06:12.742092 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 04:06:12.742092 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:12.742092 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:12.742092 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:12.742092 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:12.742092 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:12.742092 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:12.742949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:12.742949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:12.742949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:12.742949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:12.742949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:12.742949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:12.742949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:12.742949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:12.742949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:12.742949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:12.742949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 04:06:12.742949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:12.742949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 04:06:12.742949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:12.742949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 407/816] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:06:12 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:12.743760 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031cf28-d927-41b2-ae39-e94778a77748 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:12.746099 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b7b02-6c41-4065-91a1-869de79b6899 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:12.794098 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732c426-9c9c-4b41-adde-b39243eabafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:12.795350 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732c426-9c9c-4b41-adde-b39243eabafc None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:12.795796 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732c426-9c9c-4b41-adde-b39243eabafc None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:12.796231 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732c426-9c9c-4b41-adde-b39243eabafc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:12.812779 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732c426-9c9c-4b41-adde-b39243eabafc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:12.814715 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732c426-9c9c-4b41-adde-b39243eabafc None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:12.834495 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-4732c426-9c9c-4b41-adde-b39243eabafc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:12.834495 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:12.834495 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:12.834495 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:12.834495 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:12.834495 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:12.834495 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:12.834495 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:12.834495 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:12.834495 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:12.834495 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:12.834495 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:12.834495 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:06:12.834495 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:06:12.834495 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:06:12.834495 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:06:12.835496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:12.835496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:12.835496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:12.835496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:12.835496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:12.835496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:12.835496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:12.835496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:12.835496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:12.835496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:12.835496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:12.835496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:12.835496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:12.835496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:12.835496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:12.835496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:12.835496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:06:12.836418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:06:12.836418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:12.836418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:12.843505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 410/817] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:12.843505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732c426-9c9c-4b41-adde-b39243eabafc None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:12.869793 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031cf28-d927-41b2-ae39-e94778a77748 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:12.907715 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe10a7-ebcd-42a0-b258-813756fdbab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:12.908688 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe10a7-ebcd-42a0-b258-813756fdbab9 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:12.909256 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe10a7-ebcd-42a0-b258-813756fdbab9 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:12.909757 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe10a7-ebcd-42a0-b258-813756fdbab9 None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:12.910608 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe10a7-ebcd-42a0-b258-813756fdbab9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:12.911121 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe10a7-ebcd-42a0-b258-813756fdbab9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:12.912745 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe10a7-ebcd-42a0-b258-813756fdbab9 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:12.925853 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 408/818] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:12.927073 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe10a7-ebcd-42a0-b258-813756fdbab9 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:12.975825 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732c426-9c9c-4b41-adde-b39243eabafc None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:12.991635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:12.996638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:13.011870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86de68c-db59-4b94-8daa-082b74900c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:13.012485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86de68c-db59-4b94-8daa-082b74900c61 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:13.013040 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86de68c-db59-4b94-8daa-082b74900c61 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:13.013040 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86de68c-db59-4b94-8daa-082b74900c61 None admin] PATH_INFO: `/v3/services` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:13.013706 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86de68c-db59-4b94-8daa-082b74900c61 None admin] RBAC: Adding query filter params (name=network) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:13.014010 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86de68c-db59-4b94-8daa-082b74900c61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:13.015629 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86de68c-db59-4b94-8daa-082b74900c61 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:13.021386 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 411/819] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 23 04:06:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:13.022271 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86de68c-db59-4b94-8daa-082b74900c61 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:13.040538 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe10a7-ebcd-42a0-b258-813756fdbab9 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:13.080790 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210df76-84fa-47a8-8c36-c1368c1ee5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:13.082037 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210df76-84fa-47a8-8c36-c1368c1ee5aa None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:13.082552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210df76-84fa-47a8-8c36-c1368c1ee5aa None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:13.083084 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210df76-84fa-47a8-8c36-c1368c1ee5aa None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:13.083936 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210df76-84fa-47a8-8c36-c1368c1ee5aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:13.084499 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210df76-84fa-47a8-8c36-c1368c1ee5aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:13.086258 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210df76-84fa-47a8-8c36-c1368c1ee5aa None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:13.101678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 409/820] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:13.102789 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210df76-84fa-47a8-8c36-c1368c1ee5aa None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:13.136389 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86de68c-db59-4b94-8daa-082b74900c61 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:13.173593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcf1b8-1c16-44a9-ba72-a302663a4424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:13.174233 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcf1b8-1c16-44a9-ba72-a302663a4424 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:13.174510 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcf1b8-1c16-44a9-ba72-a302663a4424 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:13.174912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcf1b8-1c16-44a9-ba72-a302663a4424 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:13.183204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcf1b8-1c16-44a9-ba72-a302663a4424 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:13.184654 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcf1b8-1c16-44a9-ba72-a302663a4424 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:13.196590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-b4fcf1b8-1c16-44a9-ba72-a302663a4424 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 04:06:13.196590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:13.196590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:13.196590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:13.196590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:13.196590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:13.196590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:13.196590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:13.196590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:13.196590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:13.196590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:13.196590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:13.196590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:06:13.196590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:06:13.196590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:06:13.196590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:06:13.197987 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:13.197987 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:13.197987 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:06:13.197987 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:06:13.197987 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:06:13.197987 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:06:13.197987 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:13.197987 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:13.197987 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:13.197987 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:13.197987 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:13.197987 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:13.197987 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:13.197987 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:13.197987 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:13.197987 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:13.197987 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:13.197987 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:13.198951 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:13.198951 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:13.198951 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:06:13.198951 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:06:13.198951 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:06:13.198951 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:06:13.198951 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:06:13.198951 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:06:13.198951 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 04:06:13.198951 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:13.198951 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 412/821] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Aug 23 04:06:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:13.199548 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcf1b8-1c16-44a9-ba72-a302663a4424 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:13.218292 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210df76-84fa-47a8-8c36-c1368c1ee5aa None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:13.238050 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:13.248781 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:13.256948 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f313cf-dcd5-4bcf-ab58-d3dccd09b227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:13.257742 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f313cf-dcd5-4bcf-ab58-d3dccd09b227 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:13.258126 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f313cf-dcd5-4bcf-ab58-d3dccd09b227 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:13.258506 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f313cf-dcd5-4bcf-ab58-d3dccd09b227 None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:13.259249 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f313cf-dcd5-4bcf-ab58-d3dccd09b227 None admin] RBAC: Adding query filter params (type=network) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:13.259676 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f313cf-dcd5-4bcf-ab58-d3dccd09b227 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:13.261319 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f313cf-dcd5-4bcf-ab58-d3dccd09b227 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:13.266935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 410/822] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 23 04:06:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:13.267956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f313cf-dcd5-4bcf-ab58-d3dccd09b227 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:13.310602 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcf1b8-1c16-44a9-ba72-a302663a4424 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:13.348228 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ec175-30c1-483b-a167-9e0b58ad0503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:13.349135 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ec175-30c1-483b-a167-9e0b58ad0503 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:13.349558 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ec175-30c1-483b-a167-9e0b58ad0503 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:13.349997 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ec175-30c1-483b-a167-9e0b58ad0503 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:13.357429 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ec175-30c1-483b-a167-9e0b58ad0503 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:13.359092 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ec175-30c1-483b-a167-9e0b58ad0503 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:13.371249 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-9f8ec175-30c1-483b-a167-9e0b58ad0503 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:06:13.371249 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:13.371249 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:13.371249 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:13.371249 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:13.371249 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:13.371249 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:13.371249 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:13.371249 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:13.371249 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:13.371249 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:13.371249 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:13.371249 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:06:13.371249 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:06:13.371249 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:06:13.372338 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:06:13.372338 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:13.372338 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:13.372338 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:13.372338 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:13.372338 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:13.372338 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:13.372338 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:13.372338 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:13.372338 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:13.372338 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:13.372338 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:13.372338 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:13.372338 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:13.372338 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:13.372338 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:13.372338 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:13.373484 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:06:13.373484 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:06:13.373484 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:06:13.373484 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:06:13.373484 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:06:13.373484 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:06:13.373484 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:06:13.373484 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:13.380032 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 413/823] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:06:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:13.381168 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ec175-30c1-483b-a167-9e0b58ad0503 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:13.382940 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f313cf-dcd5-4bcf-ab58-d3dccd09b227 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:13.420641 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690ad2f-2b65-4dc5-b565-a7b40f5bd3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:13.421487 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690ad2f-2b65-4dc5-b565-a7b40f5bd3cd None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:13.421872 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690ad2f-2b65-4dc5-b565-a7b40f5bd3cd None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:13.422254 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690ad2f-2b65-4dc5-b565-a7b40f5bd3cd None admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:13.423099 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690ad2f-2b65-4dc5-b565-a7b40f5bd3cd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:13.423512 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690ad2f-2b65-4dc5-b565-a7b40f5bd3cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:13.425078 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690ad2f-2b65-4dc5-b565-a7b40f5bd3cd None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:13.445248 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 411/824] 10.222.0.42 () {56 vars in 1149 bytes} [Tue Aug 23 04:06:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:13.445248 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690ad2f-2b65-4dc5-b565-a7b40f5bd3cd None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:13.491268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:13.493216 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ec175-30c1-483b-a167-9e0b58ad0503 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:13.496667 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:13.530676 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f32e59-7415-4247-8a95-7b6a201963aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:13.531213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f32e59-7415-4247-8a95-7b6a201963aa None admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:13.531496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f32e59-7415-4247-8a95-7b6a201963aa None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:13.531771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f32e59-7415-4247-8a95-7b6a201963aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:13.532449 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f32e59-7415-4247-8a95-7b6a201963aa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:13.534416 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f32e59-7415-4247-8a95-7b6a201963aa None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:13.555243 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690ad2f-2b65-4dc5-b565-a7b40f5bd3cd None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:13.590658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a9d0b-9f8d-4c67-8b3c-a3c8388c33d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:13.591355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a9d0b-9f8d-4c67-8b3c-a3c8388c33d1 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:13.591640 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a9d0b-9f8d-4c67-8b3c-a3c8388c33d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:13.591915 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a9d0b-9f8d-4c67-8b3c-a3c8388c33d1 None admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:13.592604 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a9d0b-9f8d-4c67-8b3c-a3c8388c33d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:13.592909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a9d0b-9f8d-4c67-8b3c-a3c8388c33d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:13.594524 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a9d0b-9f8d-4c67-8b3c-a3c8388c33d1 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:13.605220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 414/825] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:06:13 2022] POST /identity/v3/endpoints => generated 337 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:06:13.605220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42c386-6cc1-4389-9e0a-ac07b5107a8a None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:13.605220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42c386-6cc1-4389-9e0a-ac07b5107a8a None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:13.605220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42c386-6cc1-4389-9e0a-ac07b5107a8a None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:13.605889 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 415/826] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:13.606746 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42c386-6cc1-4389-9e0a-ac07b5107a8a None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:13.610679 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 412/827] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:06:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:13.611978 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb05eea-6fce-4b65-b9fb-302015a88ba2 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:13.612261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb05eea-6fce-4b65-b9fb-302015a88ba2 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:13.612537 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb05eea-6fce-4b65-b9fb-302015a88ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:13.633179 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-5cb05eea-6fce-4b65-b9fb-302015a88ba2 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:13.634450 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-5cb05eea-6fce-4b65-b9fb-302015a88ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:13.725115 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 413/828] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:13.725115 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb05eea-6fce-4b65-b9fb-302015a88ba2 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:13.753706 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:13.773776 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42c386-6cc1-4389-9e0a-ac07b5107a8a None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:13.811403 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c2324-1908-4a3b-a53a-224d8d314c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:13.812041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c2324-1908-4a3b-a53a-224d8d314c4d None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:13.812328 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c2324-1908-4a3b-a53a-224d8d314c4d None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:13.812610 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c2324-1908-4a3b-a53a-224d8d314c4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:13.825525 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c2324-1908-4a3b-a53a-224d8d314c4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:13.828676 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c2324-1908-4a3b-a53a-224d8d314c4d None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:13.844773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-668c2324-1908-4a3b-a53a-224d8d314c4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:13.844773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:13.844773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:13.844773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:13.844773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:13.844773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:13.844773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:13.844773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:13.844773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:13.844773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:13.844773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:13.844773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:13.844773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:06:13.844773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:06:13.844773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:06:13.844773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:06:13.845812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:13.845812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:13.845812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:13.845812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:13.845812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:13.845812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:13.845812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:13.845812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:13.845812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:13.845812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:13.845812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:13.845812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:13.845812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:13.845812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:13.845812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:13.845812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:13.845812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:06:13.847202 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:06:13.847202 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:13.847202 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:13.847587 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb05eea-6fce-4b65-b9fb-302015a88ba2 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:13.847668 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 416/829] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:13.852012 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c2324-1908-4a3b-a53a-224d8d314c4d None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:13.869227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:13.884911 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7679808-6d46-48c9-879e-9f233fb0a79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:13.885718 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7679808-6d46-48c9-879e-9f233fb0a79c None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:13.886001 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7679808-6d46-48c9-879e-9f233fb0a79c None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:13.886313 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7679808-6d46-48c9-879e-9f233fb0a79c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:13.887121 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7679808-6d46-48c9-879e-9f233fb0a79c None admin] RBAC: Adding query filter params (role.id=255d9e4004c54505a7cda1b8af74e5f1, scope.project.id=a7ada12a1e3a42949c00f483efd522ba, user.id=1e0236a0acac4b87be977878b5186551) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:13.887484 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7679808-6d46-48c9-879e-9f233fb0a79c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:13.891924 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7679808-6d46-48c9-879e-9f233fb0a79c None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:13.895430 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 414/830] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:06:13 2022] GET /identity/v3/role_assignments?user.id=1e0236a0acac4b87be977878b5186551&scope.project.id=a7ada12a1e3a42949c00f483efd522ba&role.id=255d9e4004c54505a7cda1b8af74e5f1 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:13.974687 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c2324-1908-4a3b-a53a-224d8d314c4d None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:14.018756 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c599db-2436-4127-bee9-cc72ceabe077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:14.019391 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c599db-2436-4127-bee9-cc72ceabe077 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:14.019670 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c599db-2436-4127-bee9-cc72ceabe077 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:14.019940 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c599db-2436-4127-bee9-cc72ceabe077 None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:14.020603 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c599db-2436-4127-bee9-cc72ceabe077 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:14.020906 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c599db-2436-4127-bee9-cc72ceabe077 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:14.022327 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c599db-2436-4127-bee9-cc72ceabe077 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:14.044245 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7679808-6d46-48c9-879e-9f233fb0a79c None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:14.171234 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 417/831] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:06:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:14.172239 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:14.177499 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c599db-2436-4127-bee9-cc72ceabe077 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:14.185025 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7679808-6d46-48c9-879e-9f233fb0a79c None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:14.228669 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae24fb-9064-413c-a09f-e23d50f1b385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:14.229353 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae24fb-9064-413c-a09f-e23d50f1b385 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:14.229636 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae24fb-9064-413c-a09f-e23d50f1b385 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:14.230280 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae24fb-9064-413c-a09f-e23d50f1b385 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:14.244026 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae24fb-9064-413c-a09f-e23d50f1b385 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:06:14.251130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-7dae24fb-9064-413c-a09f-e23d50f1b385 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:06:14.251130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:14.251130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:14.251130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:14.251130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:14.251130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:14.251130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:14.251130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:14.251130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:14.251130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:14.251130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:14.251130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:14.251130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:06:14.251130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:06:14.251130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:06:14.251130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:06:14.252052 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:06:14.252052 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:06:14.252052 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:06:14.252052 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:06:14.252052 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:14.252052 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:14.252052 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:14.252052 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:14.252052 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:14.252052 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:14.252052 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:14.252052 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:14.252052 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:14.252052 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:14.252052 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:14.252052 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:14.252958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:14.252958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:14.252958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:14.252958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:14.252958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:06:14.252958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:06:14.252958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:06:14.252958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:06:14.252958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:06:14.252958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:06:14.252958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:06:14.252958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:14.253644 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 415/832] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:06:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:06:14.258677 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae24fb-9064-413c-a09f-e23d50f1b385 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:14.268167 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:14.301377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c599db-2436-4127-bee9-cc72ceabe077 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:14.338216 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e65db-3ef6-4fcb-be92-07beb3f11751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:14.338859 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e65db-3ef6-4fcb-be92-07beb3f11751 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:14.339139 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e65db-3ef6-4fcb-be92-07beb3f11751 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:14.339411 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e65db-3ef6-4fcb-be92-07beb3f11751 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:14.347030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e65db-3ef6-4fcb-be92-07beb3f11751 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:14.348472 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e65db-3ef6-4fcb-be92-07beb3f11751 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:14.359939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-d34e65db-3ef6-4fcb-be92-07beb3f11751 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:06:14.359939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:14.359939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:14.359939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:14.359939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:14.359939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:14.359939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:14.359939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:14.359939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:14.359939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:14.359939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:14.359939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:14.359939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:06:14.359939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:06:14.359939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:06:14.361060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:06:14.361060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:14.361060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:14.361060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:14.361060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:14.361060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:14.361060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:14.361060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:14.361060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:14.361060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:14.361060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:14.361060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:14.361060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:14.361060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:14.361060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:14.361060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:14.361060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:14.362180 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:06:14.362180 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:06:14.362180 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:06:14.362180 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:06:14.362180 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:06:14.362180 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:06:14.362180 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:06:14.362180 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:14.366396 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 418/833] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:06:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:14.367963 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e65db-3ef6-4fcb-be92-07beb3f11751 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:14.399626 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae24fb-9064-413c-a09f-e23d50f1b385 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:14.435868 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3de21-e80c-47db-a77d-8a10e4c2bac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:14.436431 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3de21-e80c-47db-a77d-8a10e4c2bac1 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:14.436715 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3de21-e80c-47db-a77d-8a10e4c2bac1 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:14.436988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3de21-e80c-47db-a77d-8a10e4c2bac1 None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:14.437689 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3de21-e80c-47db-a77d-8a10e4c2bac1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:14.437994 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3de21-e80c-47db-a77d-8a10e4c2bac1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:14.439363 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3de21-e80c-47db-a77d-8a10e4c2bac1 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:14.452128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 416/834] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:06:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:14.452128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106cd7f-7803-4335-b2ee-298146ff0817 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:14.452128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106cd7f-7803-4335-b2ee-298146ff0817 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:14.452128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106cd7f-7803-4335-b2ee-298146ff0817 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:14.452128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 417/835] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:14.453139 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106cd7f-7803-4335-b2ee-298146ff0817 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:14.469181 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:14.483791 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e65db-3ef6-4fcb-be92-07beb3f11751 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:14.514771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:14.521167 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5887a-afe1-416b-9e09-291f975a43b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:14.521728 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5887a-afe1-416b-9e09-291f975a43b0 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:14.522012 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5887a-afe1-416b-9e09-291f975a43b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:14.522287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5887a-afe1-416b-9e09-291f975a43b0 None admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:14.522984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5887a-afe1-416b-9e09-291f975a43b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:14.523293 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5887a-afe1-416b-9e09-291f975a43b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:14.524727 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5887a-afe1-416b-9e09-291f975a43b0 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:14.543083 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 419/836] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:06:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:14.544161 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58667969-3913-40f7-b183-99f7069211eb None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:14.544760 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58667969-3913-40f7-b183-99f7069211eb None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:14.545434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58667969-3913-40f7-b183-99f7069211eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:14.563435 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-58667969-3913-40f7-b183-99f7069211eb None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:14.564621 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-58667969-3913-40f7-b183-99f7069211eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:14.566766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106cd7f-7803-4335-b2ee-298146ff0817 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:14.607851 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a548e-b583-4689-ab1f-5f5f43d75e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:14.608844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a548e-b583-4689-ab1f-5f5f43d75e12 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:14.609159 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a548e-b583-4689-ab1f-5f5f43d75e12 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:14.609441 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a548e-b583-4689-ab1f-5f5f43d75e12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:14.620620 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a548e-b583-4689-ab1f-5f5f43d75e12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:14.622067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a548e-b583-4689-ab1f-5f5f43d75e12 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:14.641115 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 420/837] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:14.641115 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58667969-3913-40f7-b183-99f7069211eb None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:14.641359 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-197a548e-b583-4689-ab1f-5f5f43d75e12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:14.641359 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:14.641359 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:14.641359 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:14.641359 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:14.641359 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:14.641359 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:14.641359 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:14.641359 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:14.641359 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:14.641359 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:14.641359 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:14.641359 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:06:14.641359 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:06:14.641359 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:06:14.641359 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:06:14.642258 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:14.642258 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:14.642258 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:14.642258 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:14.642258 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:14.642258 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:14.642258 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:14.642258 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:14.642258 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:14.642258 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:14.642258 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:14.642258 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:14.642258 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:14.642258 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:14.642258 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:14.642258 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:14.642258 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:06:14.643165 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:06:14.643165 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:14.643165 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:14.643165 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 418/838] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:14.643938 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a548e-b583-4689-ab1f-5f5f43d75e12 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:14.732768 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:14.749660 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58667969-3913-40f7-b183-99f7069211eb None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:14.773777 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:14.786325 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a548e-b583-4689-ab1f-5f5f43d75e12 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:14.786805 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de5890-b593-4377-912e-4dadabae5004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:14.787364 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de5890-b593-4377-912e-4dadabae5004 None admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:14.787645 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de5890-b593-4377-912e-4dadabae5004 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:14.787968 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de5890-b593-4377-912e-4dadabae5004 None admin] PATH_INFO: `/v3/projects/a7ada12a1e3a42949c00f483efd522ba/users/826b9a7c343b4dbc9aeb3dbc0b75fc92/roles/e7c20cdfa0b64f71a716edf832519cbb` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:14.803844 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de5890-b593-4377-912e-4dadabae5004 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7ada12a1e3a42949c00f483efd522ba, user_id=826b9a7c343b4dbc9aeb3dbc0b75fc92, role_id=e7c20cdfa0b64f71a716edf832519cbb)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:14.805549 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de5890-b593-4377-912e-4dadabae5004 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:14.827480 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc3325-2317-4294-a039-8e8261374326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:14.828093 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc3325-2317-4294-a039-8e8261374326 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:14.828374 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc3325-2317-4294-a039-8e8261374326 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:14.828646 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc3325-2317-4294-a039-8e8261374326 None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:14.829355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc3325-2317-4294-a039-8e8261374326 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:14.829653 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc3325-2317-4294-a039-8e8261374326 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:14.831653 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc3325-2317-4294-a039-8e8261374326 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:14.843758 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 419/839] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:14.849729 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc3325-2317-4294-a039-8e8261374326 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:14.894654 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 421/840] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 23 04:06:14 2022] PUT /identity/v3/projects/a7ada12a1e3a42949c00f483efd522ba/users/826b9a7c343b4dbc9aeb3dbc0b75fc92/roles/e7c20cdfa0b64f71a716edf832519cbb => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:06:14.920601 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de5890-b593-4377-912e-4dadabae5004 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:14.984330 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc3325-2317-4294-a039-8e8261374326 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:15.013462 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:15.024812 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a0c39-c110-4aad-af7a-9973c27b82af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:15.028141 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a0c39-c110-4aad-af7a-9973c27b82af None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:15.028141 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a0c39-c110-4aad-af7a-9973c27b82af None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:15.028141 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a0c39-c110-4aad-af7a-9973c27b82af None admin] PATH_INFO: `/v3/users/swift` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:15.035352 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a0c39-c110-4aad-af7a-9973c27b82af None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:15.037262 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a0c39-c110-4aad-af7a-9973c27b82af None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:15.047937 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de5890-b593-4377-912e-4dadabae5004 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:15.051354 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-691a0c39-c110-4aad-af7a-9973c27b82af None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 04:06:15.051354 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:15.051354 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:15.051354 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:15.051354 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:15.051354 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:15.051354 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:15.051354 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:15.051354 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:15.051354 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:15.051354 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:15.051354 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:15.051354 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:06:15.051354 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:06:15.051354 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:06:15.051354 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:06:15.052376 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:15.052376 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:15.052376 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:06:15.052376 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:06:15.052376 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:06:15.052376 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:06:15.052376 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:15.052376 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:15.052376 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:15.052376 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:15.052376 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:15.052376 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:15.052376 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:15.052376 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:15.052376 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:15.052376 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:15.052376 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:15.052376 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:15.054017 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:15.054017 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:15.054017 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:06:15.054017 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:06:15.054017 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:06:15.054017 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:06:15.054017 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:06:15.054017 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:06:15.054017 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 04:06:15.054017 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:15.057796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 420/841] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:06:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:06:15.059159 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a0c39-c110-4aad-af7a-9973c27b82af None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:15.094446 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad190e22-3b3d-4cac-bd36-d5d03a12ec02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:15.095238 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad190e22-3b3d-4cac-bd36-d5d03a12ec02 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:15.095594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad190e22-3b3d-4cac-bd36-d5d03a12ec02 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:15.095944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad190e22-3b3d-4cac-bd36-d5d03a12ec02 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:15.096581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad190e22-3b3d-4cac-bd36-d5d03a12ec02 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:15.098126 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad190e22-3b3d-4cac-bd36-d5d03a12ec02 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:15.107478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-ad190e22-3b3d-4cac-bd36-d5d03a12ec02 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 04:06:15.107478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:15.107478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 04:06:15.107478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 04:06:15.107478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 04:06:15.107478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 04:06:15.107478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 04:06:15.107478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:15.107478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 04:06:15.107478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:15.107478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 04:06:15.107478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:15.107478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:15.107478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:15.107478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:15.107478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:15.107478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:15.108493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:15.108493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:15.108493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:15.108493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:15.108493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:15.108493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:15.108493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 04:06:15.108493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 04:06:15.108493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 04:06:15.108493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 04:06:15.108493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:15.108493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:15.108493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:15.108493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:15.108493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:15.108493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:15.109377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:15.109377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:15.109377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:15.109377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:15.109377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:15.109377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:15.109377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:15.109377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:15.109377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:15.109377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:15.109377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 04:06:15.109377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:15.109377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 04:06:15.109377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:15.109377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 422/842] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 23 04:06:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:06:15.116668 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad190e22-3b3d-4cac-bd36-d5d03a12ec02 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:15.165922 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:15.177166 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a0c39-c110-4aad-af7a-9973c27b82af None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:15.216510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385545fb-0e8f-48a0-849e-1a842045ccf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:15.217471 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385545fb-0e8f-48a0-849e-1a842045ccf2 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:15.217762 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385545fb-0e8f-48a0-849e-1a842045ccf2 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:15.218043 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385545fb-0e8f-48a0-849e-1a842045ccf2 None admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:15.218778 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385545fb-0e8f-48a0-849e-1a842045ccf2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:15.219090 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385545fb-0e8f-48a0-849e-1a842045ccf2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:15.220970 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385545fb-0e8f-48a0-849e-1a842045ccf2 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:15.249456 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 421/843] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Aug 23 04:06:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:15.250311 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad190e22-3b3d-4cac-bd36-d5d03a12ec02 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:15.250694 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385545fb-0e8f-48a0-849e-1a842045ccf2 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:15.297453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:15.297681 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0dd7ed-dee4-4ca6-bed6-9a4143a170d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:15.298287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0dd7ed-dee4-4ca6-bed6-9a4143a170d5 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:15.298494 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0dd7ed-dee4-4ca6-bed6-9a4143a170d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:15.298701 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0dd7ed-dee4-4ca6-bed6-9a4143a170d5 None admin] PATH_INFO: `/v3/services` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:15.300946 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0dd7ed-dee4-4ca6-bed6-9a4143a170d5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:15.301285 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0dd7ed-dee4-4ca6-bed6-9a4143a170d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:15.302670 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0dd7ed-dee4-4ca6-bed6-9a4143a170d5 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:15.310575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 423/844] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 23 04:06:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:15.317208 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0dd7ed-dee4-4ca6-bed6-9a4143a170d5 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:15.365042 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385545fb-0e8f-48a0-849e-1a842045ccf2 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:15.401823 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e396b-8149-4565-9ea6-16d03846ca1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:15.402443 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e396b-8149-4565-9ea6-16d03846ca1d None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:15.402726 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e396b-8149-4565-9ea6-16d03846ca1d None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:15.402996 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e396b-8149-4565-9ea6-16d03846ca1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:15.430189 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:15.433833 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0dd7ed-dee4-4ca6-bed6-9a4143a170d5 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:15.478133 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2567d8-54ab-45d3-9038-08361b475782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:15.478749 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2567d8-54ab-45d3-9038-08361b475782 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:15.479029 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2567d8-54ab-45d3-9038-08361b475782 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:15.479462 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2567d8-54ab-45d3-9038-08361b475782 None admin] PATH_INFO: `/v3/services` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:15.480101 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2567d8-54ab-45d3-9038-08361b475782 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:15.480889 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2567d8-54ab-45d3-9038-08361b475782 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:15.482595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2567d8-54ab-45d3-9038-08361b475782 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:15.482711 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e396b-8149-4565-9ea6-16d03846ca1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:15.484924 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e396b-8149-4565-9ea6-16d03846ca1d None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:15.487909 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 424/845] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 23 04:06:15 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:15.565528 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:15.606180 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 422/846] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:06:15 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 04:06:15.607649 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2567d8-54ab-45d3-9038-08361b475782 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:15.718844 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2567d8-54ab-45d3-9038-08361b475782 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:15.753665 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7ec92-1610-4407-9fbb-6f1ebd629bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:15.754352 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7ec92-1610-4407-9fbb-6f1ebd629bfa None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:15.754634 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7ec92-1610-4407-9fbb-6f1ebd629bfa None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:15.754904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7ec92-1610-4407-9fbb-6f1ebd629bfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:15.765768 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7ec92-1610-4407-9fbb-6f1ebd629bfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:15.767274 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7ec92-1610-4407-9fbb-6f1ebd629bfa None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:15.782116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-ccd7ec92-1610-4407-9fbb-6f1ebd629bfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:15.782116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:15.782116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:15.782116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:15.782116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:15.782116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:15.782116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:15.782116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:15.782116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:15.782116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:15.782116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:15.782116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:15.782116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:06:15.782116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:06:15.782116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:06:15.782116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:06:15.784293 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:15.784293 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:15.784293 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:15.784293 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:15.784293 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:15.784293 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:15.784293 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:15.784293 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:15.784293 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:15.784293 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:15.784293 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:15.784293 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:15.784293 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:15.784293 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:15.784293 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:15.784293 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:15.784293 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:06:15.786440 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:06:15.786440 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:15.786440 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:15.789109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 425/847] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:15.789331 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e396b-8149-4565-9ea6-16d03846ca1d None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:15.895460 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e396b-8149-4565-9ea6-16d03846ca1d None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:15.931375 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ec7e8-48d1-4c43-8939-d16beeb266ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:15.931994 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ec7e8-48d1-4c43-8939-d16beeb266ec None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:15.932275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ec7e8-48d1-4c43-8939-d16beeb266ec None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:15.932549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ec7e8-48d1-4c43-8939-d16beeb266ec None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:15.933228 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78ec7e8-48d1-4c43-8939-d16beeb266ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:15.933532 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78ec7e8-48d1-4c43-8939-d16beeb266ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:15.935040 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78ec7e8-48d1-4c43-8939-d16beeb266ec None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:15.963055 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 423/848] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:15.970224 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7ec92-1610-4407-9fbb-6f1ebd629bfa None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:15.991391 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:16.014298 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50dfce-7fc5-4580-a156-c23b3e8e4c62 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:16.014643 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50dfce-7fc5-4580-a156-c23b3e8e4c62 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:16.015097 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50dfce-7fc5-4580-a156-c23b3e8e4c62 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:16.016810 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 424/849] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 04:06:16.022743 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1187e9-7daa-4b37-92e3-ee50ef9e4377 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:16.023029 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1187e9-7daa-4b37-92e3-ee50ef9e4377 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:16.023309 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1187e9-7daa-4b37-92e3-ee50ef9e4377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:16.029926 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:16.043757 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-4f1187e9-7daa-4b37-92e3-ee50ef9e4377 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:16.045026 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-4f1187e9-7daa-4b37-92e3-ee50ef9e4377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:16.100036 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7ec92-1610-4407-9fbb-6f1ebd629bfa None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:16.133781 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 425/850] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 04:06:16.148812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd907656-1837-4d8f-ad68-7c25ec2acd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:16.148812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd907656-1837-4d8f-ad68-7c25ec2acd57 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:16.148812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd907656-1837-4d8f-ad68-7c25ec2acd57 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:16.148812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd907656-1837-4d8f-ad68-7c25ec2acd57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:16.154678 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd907656-1837-4d8f-ad68-7c25ec2acd57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:16.156315 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd907656-1837-4d8f-ad68-7c25ec2acd57 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:16.169442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-dd907656-1837-4d8f-ad68-7c25ec2acd57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:06:16.169442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:16.169442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:16.169442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:16.169442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:16.169442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:16.169442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:16.169442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:16.169442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:16.169442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:16.169442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:16.169442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:16.169442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:06:16.169442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:06:16.169442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:06:16.170426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:06:16.170426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:16.170426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:16.170426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:16.170426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:16.170426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:16.170426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:16.170426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:16.170426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:16.170426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:16.170426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:16.170426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:16.170426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:16.170426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:16.170426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:16.170426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:16.170426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:16.171348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:06:16.171348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:06:16.171348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:06:16.171348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:06:16.171348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:06:16.171348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:06:16.171348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:06:16.171348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:16.171348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 426/851] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:06:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:16.176647 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1187e9-7daa-4b37-92e3-ee50ef9e4377 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:16.283679 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1187e9-7daa-4b37-92e3-ee50ef9e4377 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:16.315736 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:16.321055 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f39e37-e763-4b83-b1be-26f439689c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:16.321707 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f39e37-e763-4b83-b1be-26f439689c1e None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:16.321991 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f39e37-e763-4b83-b1be-26f439689c1e None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:16.325517 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f39e37-e763-4b83-b1be-26f439689c1e None admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:16.325517 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f39e37-e763-4b83-b1be-26f439689c1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:16.325517 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f39e37-e763-4b83-b1be-26f439689c1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:16.325517 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f39e37-e763-4b83-b1be-26f439689c1e None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:16.337968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 426/852] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:06:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:16.343610 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd907656-1837-4d8f-ad68-7c25ec2acd57 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:16.407203 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f39e37-e763-4b83-b1be-26f439689c1e None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:16.431544 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:16.454587 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd907656-1837-4d8f-ad68-7c25ec2acd57 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:16.499410 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec553272-5eeb-499d-8a07-1caa13d84e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:16.501278 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec553272-5eeb-499d-8a07-1caa13d84e12 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:16.501786 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec553272-5eeb-499d-8a07-1caa13d84e12 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:16.502271 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec553272-5eeb-499d-8a07-1caa13d84e12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:16.503238 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec553272-5eeb-499d-8a07-1caa13d84e12 None admin] RBAC: Adding query filter params (role.id=255d9e4004c54505a7cda1b8af74e5f1, scope.project.id=a7ada12a1e3a42949c00f483efd522ba, user.id=63190c62bc92403880ffaedc4737485a) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:16.503771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec553272-5eeb-499d-8a07-1caa13d84e12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:16.505975 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec553272-5eeb-499d-8a07-1caa13d84e12 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:16.515901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 427/853] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:06:16 2022] GET /identity/v3/role_assignments?user.id=63190c62bc92403880ffaedc4737485a&scope.project.id=a7ada12a1e3a42949c00f483efd522ba&role.id=255d9e4004c54505a7cda1b8af74e5f1 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:16.550436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f39e37-e763-4b83-b1be-26f439689c1e None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:16.590647 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd28672-0ef9-45b8-8081-3aeac14b0d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:16.591303 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd28672-0ef9-45b8-8081-3aeac14b0d6e None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:16.591585 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd28672-0ef9-45b8-8081-3aeac14b0d6e None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:16.591857 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd28672-0ef9-45b8-8081-3aeac14b0d6e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:16.592456 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd28672-0ef9-45b8-8081-3aeac14b0d6e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:16.593964 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd28672-0ef9-45b8-8081-3aeac14b0d6e None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:16.604444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-fbd28672-0ef9-45b8-8081-3aeac14b0d6e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 04:06:16.604444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:16.604444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 04:06:16.604444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 04:06:16.604444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 04:06:16.604444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 04:06:16.604444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 04:06:16.604444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:16.604444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 04:06:16.604444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:16.604444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 04:06:16.604444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:16.604444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:16.604444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:16.604444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:16.604444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:16.605523 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:16.605523 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:16.605523 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:16.605523 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:16.605523 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:16.605523 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:16.605523 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:16.605523 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 04:06:16.605523 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 04:06:16.605523 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 04:06:16.605523 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 04:06:16.605523 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:16.605523 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:16.605523 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:16.605523 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:16.605523 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:16.605523 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:16.606657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:16.606657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:16.606657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:16.606657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:16.606657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:16.606657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:16.606657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:16.606657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:16.606657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:16.606657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:16.606657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 04:06:16.606657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:16.606657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 04:06:16.606657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:16.606657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 427/854] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Aug 23 04:06:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:06:16.614806 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec553272-5eeb-499d-8a07-1caa13d84e12 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:16.727869 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec553272-5eeb-499d-8a07-1caa13d84e12 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:16.763449 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397380b1-dea1-45dd-bb94-4c9aa28abb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:16.764395 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397380b1-dea1-45dd-bb94-4c9aa28abb00 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:16.764873 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397380b1-dea1-45dd-bb94-4c9aa28abb00 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:16.765397 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397380b1-dea1-45dd-bb94-4c9aa28abb00 None admin] PATH_INFO: `/v3/services` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:16.766248 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397380b1-dea1-45dd-bb94-4c9aa28abb00 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:16.766744 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397380b1-dea1-45dd-bb94-4c9aa28abb00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:16.768863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397380b1-dea1-45dd-bb94-4c9aa28abb00 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:16.777326 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 428/855] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 23 04:06:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:16.780139 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd28672-0ef9-45b8-8081-3aeac14b0d6e None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:16.840279 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:16.886056 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd28672-0ef9-45b8-8081-3aeac14b0d6e None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:16.922157 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2f01c-e5e8-4d6f-8c8a-0b94cbea11da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:16.923151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2f01c-e5e8-4d6f-8c8a-0b94cbea11da None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:16.923629 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2f01c-e5e8-4d6f-8c8a-0b94cbea11da None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:16.924124 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2f01c-e5e8-4d6f-8c8a-0b94cbea11da None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:16.925504 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2f01c-e5e8-4d6f-8c8a-0b94cbea11da None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:16.926004 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2f01c-e5e8-4d6f-8c8a-0b94cbea11da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:16.927603 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2f01c-e5e8-4d6f-8c8a-0b94cbea11da None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:16.933249 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 428/856] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 23 04:06:16 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:16.981771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7748a1-f7a6-4e42-8fd6-efc6e99cfe78 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:16.982386 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7748a1-f7a6-4e42-8fd6-efc6e99cfe78 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:16.982866 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7748a1-f7a6-4e42-8fd6-efc6e99cfe78 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:16.984938 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 429/857] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:16.991033 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd21454-39b2-471b-9770-20f4643910d9 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:16.991353 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd21454-39b2-471b-9770-20f4643910d9 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:16.991586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd21454-39b2-471b-9770-20f4643910d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:17.011637 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-4cd21454-39b2-471b-9770-20f4643910d9 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:17.012850 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-4cd21454-39b2-471b-9770-20f4643910d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:17.090180 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 429/858] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:17.356325 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7748a1-f7a6-4e42-8fd6-efc6e99cfe78 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:17.362657 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:17.465294 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7748a1-f7a6-4e42-8fd6-efc6e99cfe78 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:17.499602 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5539114-e8c1-42a6-8162-2990f74a48af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:17.500238 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5539114-e8c1-42a6-8162-2990f74a48af None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:17.500516 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5539114-e8c1-42a6-8162-2990f74a48af None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:17.500786 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5539114-e8c1-42a6-8162-2990f74a48af None admin] PATH_INFO: `/v3/roles/service` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:17.511932 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5539114-e8c1-42a6-8162-2990f74a48af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:06:17.515763 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857db7af-6341-4b02-a742-973c453384f6 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:17.516058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857db7af-6341-4b02-a742-973c453384f6 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:17.516395 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857db7af-6341-4b02-a742-973c453384f6 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:17.516577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-c5539114-e8c1-42a6-8162-2990f74a48af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:06:17.516577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:17.516577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:17.516577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:17.516577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:17.516577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:17.516577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:17.516577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:17.516577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:17.516577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:17.516577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:17.516577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:17.516577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:06:17.516577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:06:17.516577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:06:17.516577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:06:17.517589 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:06:17.517589 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:06:17.517589 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:06:17.517589 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:06:17.517589 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:17.517589 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:17.517589 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:17.517589 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:17.517589 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:17.517589 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:17.517589 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:17.517589 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:17.517589 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:17.517589 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:17.517589 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:17.517589 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:17.519213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:17.519213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:17.519213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:17.519213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:17.519213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:06:17.519213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:06:17.519213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:06:17.519213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:06:17.519213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:06:17.519213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:06:17.519213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:06:17.519213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:17.519213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 430/859] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 23 04:06:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:17.519962 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 430/860] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 04:06:17.524412 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5faf44-da45-4e41-9e61-11a3bd5ac0d8 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:17.524702 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5faf44-da45-4e41-9e61-11a3bd5ac0d8 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:17.524983 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5faf44-da45-4e41-9e61-11a3bd5ac0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:17.526674 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857db7af-6341-4b02-a742-973c453384f6 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:17.542956 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-0b5faf44-da45-4e41-9e61-11a3bd5ac0d8 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:17.544265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-0b5faf44-da45-4e41-9e61-11a3bd5ac0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:17.587597 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:17.628966 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:17.641217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857db7af-6341-4b02-a742-973c453384f6 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:17.645163 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 431/861] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:17.685572 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605784cd-0850-4719-9346-b236c14f57f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:17.686621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605784cd-0850-4719-9346-b236c14f57f2 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:17.687204 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605784cd-0850-4719-9346-b236c14f57f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:17.687717 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605784cd-0850-4719-9346-b236c14f57f2 None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:17.688653 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605784cd-0850-4719-9346-b236c14f57f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:17.689198 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605784cd-0850-4719-9346-b236c14f57f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:17.691127 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605784cd-0850-4719-9346-b236c14f57f2 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:17.701642 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 431/862] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 23 04:06:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:17.707959 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5faf44-da45-4e41-9e61-11a3bd5ac0d8 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:17.808371 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5faf44-da45-4e41-9e61-11a3bd5ac0d8 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:17.843703 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1663181-40d5-4fef-bd3e-fbb86bcf755d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:17.844357 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1663181-40d5-4fef-bd3e-fbb86bcf755d None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:17.844730 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1663181-40d5-4fef-bd3e-fbb86bcf755d None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:17.844946 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1663181-40d5-4fef-bd3e-fbb86bcf755d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:17.858101 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1663181-40d5-4fef-bd3e-fbb86bcf755d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:17.859789 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1663181-40d5-4fef-bd3e-fbb86bcf755d None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:17.875968 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-c1663181-40d5-4fef-bd3e-fbb86bcf755d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:17.875968 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:17.875968 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:17.875968 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:17.875968 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:17.875968 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:17.875968 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:17.875968 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:17.875968 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:17.875968 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:17.875968 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:17.875968 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:17.875968 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:06:17.875968 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:06:17.875968 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:06:17.875968 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:06:17.876933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:17.876933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:17.876933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:17.876933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:17.876933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:17.876933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:17.876933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:17.876933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:17.876933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:17.876933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:17.876933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:17.876933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:17.876933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:17.876933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:17.876933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:17.876933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:17.876933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:06:17.877923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:06:17.877923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:17.877923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:17.880017 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 432/863] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:17.885976 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605784cd-0850-4719-9346-b236c14f57f2 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:17.926527 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1663181-40d5-4fef-bd3e-fbb86bcf755d None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:17.987813 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:18.009391 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605784cd-0850-4719-9346-b236c14f57f2 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:18.025406 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:18.048003 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99503a-5ecf-46f9-be5b-6ee9d69090f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:18.049003 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99503a-5ecf-46f9-be5b-6ee9d69090f6 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:18.049710 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99503a-5ecf-46f9-be5b-6ee9d69090f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:18.050178 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99503a-5ecf-46f9-be5b-6ee9d69090f6 None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:18.051109 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a99503a-5ecf-46f9-be5b-6ee9d69090f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:18.051666 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a99503a-5ecf-46f9-be5b-6ee9d69090f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:18.053620 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a99503a-5ecf-46f9-be5b-6ee9d69090f6 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:18.059249 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1663181-40d5-4fef-bd3e-fbb86bcf755d None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:18.070397 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 432/864] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:18.077960 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99503a-5ecf-46f9-be5b-6ee9d69090f6 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:18.103309 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752acfc7-4df7-42c2-b4e6-d5760d7a66ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:18.104256 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752acfc7-4df7-42c2-b4e6-d5760d7a66ba None admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:18.104758 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752acfc7-4df7-42c2-b4e6-d5760d7a66ba None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:18.105290 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752acfc7-4df7-42c2-b4e6-d5760d7a66ba None admin] PATH_INFO: `/v3/services` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:18.106247 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752acfc7-4df7-42c2-b4e6-d5760d7a66ba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:18.107874 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752acfc7-4df7-42c2-b4e6-d5760d7a66ba None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:18.179567 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 433/865] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 23 04:06:17 2022] POST /identity/v3/services => generated 251 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:06:18.193233 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99503a-5ecf-46f9-be5b-6ee9d69090f6 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:18.241133 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3755828-1b2f-4695-a04d-ee36b75190ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:18.241864 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3755828-1b2f-4695-a04d-ee36b75190ae None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:18.242145 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3755828-1b2f-4695-a04d-ee36b75190ae None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:18.242417 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3755828-1b2f-4695-a04d-ee36b75190ae None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:18.250931 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3755828-1b2f-4695-a04d-ee36b75190ae None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:18.252935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3755828-1b2f-4695-a04d-ee36b75190ae None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:18.266245 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-d3755828-1b2f-4695-a04d-ee36b75190ae None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 04:06:18.266245 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:18.266245 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:18.266245 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:18.266245 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:18.266245 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:18.266245 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:18.266245 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:18.266245 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:18.266245 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:18.266245 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:18.266245 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:18.266245 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:06:18.266245 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:06:18.266245 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:06:18.266245 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:06:18.267275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:18.267275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:18.267275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:06:18.267275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:06:18.267275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:06:18.267275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:06:18.267275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:18.267275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:18.267275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:18.267275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:18.267275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:18.267275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:18.267275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:18.267275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:18.267275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:18.267275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:18.267275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:18.267275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:18.269590 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:18.269590 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:18.269590 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:06:18.269590 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:06:18.269590 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:06:18.269590 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:06:18.269590 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:06:18.269590 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:06:18.269590 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 04:06:18.269590 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:18.269590 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 433/866] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Aug 23 04:06:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:06:18.278334 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752acfc7-4df7-42c2-b4e6-d5760d7a66ba None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:18.391036 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752acfc7-4df7-42c2-b4e6-d5760d7a66ba None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:18.399711 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:18.427353 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6252ab-2830-4bdb-b48e-96558c6f7549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:18.428665 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6252ab-2830-4bdb-b48e-96558c6f7549 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:18.429204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6252ab-2830-4bdb-b48e-96558c6f7549 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:18.429833 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6252ab-2830-4bdb-b48e-96558c6f7549 None admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:18.431169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6252ab-2830-4bdb-b48e-96558c6f7549 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:18.431742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6252ab-2830-4bdb-b48e-96558c6f7549 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:18.433244 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6252ab-2830-4bdb-b48e-96558c6f7549 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:18.451714 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 434/867] 10.222.0.42 () {56 vars in 1149 bytes} [Tue Aug 23 04:06:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:18.458753 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3755828-1b2f-4695-a04d-ee36b75190ae None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:18.489495 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:18.565746 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3755828-1b2f-4695-a04d-ee36b75190ae None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:18.588203 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ff25d-becb-46c7-8d2d-8a25b66e5aca None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:18.588824 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ff25d-becb-46c7-8d2d-8a25b66e5aca None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:18.589357 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ff25d-becb-46c7-8d2d-8a25b66e5aca None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:18.595019 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 435/868] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:18.597351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ece4e-afbb-4203-b233-031d3c11339f None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:18.597886 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ece4e-afbb-4203-b233-031d3c11339f None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:18.598354 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ece4e-afbb-4203-b233-031d3c11339f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:18.602341 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818852f1-fe6d-4c02-b58d-60be9a88fca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:18.602962 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818852f1-fe6d-4c02-b58d-60be9a88fca8 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:18.603245 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818852f1-fe6d-4c02-b58d-60be9a88fca8 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:18.603519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818852f1-fe6d-4c02-b58d-60be9a88fca8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:18.618090 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-f03ece4e-afbb-4203-b233-031d3c11339f None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:18.619659 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-f03ece4e-afbb-4203-b233-031d3c11339f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:18.701199 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818852f1-fe6d-4c02-b58d-60be9a88fca8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:18.701199 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818852f1-fe6d-4c02-b58d-60be9a88fca8 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:18.701651 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 436/869] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:18 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 04:06:18.741491 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:18.801678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 434/870] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:06:18 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 04:06:18.807483 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ece4e-afbb-4203-b233-031d3c11339f None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:18.891568 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2ece8-123e-4d12-950c-2de5ab69a505 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:18.892078 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2ece8-123e-4d12-950c-2de5ab69a505 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:18.892154 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2ece8-123e-4d12-950c-2de5ab69a505 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:18.894941 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 435/871] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 04:06:18.900974 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5101f-5891-4d70-bf5f-11b391501e87 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:18.901543 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5101f-5891-4d70-bf5f-11b391501e87 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:18.902017 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5101f-5891-4d70-bf5f-11b391501e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:18.913307 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:18.920604 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ece4e-afbb-4203-b233-031d3c11339f None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:18.922079 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-d4c5101f-5891-4d70-bf5f-11b391501e87 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:18.927352 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-d4c5101f-5891-4d70-bf5f-11b391501e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:18.964468 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867e6ad-91cb-4320-a60e-8cff18b08745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:18.965140 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867e6ad-91cb-4320-a60e-8cff18b08745 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:18.965424 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867e6ad-91cb-4320-a60e-8cff18b08745 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:18.965694 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867e6ad-91cb-4320-a60e-8cff18b08745 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:18.978976 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867e6ad-91cb-4320-a60e-8cff18b08745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:18.980723 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867e6ad-91cb-4320-a60e-8cff18b08745 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:18.996592 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 436/872] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:18 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 04:06:18.997776 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5101f-5891-4d70-bf5f-11b391501e87 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:18.998740 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-7867e6ad-91cb-4320-a60e-8cff18b08745 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:18.998740 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:18.998740 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:18.998740 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:18.998740 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:18.998740 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:18.998740 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:18.998740 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:18.998740 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:18.998740 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:18.998740 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:18.998740 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:18.998740 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:06:18.998740 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:06:18.998740 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:06:18.998740 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:06:18.999671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:18.999671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:18.999671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:18.999671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:18.999671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:18.999671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:18.999671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:18.999671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:18.999671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:18.999671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:18.999671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:18.999671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:18.999671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:18.999671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:18.999671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:18.999671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:18.999671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:06:19.000584 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:06:19.000584 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:19.000584 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:19.002985 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 437/873] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:19.005998 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867e6ad-91cb-4320-a60e-8cff18b08745 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:19.065430 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:19.112747 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5101f-5891-4d70-bf5f-11b391501e87 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:19.148264 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867e6ad-91cb-4320-a60e-8cff18b08745 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:19.151108 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c065f-e096-4374-891c-15da2facd48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:19.152082 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c065f-e096-4374-891c-15da2facd48a None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:19.152082 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c065f-e096-4374-891c-15da2facd48a None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:19.152279 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c065f-e096-4374-891c-15da2facd48a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:19.152825 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c065f-e096-4374-891c-15da2facd48a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:19.154221 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c065f-e096-4374-891c-15da2facd48a None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:19.163909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-d36c065f-e096-4374-891c-15da2facd48a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 04:06:19.163909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:19.163909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 04:06:19.163909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 04:06:19.163909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 04:06:19.163909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 04:06:19.163909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 04:06:19.163909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:19.163909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 04:06:19.163909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:19.163909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 04:06:19.163909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:19.163909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:19.163909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:19.163909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:19.163909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:19.163909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:19.164961 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:19.164961 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:19.164961 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:19.164961 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:19.164961 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:19.164961 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:19.164961 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 04:06:19.164961 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 04:06:19.164961 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 04:06:19.164961 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 04:06:19.164961 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:19.164961 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:19.164961 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:19.164961 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:19.164961 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:19.164961 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:19.165871 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:19.165871 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:19.165871 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:19.165871 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:19.165871 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:19.165871 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:19.165871 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:19.165871 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:19.165871 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:19.165871 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:19.165871 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 04:06:19.165871 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:19.165871 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 04:06:19.165871 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:19.169918 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 437/874] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 23 04:06:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:19.171147 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c065f-e096-4374-891c-15da2facd48a None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:19.195892 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a66f33-3e7e-458b-8f24-e5b59a33f765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:19.197581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a66f33-3e7e-458b-8f24-e5b59a33f765 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:19.198498 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a66f33-3e7e-458b-8f24-e5b59a33f765 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:19.198978 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a66f33-3e7e-458b-8f24-e5b59a33f765 None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:19.200543 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a66f33-3e7e-458b-8f24-e5b59a33f765 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:19.201282 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a66f33-3e7e-458b-8f24-e5b59a33f765 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:19.202678 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a66f33-3e7e-458b-8f24-e5b59a33f765 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:19.221695 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 438/875] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:19.226693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a66f33-3e7e-458b-8f24-e5b59a33f765 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:19.236636 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:19.293041 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c065f-e096-4374-891c-15da2facd48a None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:19.316064 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:19.327919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783104b-1c3f-4e0a-9bfc-d9a9d907550b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:19.328529 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783104b-1c3f-4e0a-9bfc-d9a9d907550b None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:19.328810 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783104b-1c3f-4e0a-9bfc-d9a9d907550b None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:19.329081 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783104b-1c3f-4e0a-9bfc-d9a9d907550b None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:19.329735 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783104b-1c3f-4e0a-9bfc-d9a9d907550b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:19.330035 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783104b-1c3f-4e0a-9bfc-d9a9d907550b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:19.332065 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783104b-1c3f-4e0a-9bfc-d9a9d907550b None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:19.341556 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 438/876] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Aug 23 04:06:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:19.341556 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783104b-1c3f-4e0a-9bfc-d9a9d907550b None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:19.350505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a66f33-3e7e-458b-8f24-e5b59a33f765 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:19.385668 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fba2b-f405-436b-b337-10e416326921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:19.386293 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fba2b-f405-436b-b337-10e416326921 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:19.386569 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fba2b-f405-436b-b337-10e416326921 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:19.386839 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fba2b-f405-436b-b337-10e416326921 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:19.394084 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fba2b-f405-436b-b337-10e416326921 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:19.395520 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fba2b-f405-436b-b337-10e416326921 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:19.407458 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-849fba2b-f405-436b-b337-10e416326921 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:06:19.407458 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:19.407458 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:19.407458 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:19.407458 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:19.407458 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:19.407458 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:19.407458 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:19.407458 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:19.407458 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:19.407458 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:19.407458 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:19.407458 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:06:19.407458 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:06:19.407458 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:06:19.408505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:06:19.408505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:19.408505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:19.408505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:19.408505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:19.408505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:19.408505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:19.408505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:19.408505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:19.408505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:19.408505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:19.408505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:19.408505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:19.408505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:19.408505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:19.408505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:19.408505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:19.415101 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:06:19.415101 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:06:19.415101 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:06:19.415101 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:06:19.415101 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:06:19.415101 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:06:19.415101 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:06:19.415101 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:19.415101 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 439/877] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:06:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:06:19.415101 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fba2b-f405-436b-b337-10e416326921 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:19.463235 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783104b-1c3f-4e0a-9bfc-d9a9d907550b None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:19.479191 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:19.500800 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b3535-3c07-4ad0-b091-8733dbd3f0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:19.501468 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b3535-3c07-4ad0-b091-8733dbd3f0b7 None admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:19.501826 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b3535-3c07-4ad0-b091-8733dbd3f0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:19.502110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b3535-3c07-4ad0-b091-8733dbd3f0b7 None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:19.503302 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b3535-3c07-4ad0-b091-8733dbd3f0b7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:19.504668 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b3535-3c07-4ad0-b091-8733dbd3f0b7 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:19.514990 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fba2b-f405-436b-b337-10e416326921 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:19.548624 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692234c-3259-4396-a518-78ffcbb86de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:19.549350 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692234c-3259-4396-a518-78ffcbb86de5 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:19.549648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692234c-3259-4396-a518-78ffcbb86de5 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:19.549924 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692234c-3259-4396-a518-78ffcbb86de5 None admin] PATH_INFO: `/v3/services` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:19.550573 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692234c-3259-4396-a518-78ffcbb86de5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:19.550868 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692234c-3259-4396-a518-78ffcbb86de5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:19.552236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692234c-3259-4396-a518-78ffcbb86de5 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:19.556928 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 440/878] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Aug 23 04:06:19 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:19.557729 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692234c-3259-4396-a518-78ffcbb86de5 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:19.602756 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 439/879] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 23 04:06:19 2022] POST /identity/v3/services => generated 269 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:06:19.709904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692234c-3259-4396-a518-78ffcbb86de5 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:19.743457 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:19.756800 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519329f6-9a9c-4148-929f-cdf984cc5ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:19.757443 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519329f6-9a9c-4148-929f-cdf984cc5ff2 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:19.757721 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519329f6-9a9c-4148-929f-cdf984cc5ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:19.757993 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519329f6-9a9c-4148-929f-cdf984cc5ff2 None admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:19.758685 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519329f6-9a9c-4148-929f-cdf984cc5ff2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:19.758988 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519329f6-9a9c-4148-929f-cdf984cc5ff2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:19.760516 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519329f6-9a9c-4148-929f-cdf984cc5ff2 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:19.774330 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 441/880] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:06:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:19.781101 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b3535-3c07-4ad0-b091-8733dbd3f0b7 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:19.834013 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:19.889924 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b3535-3c07-4ad0-b091-8733dbd3f0b7 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:19.925999 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40ec5f-0c93-4f09-946d-49781a8afe97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:19.926643 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40ec5f-0c93-4f09-946d-49781a8afe97 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:19.926881 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40ec5f-0c93-4f09-946d-49781a8afe97 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:19.927155 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40ec5f-0c93-4f09-946d-49781a8afe97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:19.928147 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40ec5f-0c93-4f09-946d-49781a8afe97 None admin] RBAC: Adding query filter params (role.id=e7c20cdfa0b64f71a716edf832519cbb, scope.project.id=a7ada12a1e3a42949c00f483efd522ba, user.id=826b9a7c343b4dbc9aeb3dbc0b75fc92) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:19.928514 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40ec5f-0c93-4f09-946d-49781a8afe97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:19.929980 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40ec5f-0c93-4f09-946d-49781a8afe97 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:19.936447 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 440/881] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:06:19 2022] GET /identity/v3/role_assignments?user.id=826b9a7c343b4dbc9aeb3dbc0b75fc92&scope.project.id=a7ada12a1e3a42949c00f483efd522ba&role.id=e7c20cdfa0b64f71a716edf832519cbb => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:20.189417 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f6f7d-77d4-44cb-9cf8-6d55115cfd77 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:20.190202 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f6f7d-77d4-44cb-9cf8-6d55115cfd77 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:20.190476 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f6f7d-77d4-44cb-9cf8-6d55115cfd77 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:20.192068 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 442/882] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:20.197240 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc9984-79b7-4f13-828a-ded1f3ad6c5f None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:20.197536 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc9984-79b7-4f13-828a-ded1f3ad6c5f None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:20.197816 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc9984-79b7-4f13-828a-ded1f3ad6c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:20.216429 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-12dc9984-79b7-4f13-828a-ded1f3ad6c5f None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:20.217639 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-12dc9984-79b7-4f13-828a-ded1f3ad6c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:20.285969 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 441/883] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:20 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:20.554922 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f6f7d-77d4-44cb-9cf8-6d55115cfd77 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:20.659807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f6f7d-77d4-44cb-9cf8-6d55115cfd77 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:20.694907 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a4598-7f2a-4825-aec3-934dcbc75cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:20.695551 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a4598-7f2a-4825-aec3-934dcbc75cf8 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:20.695834 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a4598-7f2a-4825-aec3-934dcbc75cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:20.696105 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a4598-7f2a-4825-aec3-934dcbc75cf8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:20.696695 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a4598-7f2a-4825-aec3-934dcbc75cf8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:20.698110 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a4598-7f2a-4825-aec3-934dcbc75cf8 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:20.708418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-fb4a4598-7f2a-4825-aec3-934dcbc75cf8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 04:06:20.708418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:20.708418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 04:06:20.708418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 04:06:20.708418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 04:06:20.708418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 04:06:20.708418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 04:06:20.708418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:20.708418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 04:06:20.708418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:20.708418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 04:06:20.708418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:20.708418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:20.708418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:20.708418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:20.708418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:20.708418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:20.709556 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:20.709556 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:20.709556 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:20.709556 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:20.709556 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:20.709556 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:20.709556 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 04:06:20.709556 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 04:06:20.709556 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 04:06:20.709556 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 04:06:20.709556 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:20.709556 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:20.709556 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:20.709556 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:20.709556 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:20.709556 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:20.710421 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:20.710421 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:20.710421 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:20.710421 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:20.710421 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:20.710421 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:20.710421 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:20.710421 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:20.710421 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:20.710421 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:20.710421 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 04:06:20.710421 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:20.710421 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 04:06:20.710421 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:20.710421 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 443/884] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 23 04:06:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:20.716019 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc9984-79b7-4f13-828a-ded1f3ad6c5f None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:20.758965 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:20.818845 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc9984-79b7-4f13-828a-ded1f3ad6c5f None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:20.856495 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fad2fd-3ca6-43e2-802c-2a239c835faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:20.857147 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fad2fd-3ca6-43e2-802c-2a239c835faa None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:20.857435 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fad2fd-3ca6-43e2-802c-2a239c835faa None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:20.857712 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fad2fd-3ca6-43e2-802c-2a239c835faa None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:20.858360 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fad2fd-3ca6-43e2-802c-2a239c835faa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:20.858666 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fad2fd-3ca6-43e2-802c-2a239c835faa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:20.860041 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fad2fd-3ca6-43e2-802c-2a239c835faa None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:20.865291 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 442/885] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 23 04:06:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:20.870905 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a4598-7f2a-4825-aec3-934dcbc75cf8 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:20.923785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:20.976338 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a4598-7f2a-4825-aec3-934dcbc75cf8 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:21.011022 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0db44-d650-436d-bc05-89a2ca99dc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:21.011640 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0db44-d650-436d-bc05-89a2ca99dc92 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:21.011919 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0db44-d650-436d-bc05-89a2ca99dc92 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:21.012191 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0db44-d650-436d-bc05-89a2ca99dc92 None admin] PATH_INFO: `/v3/services` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:21.012876 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0db44-d650-436d-bc05-89a2ca99dc92 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:21.013215 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0db44-d650-436d-bc05-89a2ca99dc92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:21.014593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0db44-d650-436d-bc05-89a2ca99dc92 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:21.020354 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 444/886] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 23 04:06:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:21.026103 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fad2fd-3ca6-43e2-802c-2a239c835faa None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:21.137685 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fad2fd-3ca6-43e2-802c-2a239c835faa None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:21.140113 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:21.173699 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3305895-d075-4427-8e02-ef30fb46d781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:21.174348 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3305895-d075-4427-8e02-ef30fb46d781 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:21.174630 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3305895-d075-4427-8e02-ef30fb46d781 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:21.174909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3305895-d075-4427-8e02-ef30fb46d781 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:21.175671 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3305895-d075-4427-8e02-ef30fb46d781 None admin] RBAC: Adding query filter params (interface=public, service_id=14e4ec79658b476e800a24b280e852a8, region_id=RegionOne) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:21.176198 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3305895-d075-4427-8e02-ef30fb46d781 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:21.177608 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3305895-d075-4427-8e02-ef30fb46d781 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:21.183384 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 443/887] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Aug 23 04:06:21 2022] GET /identity/v3/endpoints?service_id=14e4ec79658b476e800a24b280e852a8&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:21.188842 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0db44-d650-436d-bc05-89a2ca99dc92 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:21.292108 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0db44-d650-436d-bc05-89a2ca99dc92 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:21.306836 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:21.332128 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094ce4f-49c1-4e37-b9d5-33d6395adcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:21.332748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094ce4f-49c1-4e37-b9d5-33d6395adcca None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:21.333028 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094ce4f-49c1-4e37-b9d5-33d6395adcca None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:21.333480 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094ce4f-49c1-4e37-b9d5-33d6395adcca None admin] PATH_INFO: `/v3/services` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:21.334101 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094ce4f-49c1-4e37-b9d5-33d6395adcca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:21.335468 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094ce4f-49c1-4e37-b9d5-33d6395adcca None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:21.341639 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 445/888] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Aug 23 04:06:21 2022] GET /identity/v3/services => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:06:21.572709 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550d271-89dd-4684-a488-61369a76b99d None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:21.573058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550d271-89dd-4684-a488-61369a76b99d None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:21.573282 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550d271-89dd-4684-a488-61369a76b99d None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:21.574692 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 444/889] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:21.580780 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc542d3-e71e-4ef3-ba9b-1fc193f7dff2 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:21.581390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc542d3-e71e-4ef3-ba9b-1fc193f7dff2 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:21.581390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc542d3-e71e-4ef3-ba9b-1fc193f7dff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:21.600181 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-3fc542d3-e71e-4ef3-ba9b-1fc193f7dff2 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:21.601386 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-3fc542d3-e71e-4ef3-ba9b-1fc193f7dff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:21.671104 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 446/890] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:21 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:21.775907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d9fc9-ce68-4ea0-9e76-db6590762749 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:21.776392 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d9fc9-ce68-4ea0-9e76-db6590762749 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:21.776781 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d9fc9-ce68-4ea0-9e76-db6590762749 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:21.778506 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 445/891] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:21.784414 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9add92-2cbb-4f4b-9eec-29560f17f130 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:21.784699 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9add92-2cbb-4f4b-9eec-29560f17f130 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:21.784976 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9add92-2cbb-4f4b-9eec-29560f17f130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:21.804332 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-0a9add92-2cbb-4f4b-9eec-29560f17f130 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:21.805562 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-0a9add92-2cbb-4f4b-9eec-29560f17f130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:21.875282 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 447/892] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:21 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 04:06:21.952618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d9fc9-ce68-4ea0-9e76-db6590762749 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:21.980328 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcff51-7a19-485e-b756-9bd5606a5051 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:21.980666 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcff51-7a19-485e-b756-9bd5606a5051 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:21.980881 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcff51-7a19-485e-b756-9bd5606a5051 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:21.982582 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 448/893] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:21.988263 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1fc1f-bcee-444f-af3d-b61ab2523805 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:21.988554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1fc1f-bcee-444f-af3d-b61ab2523805 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:21.988828 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1fc1f-bcee-444f-af3d-b61ab2523805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:22.007881 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-d0e1fc1f-bcee-444f-af3d-b61ab2523805 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:22.009052 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-d0e1fc1f-bcee-444f-af3d-b61ab2523805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:22.044714 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:22.083436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d9fc9-ce68-4ea0-9e76-db6590762749 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:22.086197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 449/894] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:21 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 04:06:22.122295 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca1913-d178-439c-9b93-5fe99f45ccac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:22.123218 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca1913-d178-439c-9b93-5fe99f45ccac None admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:22.123701 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca1913-d178-439c-9b93-5fe99f45ccac None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:22.124210 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca1913-d178-439c-9b93-5fe99f45ccac None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:22.125195 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca1913-d178-439c-9b93-5fe99f45ccac None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:22.126814 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca1913-d178-439c-9b93-5fe99f45ccac None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:22.155531 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1fc1f-bcee-444f-af3d-b61ab2523805 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:22.201842 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 446/895] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 23 04:06:21 2022] POST /identity/v3/services => generated 241 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:06:22.273519 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1fc1f-bcee-444f-af3d-b61ab2523805 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:22.318539 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98063f47-f57d-4caf-9296-c843f19ca262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:22.319192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98063f47-f57d-4caf-9296-c843f19ca262 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:22.319471 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98063f47-f57d-4caf-9296-c843f19ca262 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:22.319742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98063f47-f57d-4caf-9296-c843f19ca262 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:22.320335 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98063f47-f57d-4caf-9296-c843f19ca262 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:22.321780 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98063f47-f57d-4caf-9296-c843f19ca262 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:22.331881 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-98063f47-f57d-4caf-9296-c843f19ca262 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 04:06:22.331881 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:22.331881 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 04:06:22.331881 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 04:06:22.331881 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 04:06:22.331881 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 04:06:22.331881 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 04:06:22.331881 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:22.331881 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 04:06:22.331881 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:22.331881 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 04:06:22.331881 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:22.331881 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:22.331881 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:22.331881 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:22.331881 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:22.332897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:22.332897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:22.332897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:22.332897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:22.332897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:22.332897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:22.332897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:22.332897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 04:06:22.332897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 04:06:22.332897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 04:06:22.332897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 04:06:22.332897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:22.332897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:22.332897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:22.332897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:22.332897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:22.332897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:22.333888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:22.333888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:22.333888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:22.333888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:22.333888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:22.333888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:22.333888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:22.333888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:22.333888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:22.333888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:22.333888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 04:06:22.333888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:22.333888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 04:06:22.333888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:22.333888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 450/896] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Aug 23 04:06:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:06:22.341028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca1913-d178-439c-9b93-5fe99f45ccac None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:22.365181 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98063f47-f57d-4caf-9296-c843f19ca262 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:22.374647 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:22.404011 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:22.469816 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca1913-d178-439c-9b93-5fe99f45ccac None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:22.490318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98063f47-f57d-4caf-9296-c843f19ca262 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:22.515715 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bca1e7-f3ae-4190-bb27-3ba6809aebbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:22.516749 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bca1e7-f3ae-4190-bb27-3ba6809aebbd None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:22.517325 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bca1e7-f3ae-4190-bb27-3ba6809aebbd None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:22.517660 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bca1e7-f3ae-4190-bb27-3ba6809aebbd None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:22.519036 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bca1e7-f3ae-4190-bb27-3ba6809aebbd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:22.519348 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bca1e7-f3ae-4190-bb27-3ba6809aebbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:22.521497 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bca1e7-f3ae-4190-bb27-3ba6809aebbd None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:22.527669 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd4b00-deb4-4a41-976f-8aa8e5fd762f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:22.527818 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 447/897] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 23 04:06:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:22.528253 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd4b00-deb4-4a41-976f-8aa8e5fd762f None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:22.528529 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd4b00-deb4-4a41-976f-8aa8e5fd762f None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:22.528863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd4b00-deb4-4a41-976f-8aa8e5fd762f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:22.533247 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bca1e7-f3ae-4190-bb27-3ba6809aebbd None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:22.542547 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd4b00-deb4-4a41-976f-8aa8e5fd762f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:06:22.547656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-08cd4b00-deb4-4a41-976f-8aa8e5fd762f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 04:06:22.547656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:22.547656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:22.547656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:22.547656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:22.547656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:22.547656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:22.547656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:22.547656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:22.547656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:22.547656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:22.547656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:22.547656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:06:22.547656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:06:22.547656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:06:22.547656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:06:22.548695 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:06:22.548695 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:06:22.548695 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:06:22.548695 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:06:22.548695 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:22.548695 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:22.548695 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:22.548695 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:22.548695 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:22.548695 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:22.548695 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:22.548695 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:22.548695 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:22.548695 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:22.548695 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:22.548695 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:22.550035 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:22.550035 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:22.550035 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:22.550035 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:22.550035 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:06:22.550035 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:06:22.550035 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:06:22.550035 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:06:22.550035 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:06:22.550035 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:06:22.550035 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 04:06:22.550035 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:22.550035 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 451/898] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Aug 23 04:06:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:06:22.554663 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd4b00-deb4-4a41-976f-8aa8e5fd762f None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:22.649642 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:22.667886 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bca1e7-f3ae-4190-bb27-3ba6809aebbd None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:22.668392 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:22.682865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd4b00-deb4-4a41-976f-8aa8e5fd762f None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:22.706148 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79903167-41c0-4386-8f2b-c64828d514ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:22.706787 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79903167-41c0-4386-8f2b-c64828d514ae None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:22.707056 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79903167-41c0-4386-8f2b-c64828d514ae None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:22.707359 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79903167-41c0-4386-8f2b-c64828d514ae None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:22.708117 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79903167-41c0-4386-8f2b-c64828d514ae None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:22.708442 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79903167-41c0-4386-8f2b-c64828d514ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:22.710389 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79903167-41c0-4386-8f2b-c64828d514ae None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:22.717984 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 448/899] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 23 04:06:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:22.724556 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79903167-41c0-4386-8f2b-c64828d514ae None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:22.727654 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b58026-cdec-4d16-a88c-294c1bd1e7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:22.728509 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b58026-cdec-4d16-a88c-294c1bd1e7d0 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:22.729008 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b58026-cdec-4d16-a88c-294c1bd1e7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:22.729515 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b58026-cdec-4d16-a88c-294c1bd1e7d0 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:22.730427 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b58026-cdec-4d16-a88c-294c1bd1e7d0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:22.730957 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b58026-cdec-4d16-a88c-294c1bd1e7d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:22.732571 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b58026-cdec-4d16-a88c-294c1bd1e7d0 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:22.747408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 452/900] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Aug 23 04:06:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:22.748571 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b58026-cdec-4d16-a88c-294c1bd1e7d0 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:22.844356 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79903167-41c0-4386-8f2b-c64828d514ae None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:22.882269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac6a9d-1921-4fe5-bd54-1dbba9321b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:22.882807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b58026-cdec-4d16-a88c-294c1bd1e7d0 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:22.883576 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac6a9d-1921-4fe5-bd54-1dbba9321b99 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:22.884063 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac6a9d-1921-4fe5-bd54-1dbba9321b99 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:22.884635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac6a9d-1921-4fe5-bd54-1dbba9321b99 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:22.885579 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac6a9d-1921-4fe5-bd54-1dbba9321b99 None admin] RBAC: Adding query filter params (interface=public, service_id=843a135824d444a4b820f1d36059105e, region_id=RegionOne) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:22.886094 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac6a9d-1921-4fe5-bd54-1dbba9321b99 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:22.887659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac6a9d-1921-4fe5-bd54-1dbba9321b99 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:22.897481 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 449/901] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Aug 23 04:06:22 2022] GET /identity/v3/endpoints?service_id=843a135824d444a4b820f1d36059105e&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:22.900045 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac6a9d-1921-4fe5-bd54-1dbba9321b99 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:22.924244 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:22.926027 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c02a9b6-377c-4b53-87a7-5e737387c870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:22.926693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02a9b6-377c-4b53-87a7-5e737387c870 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:22.926956 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02a9b6-377c-4b53-87a7-5e737387c870 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:22.927221 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02a9b6-377c-4b53-87a7-5e737387c870 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:22.942115 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c02a9b6-377c-4b53-87a7-5e737387c870 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:22.943592 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c02a9b6-377c-4b53-87a7-5e737387c870 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:22.964538 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-6c02a9b6-377c-4b53-87a7-5e737387c870 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:22.964538 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:22.964538 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:22.964538 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:22.964538 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:22.964538 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:22.964538 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:22.964538 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:22.964538 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:22.964538 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:22.964538 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:22.964538 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:22.964538 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:06:22.964538 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:06:22.964538 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:06:22.964538 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:06:22.965616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:22.965616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:22.965616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:22.965616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:22.965616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:22.965616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:22.965616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:22.965616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:22.965616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:22.965616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:22.965616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:22.965616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:22.965616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:22.965616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:22.965616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:22.965616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:22.965616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:06:22.966563 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:06:22.966563 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:22.966563 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:22.969171 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 453/902] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:22.970604 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c02a9b6-377c-4b53-87a7-5e737387c870 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:22.975136 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:23.035823 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac6a9d-1921-4fe5-bd54-1dbba9321b99 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:23.080248 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c02a9b6-377c-4b53-87a7-5e737387c870 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:23.082289 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81feb55-55ff-41ae-9a3a-8c6e8478a30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:23.082919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81feb55-55ff-41ae-9a3a-8c6e8478a30f None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:23.083204 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81feb55-55ff-41ae-9a3a-8c6e8478a30f None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:23.083509 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81feb55-55ff-41ae-9a3a-8c6e8478a30f None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:23.084120 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81feb55-55ff-41ae-9a3a-8c6e8478a30f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:23.086390 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81feb55-55ff-41ae-9a3a-8c6e8478a30f None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:23.097456 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 450/903] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Aug 23 04:06:22 2022] GET /identity/v3/services => generated 1497 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:06:23.121056 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b7bbb9-fddc-4bfb-b646-baba9c51890a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:23.121716 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7bbb9-fddc-4bfb-b646-baba9c51890a None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:23.121997 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7bbb9-fddc-4bfb-b646-baba9c51890a None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:23.122271 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7bbb9-fddc-4bfb-b646-baba9c51890a None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:23.122940 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b7bbb9-fddc-4bfb-b646-baba9c51890a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:23.123243 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b7bbb9-fddc-4bfb-b646-baba9c51890a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:23.124646 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b7bbb9-fddc-4bfb-b646-baba9c51890a None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:23.139137 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 454/904] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:23.144944 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81feb55-55ff-41ae-9a3a-8c6e8478a30f None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:23.242459 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:23.258291 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81feb55-55ff-41ae-9a3a-8c6e8478a30f None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:23.294379 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f9460-8f55-4593-a03d-0eca927c3215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:23.295026 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f9460-8f55-4593-a03d-0eca927c3215 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:23.295307 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f9460-8f55-4593-a03d-0eca927c3215 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:23.295580 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f9460-8f55-4593-a03d-0eca927c3215 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:23.300868 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9a070-f9fc-4f7f-9e68-a047ea9eff8f None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:23.301182 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9a070-f9fc-4f7f-9e68-a047ea9eff8f None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:23.301454 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9a070-f9fc-4f7f-9e68-a047ea9eff8f None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:23.303196 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 455/905] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 04:06:23.306329 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f9460-8f55-4593-a03d-0eca927c3215 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:23.308130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f9460-8f55-4593-a03d-0eca927c3215 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:23.310627 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d15e2-d31a-40de-b688-d6c7f02ee3eb None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:23.311134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d15e2-d31a-40de-b688-d6c7f02ee3eb None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:23.311635 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d15e2-d31a-40de-b688-d6c7f02ee3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:23.321250 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-ff0f9460-8f55-4593-a03d-0eca927c3215 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 04:06:23.321250 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:23.321250 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:23.321250 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:23.321250 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:23.321250 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:23.321250 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:23.321250 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:23.321250 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:23.321250 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:23.321250 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:23.321250 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:23.321250 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:06:23.321250 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:06:23.321250 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:06:23.321250 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:06:23.322261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:23.322261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:23.322261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:06:23.322261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:06:23.322261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:06:23.322261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:06:23.322261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:23.322261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:23.322261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:23.322261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:23.322261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:23.322261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:23.322261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:23.322261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:23.322261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:23.322261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:23.322261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:23.322261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:23.323261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:23.323261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:23.323261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:06:23.323261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:06:23.323261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:06:23.323261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:06:23.323261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:06:23.323261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:06:23.323261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 04:06:23.323261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:23.323261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 451/906] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Aug 23 04:06:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:23.328008 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f9460-8f55-4593-a03d-0eca927c3215 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:23.334984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-5c8d15e2-d31a-40de-b688-d6c7f02ee3eb None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:23.336177 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-5c8d15e2-d31a-40de-b688-d6c7f02ee3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:23.415277 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:23.433117 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 456/907] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 04:06:23.447058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f9460-8f55-4593-a03d-0eca927c3215 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:23.483157 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06281f-43d1-4090-a88f-ecebe6a6bb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:23.483779 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06281f-43d1-4090-a88f-ecebe6a6bb67 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:23.484060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06281f-43d1-4090-a88f-ecebe6a6bb67 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:23.484335 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06281f-43d1-4090-a88f-ecebe6a6bb67 None admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:23.485068 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06281f-43d1-4090-a88f-ecebe6a6bb67 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:23.485403 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06281f-43d1-4090-a88f-ecebe6a6bb67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:23.486992 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06281f-43d1-4090-a88f-ecebe6a6bb67 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:23.506236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 452/908] 10.222.0.42 () {56 vars in 1149 bytes} [Tue Aug 23 04:06:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:23.511788 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d15e2-d31a-40de-b688-d6c7f02ee3eb None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:23.615450 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d15e2-d31a-40de-b688-d6c7f02ee3eb None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:23.651052 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f92ed-fb02-482f-9b87-82c53f904b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:23.651673 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f92ed-fb02-482f-9b87-82c53f904b82 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:23.651955 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f92ed-fb02-482f-9b87-82c53f904b82 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:23.652226 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f92ed-fb02-482f-9b87-82c53f904b82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:23.700643 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06281f-43d1-4090-a88f-ecebe6a6bb67 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:23.706409 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:23.714637 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:23.725039 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f92ed-fb02-482f-9b87-82c53f904b82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:23.730170 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f92ed-fb02-482f-9b87-82c53f904b82 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:23.811590 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06281f-43d1-4090-a88f-ecebe6a6bb67 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:23.836616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 457/909] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:06:23 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 04:06:23.837575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f92ed-fb02-482f-9b87-82c53f904b82 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:23.849494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75cc98-5413-4a68-9aa8-0f5ab4873949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:23.850478 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75cc98-5413-4a68-9aa8-0f5ab4873949 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:23.850966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75cc98-5413-4a68-9aa8-0f5ab4873949 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:23.851467 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75cc98-5413-4a68-9aa8-0f5ab4873949 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:23.852272 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75cc98-5413-4a68-9aa8-0f5ab4873949 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:23.853961 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75cc98-5413-4a68-9aa8-0f5ab4873949 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:23.863962 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-7b75cc98-5413-4a68-9aa8-0f5ab4873949 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 04:06:23.863962 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:23.863962 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 04:06:23.863962 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 04:06:23.863962 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 04:06:23.863962 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 04:06:23.863962 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 04:06:23.863962 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:23.863962 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 04:06:23.863962 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:23.863962 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 04:06:23.863962 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:23.863962 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:23.863962 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:23.863962 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:23.863962 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:23.863962 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:23.864983 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:23.864983 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:23.864983 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:23.864983 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:23.864983 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:23.864983 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:23.864983 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 04:06:23.864983 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 04:06:23.864983 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 04:06:23.864983 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 04:06:23.864983 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:23.864983 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:23.864983 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:23.864983 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:23.864983 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:23.864983 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:23.865884 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:23.865884 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:23.865884 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:23.865884 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:23.865884 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:23.865884 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:23.865884 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:23.865884 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:23.865884 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:23.865884 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:23.865884 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 04:06:23.865884 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:23.865884 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 04:06:23.865884 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:23.873039 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 453/910] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 23 04:06:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:06:23.874690 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75cc98-5413-4a68-9aa8-0f5ab4873949 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:23.961827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:23.968363 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:23.972984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f92ed-fb02-482f-9b87-82c53f904b82 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:24.012364 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75cc98-5413-4a68-9aa8-0f5ab4873949 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:24.018584 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf71e9-c568-42fa-a77a-b2f048043864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:24.019227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf71e9-c568-42fa-a77a-b2f048043864 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:24.019507 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf71e9-c568-42fa-a77a-b2f048043864 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:24.019778 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf71e9-c568-42fa-a77a-b2f048043864 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:24.032822 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf71e9-c568-42fa-a77a-b2f048043864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:24.035509 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf71e9-c568-42fa-a77a-b2f048043864 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:24.053880 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-48cf71e9-c568-42fa-a77a-b2f048043864 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:24.053880 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:24.053880 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:24.053880 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:24.053880 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:24.053880 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:24.053880 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:24.053880 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:24.053880 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:24.053880 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:24.053880 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:24.053880 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:24.053880 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:06:24.053880 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:06:24.053880 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:06:24.053880 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:06:24.055720 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:24.055720 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:24.055720 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:24.055720 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:24.055720 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:24.055720 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:24.055720 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:24.055720 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:24.055720 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:24.055720 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:24.055720 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:24.055720 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:24.055720 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:24.055720 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:24.055720 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:24.055720 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:24.055720 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:06:24.058334 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:06:24.058334 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:24.058334 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:24.058334 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 458/911] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:24.060005 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc36fd3-95b8-4315-935b-fc3286edde87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:24.060686 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc36fd3-95b8-4315-935b-fc3286edde87 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:24.060969 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc36fd3-95b8-4315-935b-fc3286edde87 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:24.061269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc36fd3-95b8-4315-935b-fc3286edde87 None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:24.061958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc36fd3-95b8-4315-935b-fc3286edde87 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:24.062211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc36fd3-95b8-4315-935b-fc3286edde87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:24.064038 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf71e9-c568-42fa-a77a-b2f048043864 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:24.065381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc36fd3-95b8-4315-935b-fc3286edde87 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:24.071539 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 454/912] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 23 04:06:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:24.079011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc36fd3-95b8-4315-935b-fc3286edde87 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:24.180624 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf71e9-c568-42fa-a77a-b2f048043864 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:24.183931 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc36fd3-95b8-4315-935b-fc3286edde87 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:24.214280 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:24.220441 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af404e1e-673d-4fca-af02-0d1a53aea236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:24.221263 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af404e1e-673d-4fca-af02-0d1a53aea236 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:24.221650 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af404e1e-673d-4fca-af02-0d1a53aea236 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:24.221765 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c9810-8e35-4d11-be32-bd77a5001648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:24.222102 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af404e1e-673d-4fca-af02-0d1a53aea236 None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:24.222687 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c9810-8e35-4d11-be32-bd77a5001648 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:24.222927 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af404e1e-673d-4fca-af02-0d1a53aea236 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:24.223331 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c9810-8e35-4d11-be32-bd77a5001648 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:24.223530 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af404e1e-673d-4fca-af02-0d1a53aea236 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:24.223895 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c9810-8e35-4d11-be32-bd77a5001648 None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:24.224688 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c9810-8e35-4d11-be32-bd77a5001648 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:24.225071 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af404e1e-673d-4fca-af02-0d1a53aea236 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:24.225357 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c9810-8e35-4d11-be32-bd77a5001648 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:24.226962 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c9810-8e35-4d11-be32-bd77a5001648 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:24.230685 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 455/913] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 23 04:06:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:24.238050 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af404e1e-673d-4fca-af02-0d1a53aea236 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:24.241901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 459/914] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:24.243098 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e2c06-21cb-44a3-9daf-d04cf0f7f60c None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:24.243389 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e2c06-21cb-44a3-9daf-d04cf0f7f60c None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:24.243663 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e2c06-21cb-44a3-9daf-d04cf0f7f60c None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:24.245046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 460/915] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:24.247685 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e2c06-21cb-44a3-9daf-d04cf0f7f60c None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:24.252616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:24.349166 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af404e1e-673d-4fca-af02-0d1a53aea236 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:24.365297 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e2c06-21cb-44a3-9daf-d04cf0f7f60c None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:24.386267 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90142f8-841d-4629-9e33-233db41edf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:24.386974 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90142f8-841d-4629-9e33-233db41edf51 None admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:24.387257 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90142f8-841d-4629-9e33-233db41edf51 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:24.387535 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90142f8-841d-4629-9e33-233db41edf51 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:24.388196 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90142f8-841d-4629-9e33-233db41edf51 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:24.389766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90142f8-841d-4629-9e33-233db41edf51 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:24.400669 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180be8fd-703b-439c-aa4d-0d76a0b38d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:24.401337 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180be8fd-703b-439c-aa4d-0d76a0b38d26 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:24.401609 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180be8fd-703b-439c-aa4d-0d76a0b38d26 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:24.401869 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180be8fd-703b-439c-aa4d-0d76a0b38d26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:24.409000 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180be8fd-703b-439c-aa4d-0d76a0b38d26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:24.410450 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180be8fd-703b-439c-aa4d-0d76a0b38d26 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:24.421213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-180be8fd-703b-439c-aa4d-0d76a0b38d26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:06:24.421213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:24.421213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:24.421213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:24.421213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:24.421213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:24.421213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:24.421213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:24.421213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:24.421213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:24.421213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:24.421213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:24.421213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:06:24.421213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:06:24.421213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:06:24.422109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:06:24.422109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:24.422109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:24.422109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:24.422109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:24.422109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:24.422109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:24.422109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:24.422109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:24.422109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:24.422109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:24.422109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:24.422109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:24.422109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:24.422109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:24.422109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:24.422109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:24.428288 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:06:24.428288 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:06:24.428288 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:06:24.428288 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:06:24.428288 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:06:24.428288 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:06:24.428288 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:06:24.428288 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:24.428288 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 461/916] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:06:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:06:24.428288 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebebd5-a1e7-496e-89c6-11634eb6bd1b None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:24.428288 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebebd5-a1e7-496e-89c6-11634eb6bd1b None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:24.428901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebebd5-a1e7-496e-89c6-11634eb6bd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:24.442479 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-a6ebebd5-a1e7-496e-89c6-11634eb6bd1b None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:24.443646 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-a6ebebd5-a1e7-496e-89c6-11634eb6bd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:24.454273 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 456/917] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:06:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:06:24.456549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90142f8-841d-4629-9e33-233db41edf51 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:24.523835 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:24.527120 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:24.543070 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 462/918] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:24.599604 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90142f8-841d-4629-9e33-233db41edf51 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:24.634308 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32a862-d62e-4095-b51e-b7a124aef76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:24.634925 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32a862-d62e-4095-b51e-b7a124aef76c None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:24.635264 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32a862-d62e-4095-b51e-b7a124aef76c None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:24.635542 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32a862-d62e-4095-b51e-b7a124aef76c None admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:24.636335 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32a862-d62e-4095-b51e-b7a124aef76c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:24.636680 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32a862-d62e-4095-b51e-b7a124aef76c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:24.638098 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32a862-d62e-4095-b51e-b7a124aef76c None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:24.651526 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 457/919] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:06:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:24.657370 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebebd5-a1e7-496e-89c6-11634eb6bd1b None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:24.761584 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebebd5-a1e7-496e-89c6-11634eb6bd1b None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:24.797215 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45912b-b2e4-437d-a72f-c8461ff6156f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:24.797832 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45912b-b2e4-437d-a72f-c8461ff6156f None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:24.798110 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45912b-b2e4-437d-a72f-c8461ff6156f None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:24.804569 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45912b-b2e4-437d-a72f-c8461ff6156f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:24.804569 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed45912b-b2e4-437d-a72f-c8461ff6156f None admin] RBAC: Adding query filter params (role.id=3c58c3168e8e4a6d8bcb887f5c3f4a10, scope.project.id=a7ada12a1e3a42949c00f483efd522ba, user.id=826b9a7c343b4dbc9aeb3dbc0b75fc92) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:24.804569 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed45912b-b2e4-437d-a72f-c8461ff6156f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:24.804569 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed45912b-b2e4-437d-a72f-c8461ff6156f None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:24.807818 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 463/920] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:06:24 2022] GET /identity/v3/role_assignments?user.id=826b9a7c343b4dbc9aeb3dbc0b75fc92&scope.project.id=a7ada12a1e3a42949c00f483efd522ba&role.id=3c58c3168e8e4a6d8bcb887f5c3f4a10 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:24.823419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32a862-d62e-4095-b51e-b7a124aef76c None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:24.937168 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32a862-d62e-4095-b51e-b7a124aef76c None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:24.964651 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:24.975851 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d548328-cd0c-4211-a9fc-0e96bfca5dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:24.976489 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d548328-cd0c-4211-a9fc-0e96bfca5dfb None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:24.976770 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d548328-cd0c-4211-a9fc-0e96bfca5dfb None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:24.977107 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d548328-cd0c-4211-a9fc-0e96bfca5dfb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:24.977651 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d548328-cd0c-4211-a9fc-0e96bfca5dfb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:24.979024 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d548328-cd0c-4211-a9fc-0e96bfca5dfb None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:24.988539 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-7d548328-cd0c-4211-a9fc-0e96bfca5dfb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 04:06:24.988539 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:24.988539 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 04:06:24.988539 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 04:06:24.988539 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 04:06:24.988539 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 04:06:24.988539 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 04:06:24.988539 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:24.988539 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 04:06:24.988539 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:24.988539 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 04:06:24.988539 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:24.988539 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:24.988539 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:24.988539 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:24.988539 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:24.988539 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:24.989672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:24.989672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:24.989672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:24.989672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:24.989672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:24.989672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:24.989672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 04:06:24.989672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 04:06:24.989672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 04:06:24.989672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 04:06:24.989672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:24.989672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:24.989672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:24.989672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:24.989672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:24.989672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:24.990542 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:24.990542 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:24.990542 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:24.990542 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:24.990542 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:24.990542 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:24.990542 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:24.990542 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:24.990542 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:24.990542 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:24.990542 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 04:06:24.990542 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:24.990542 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 04:06:24.990542 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:24.990542 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 458/921] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 23 04:06:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:24.996203 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45912b-b2e4-437d-a72f-c8461ff6156f None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:25.063630 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:25.111672 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45912b-b2e4-437d-a72f-c8461ff6156f None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:25.147575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958319c-9b3b-47c9-9c95-213cacc47707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:25.148200 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958319c-9b3b-47c9-9c95-213cacc47707 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:25.148484 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958319c-9b3b-47c9-9c95-213cacc47707 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:25.148760 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958319c-9b3b-47c9-9c95-213cacc47707 None admin] PATH_INFO: `/v3/services` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:25.149433 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b958319c-9b3b-47c9-9c95-213cacc47707 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:25.149739 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b958319c-9b3b-47c9-9c95-213cacc47707 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:25.151114 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b958319c-9b3b-47c9-9c95-213cacc47707 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:25.156331 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 464/922] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Aug 23 04:06:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:25.162393 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d548328-cd0c-4211-a9fc-0e96bfca5dfb None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:25.167432 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001d3be-3941-4208-9836-f867c7afa499 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:25.167727 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001d3be-3941-4208-9836-f867c7afa499 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:25.168006 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001d3be-3941-4208-9836-f867c7afa499 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:25.169629 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 465/923] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 04:06:25.174694 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8166d5-a6d6-4f63-aec5-b75dce3f68f6 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:25.175244 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8166d5-a6d6-4f63-aec5-b75dce3f68f6 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:25.175367 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8166d5-a6d6-4f63-aec5-b75dce3f68f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:25.193352 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-db8166d5-a6d6-4f63-aec5-b75dce3f68f6 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:25.195597 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-db8166d5-a6d6-4f63-aec5-b75dce3f68f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:25.267922 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 466/924] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 04:06:25.279855 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d548328-cd0c-4211-a9fc-0e96bfca5dfb None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:25.315950 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7881cd7-eee8-4dd0-a47d-70e56edcec5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:25.316563 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7881cd7-eee8-4dd0-a47d-70e56edcec5d None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:25.316895 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7881cd7-eee8-4dd0-a47d-70e56edcec5d None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:25.317208 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7881cd7-eee8-4dd0-a47d-70e56edcec5d None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:25.317847 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7881cd7-eee8-4dd0-a47d-70e56edcec5d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:25.318241 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7881cd7-eee8-4dd0-a47d-70e56edcec5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:25.319741 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7881cd7-eee8-4dd0-a47d-70e56edcec5d None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:25.328589 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 459/925] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Aug 23 04:06:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:25.331616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8166d5-a6d6-4f63-aec5-b75dce3f68f6 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:25.382019 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:25.439882 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8166d5-a6d6-4f63-aec5-b75dce3f68f6 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:25.476395 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a729a-0758-4f87-8c32-fb50d0184d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:25.476926 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a729a-0758-4f87-8c32-fb50d0184d60 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:25.477242 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a729a-0758-4f87-8c32-fb50d0184d60 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:25.477517 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a729a-0758-4f87-8c32-fb50d0184d60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:25.478225 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a729a-0758-4f87-8c32-fb50d0184d60 None admin] RBAC: Adding query filter params (interface=public, service_id=cd8e234366804b5d9217fdbeead249b7, region_id=RegionOne) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:25.478534 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a729a-0758-4f87-8c32-fb50d0184d60 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:25.479901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a729a-0758-4f87-8c32-fb50d0184d60 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:25.487789 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 467/926] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Aug 23 04:06:25 2022] GET /identity/v3/endpoints?service_id=cd8e234366804b5d9217fdbeead249b7&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:25.494433 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7881cd7-eee8-4dd0-a47d-70e56edcec5d None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:25.537171 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:25.558590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a729a-0758-4f87-8c32-fb50d0184d60 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:25.601077 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7881cd7-eee8-4dd0-a47d-70e56edcec5d None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:25.643163 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc49ab-17b8-4559-8ccb-9fe39de5ad75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:25.643797 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc49ab-17b8-4559-8ccb-9fe39de5ad75 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:25.644066 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc49ab-17b8-4559-8ccb-9fe39de5ad75 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:25.644343 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc49ab-17b8-4559-8ccb-9fe39de5ad75 None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:25.644954 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc49ab-17b8-4559-8ccb-9fe39de5ad75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:25.646450 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc49ab-17b8-4559-8ccb-9fe39de5ad75 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:25.655796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 460/927] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Aug 23 04:06:25 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:06:25.678075 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a729a-0758-4f87-8c32-fb50d0184d60 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:25.693732 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:25.717073 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde443cd-9712-4f83-aae7-969dc86023b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:25.717750 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde443cd-9712-4f83-aae7-969dc86023b7 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:25.718032 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde443cd-9712-4f83-aae7-969dc86023b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:25.718306 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde443cd-9712-4f83-aae7-969dc86023b7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:25.718910 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde443cd-9712-4f83-aae7-969dc86023b7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:25.720305 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde443cd-9712-4f83-aae7-969dc86023b7 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:25.731030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-cde443cd-9712-4f83-aae7-969dc86023b7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 04:06:25.731030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:25.731030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 04:06:25.731030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 04:06:25.731030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 04:06:25.731030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 04:06:25.731030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 04:06:25.731030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:25.731030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 04:06:25.731030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:25.731030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 04:06:25.731030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:25.731030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:25.731030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:25.731030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:25.731030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:25.732061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:25.732061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:25.732061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:25.732061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:25.732061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:25.732061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:25.732061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:25.732061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 04:06:25.732061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 04:06:25.732061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 04:06:25.732061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 04:06:25.732061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:25.732061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:25.732061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:25.732061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:25.732061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:25.732061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:25.732986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:25.732986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:25.732986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:25.732986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:25.732986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:25.732986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:25.732986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:25.732986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:25.732986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:25.732986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:25.732986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 04:06:25.732986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:25.732986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 04:06:25.732986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:25.732986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 468/928] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Aug 23 04:06:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:25.741363 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc49ab-17b8-4559-8ccb-9fe39de5ad75 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:25.855567 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc49ab-17b8-4559-8ccb-9fe39de5ad75 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:25.857689 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:25.891339 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7f472-9f19-49bd-8e64-2c5bfdfb8c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:25.891959 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7f472-9f19-49bd-8e64-2c5bfdfb8c11 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:25.892764 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7f472-9f19-49bd-8e64-2c5bfdfb8c11 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:25.893050 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7f472-9f19-49bd-8e64-2c5bfdfb8c11 None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:25.893721 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7f472-9f19-49bd-8e64-2c5bfdfb8c11 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:25.894027 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7f472-9f19-49bd-8e64-2c5bfdfb8c11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:25.895401 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7f472-9f19-49bd-8e64-2c5bfdfb8c11 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:25.900535 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 461/929] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 23 04:06:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:25.906318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde443cd-9712-4f83-aae7-969dc86023b7 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:26.018796 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde443cd-9712-4f83-aae7-969dc86023b7 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:26.054317 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93255fe9-7a7d-4642-baed-a7b00a91cf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:26.054933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93255fe9-7a7d-4642-baed-a7b00a91cf54 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:26.055210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93255fe9-7a7d-4642-baed-a7b00a91cf54 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:26.055480 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93255fe9-7a7d-4642-baed-a7b00a91cf54 None admin] PATH_INFO: `/v3/services` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:26.056112 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93255fe9-7a7d-4642-baed-a7b00a91cf54 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:26.056413 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93255fe9-7a7d-4642-baed-a7b00a91cf54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:26.057810 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93255fe9-7a7d-4642-baed-a7b00a91cf54 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:26.063027 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 469/930] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 23 04:06:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:26.069003 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7f472-9f19-49bd-8e64-2c5bfdfb8c11 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:26.178497 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7f472-9f19-49bd-8e64-2c5bfdfb8c11 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:26.213961 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10922dc8-6c96-49e8-83b6-5f46ea986706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:26.214634 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10922dc8-6c96-49e8-83b6-5f46ea986706 None admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:26.215083 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10922dc8-6c96-49e8-83b6-5f46ea986706 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:26.215417 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10922dc8-6c96-49e8-83b6-5f46ea986706 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:26.216109 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10922dc8-6c96-49e8-83b6-5f46ea986706 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:26.217533 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10922dc8-6c96-49e8-83b6-5f46ea986706 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:26.322661 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 462/931] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:06:26 2022] POST /identity/v3/endpoints => generated 347 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:06:26.550082 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462016db-4dbe-4c7e-a399-f96eee56a932 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:26.550460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462016db-4dbe-4c7e-a399-f96eee56a932 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:26.550662 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462016db-4dbe-4c7e-a399-f96eee56a932 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:26.552201 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 470/932] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:26.557852 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887995e-10ae-44b0-ad61-ea0cd1f349d9 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:26.558149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887995e-10ae-44b0-ad61-ea0cd1f349d9 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:26.558433 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887995e-10ae-44b0-ad61-ea0cd1f349d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:26.578504 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-a887995e-10ae-44b0-ad61-ea0cd1f349d9 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:26.579624 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-a887995e-10ae-44b0-ad61-ea0cd1f349d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:26.597296 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:26.655906 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 463/933] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:26.786688 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769002a7-adc6-4c0e-8172-14a35df96c83 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:26.787030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769002a7-adc6-4c0e-8172-14a35df96c83 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:26.787253 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769002a7-adc6-4c0e-8172-14a35df96c83 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:26.788862 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 471/934] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:26.794183 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b534a3-13ca-483b-b9be-1cf6439b6ff2 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:26.794508 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b534a3-13ca-483b-b9be-1cf6439b6ff2 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:26.794792 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b534a3-13ca-483b-b9be-1cf6439b6ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:26.816423 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-f4b534a3-13ca-483b-b9be-1cf6439b6ff2 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:26.817701 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-f4b534a3-13ca-483b-b9be-1cf6439b6ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:26.893417 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 464/935] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:26.934744 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769002a7-adc6-4c0e-8172-14a35df96c83 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:26.981107 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:27.042091 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769002a7-adc6-4c0e-8172-14a35df96c83 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:27.076383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc6340-19f2-48b0-bbb9-b7a328547ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:27.076995 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc6340-19f2-48b0-bbb9-b7a328547ac1 None admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:27.077299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc6340-19f2-48b0-bbb9-b7a328547ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:27.077568 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc6340-19f2-48b0-bbb9-b7a328547ac1 None admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:27.078201 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc6340-19f2-48b0-bbb9-b7a328547ac1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:27.079666 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc6340-19f2-48b0-bbb9-b7a328547ac1 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:27.082916 dv-cinder-854070-1-smb devstack@keystone.service[82355]: WARNING keystone.server.flask.common [None req-bfbc6340-19f2-48b0-bbb9-b7a328547ac1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 23 04:06:27.131079 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.sql.core [None req-bfbc6340-19f2-48b0-bbb9-b7a328547ac1 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 04:06:27.131079 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 23 04:06:27.131079 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [parameters: {'id': 'e0e186e2b4e645e8968387d005e094f6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 23 04:06:27.131079 dv-cinder-854070-1-smb devstack@keystone.service[82355]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82355) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 04:06:27.138102 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-bfbc6340-19f2-48b0-bbb9-b7a328547ac1 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e0e186e2b4e645e8968387d005e094f6.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e0e186e2b4e645e8968387d005e094f6. Aug 23 04:06:27.138102 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:27.138102 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 04:06:27.138102 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 04:06:27.138102 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 04:06:27.138102 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 04:06:27.138102 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 04:06:27.138102 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 04:06:27.138102 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 04:06:27.138102 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application conn.query(q) Aug 23 04:06:27.138102 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 04:06:27.138102 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 04:06:27.138102 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 04:06:27.138925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application result.read() Aug 23 04:06:27.138925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 04:06:27.138925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 04:06:27.138925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 04:06:27.138925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 04:06:27.138925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 04:06:27.138925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 04:06:27.138925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 04:06:27.138925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 04:06:27.138925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 04:06:27.138925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:27.138925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 04:06:27.138925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:27.138925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:27.138925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 04:06:27.138925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 04:06:27.138925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 23 04:06:27.138925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 23 04:06:27.139927 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 04:06:27.139927 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application next(self.gen) Aug 23 04:06:27.139927 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 04:06:27.139927 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application yield resource Aug 23 04:06:27.139927 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 04:06:27.139927 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application next(self.gen) Aug 23 04:06:27.139927 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 04:06:27.139927 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 04:06:27.139927 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 04:06:27.139927 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 04:06:27.139927 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 04:06:27.139927 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise self.value Aug 23 04:06:27.139927 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 04:06:27.139927 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 04:06:27.139927 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 04:06:27.139927 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application session.commit() Aug 23 04:06:27.139927 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 04:06:27.141835 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 04:06:27.141835 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 04:06:27.141835 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 04:06:27.141835 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 04:06:27.141835 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self.session.flush() Aug 23 04:06:27.141835 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 04:06:27.141835 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 04:06:27.141835 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 04:06:27.141835 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 04:06:27.141835 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 04:06:27.141835 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application compat.raise_( Aug 23 04:06:27.141835 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 04:06:27.141835 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception Aug 23 04:06:27.141835 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 04:06:27.141835 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 04:06:27.141835 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 04:06:27.141835 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 04:06:27.144690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 04:06:27.144690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 04:06:27.144690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 04:06:27.144690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 04:06:27.144690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 23 04:06:27.144690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 23 04:06:27.144690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 04:06:27.144690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 04:06:27.144690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 04:06:27.144690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 04:06:27.144690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 04:06:27.144690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 04:06:27.144690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 04:06:27.144690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 04:06:27.144690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 04:06:27.146767 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 04:06:27.146767 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 04:06:27.146767 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception Aug 23 04:06:27.146767 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 04:06:27.146767 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 04:06:27.146767 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 04:06:27.146767 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 04:06:27.146767 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 04:06:27.146767 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 04:06:27.146767 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 04:06:27.146767 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application conn.query(q) Aug 23 04:06:27.146767 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 04:06:27.146767 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 04:06:27.146767 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 04:06:27.146767 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application result.read() Aug 23 04:06:27.146767 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 04:06:27.146767 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 04:06:27.149006 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 04:06:27.149006 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 04:06:27.149006 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 04:06:27.149006 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 04:06:27.149006 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 04:06:27.149006 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 04:06:27.149006 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 04:06:27.149006 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 23 04:06:27.149006 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [parameters: {'id': 'e0e186e2b4e645e8968387d005e094f6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 23 04:06:27.149006 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 04:06:27.149006 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:27.149006 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 04:06:27.149006 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:27.149006 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:27.149006 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 23 04:06:27.160462 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 23 04:06:27.160462 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 04:06:27.160462 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 04:06:27.160462 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 23 04:06:27.160462 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:27.160462 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 04:06:27.160462 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:27.160462 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:27.160462 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:27.160462 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:27.160462 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:27.160462 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:27.160462 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:27.160462 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:27.160462 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:27.160462 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:27.160462 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:27.162832 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:27.162832 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 23 04:06:27.162832 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 23 04:06:27.162832 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:27.162832 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:27.162832 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 23 04:06:27.162832 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 23 04:06:27.162832 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e0e186e2b4e645e8968387d005e094f6. Aug 23 04:06:27.162832 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:27.162832 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 472/936] 10.222.0.42 () {60 vars in 1140 bytes} [Tue Aug 23 04:06:26 2022] POST /identity/v3/projects => generated 262 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:27.164343 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b534a3-13ca-483b-b9be-1cf6439b6ff2 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:27.188249 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc6340-19f2-48b0-bbb9-b7a328547ac1 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:27.233226 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:27.254537 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b534a3-13ca-483b-b9be-1cf6439b6ff2 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:27.290195 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:27.293670 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19d8a8-f677-4bf8-a01b-b8d868a0ce34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:27.294290 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc6340-19f2-48b0-bbb9-b7a328547ac1 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:27.294468 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19d8a8-f677-4bf8-a01b-b8d868a0ce34 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:27.294620 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19d8a8-f677-4bf8-a01b-b8d868a0ce34 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:27.294842 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19d8a8-f677-4bf8-a01b-b8d868a0ce34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:27.302930 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19d8a8-f677-4bf8-a01b-b8d868a0ce34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:27.304378 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19d8a8-f677-4bf8-a01b-b8d868a0ce34 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:27.317025 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-cb19d8a8-f677-4bf8-a01b-b8d868a0ce34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:06:27.317025 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:27.317025 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:27.317025 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:27.317025 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:27.317025 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:27.317025 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:27.317025 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:27.317025 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:27.317025 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:27.317025 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:27.317025 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:27.317025 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:06:27.317025 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:06:27.317025 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:06:27.319358 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:06:27.319358 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:27.319358 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:27.319358 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:27.319358 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:27.319358 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:27.319358 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:27.319358 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:27.319358 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:27.319358 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:27.319358 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:27.319358 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:27.319358 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:27.319358 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:27.319358 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:27.319358 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:27.319358 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:27.321567 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:06:27.321567 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:06:27.321567 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:06:27.321567 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:06:27.321567 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:06:27.321567 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:06:27.321567 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:06:27.321567 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:27.321567 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 465/937] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:06:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:27.324317 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19d8a8-f677-4bf8-a01b-b8d868a0ce34 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:27.337560 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c142f-bdd5-4185-a813-f888a8f02ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:27.338582 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c142f-bdd5-4185-a813-f888a8f02ca7 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:27.339532 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c142f-bdd5-4185-a813-f888a8f02ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:27.339988 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c142f-bdd5-4185-a813-f888a8f02ca7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:27.354022 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c142f-bdd5-4185-a813-f888a8f02ca7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:06:27.360363 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-9c9c142f-bdd5-4185-a813-f888a8f02ca7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 04:06:27.360363 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:27.360363 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:27.360363 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:27.360363 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:27.360363 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:27.360363 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:27.360363 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:27.360363 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:27.360363 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:27.360363 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:27.360363 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:27.360363 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:06:27.360363 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:06:27.360363 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:06:27.360363 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:06:27.361873 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:06:27.361873 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:06:27.361873 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:06:27.361873 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:06:27.361873 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:27.361873 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:27.361873 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:27.361873 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:27.361873 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:27.361873 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:27.361873 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:27.361873 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:27.361873 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:27.361873 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:27.361873 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:27.361873 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:27.362742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:27.362742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:27.362742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:27.362742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:27.362742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:06:27.362742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:06:27.362742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:06:27.362742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:06:27.362742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:06:27.362742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:06:27.362742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 04:06:27.362742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:27.363385 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 473/938] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Aug 23 04:06:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:06:27.369830 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c142f-bdd5-4185-a813-f888a8f02ca7 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:27.464802 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19d8a8-f677-4bf8-a01b-b8d868a0ce34 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:27.493682 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c142f-bdd5-4185-a813-f888a8f02ca7 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:27.519580 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ce228-5763-4d55-b676-f0db7ef80987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:27.520618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ce228-5763-4d55-b676-f0db7ef80987 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:27.521003 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ce228-5763-4d55-b676-f0db7ef80987 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:27.521884 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ce228-5763-4d55-b676-f0db7ef80987 None admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:27.522942 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ce228-5763-4d55-b676-f0db7ef80987 None admin] RBAC: Adding query filter params (name=service) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:27.523379 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ce228-5763-4d55-b676-f0db7ef80987 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:27.525858 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ce228-5763-4d55-b676-f0db7ef80987 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:27.532867 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e73e75-f42e-4f9e-8555-02d1ab7ab55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:27.533992 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e73e75-f42e-4f9e-8555-02d1ab7ab55b None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:27.534272 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e73e75-f42e-4f9e-8555-02d1ab7ab55b None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:27.534542 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e73e75-f42e-4f9e-8555-02d1ab7ab55b None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:27.535276 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e73e75-f42e-4f9e-8555-02d1ab7ab55b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:27.535580 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e73e75-f42e-4f9e-8555-02d1ab7ab55b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:27.537231 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e73e75-f42e-4f9e-8555-02d1ab7ab55b None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:27.539300 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:27.548183 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 466/939] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 23 04:06:27 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:27.550879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 474/940] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Aug 23 04:06:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:27.563075 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ce228-5763-4d55-b676-f0db7ef80987 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:27.664743 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9586e5f-b84f-4dcd-a3f2-377cde5c575a None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:27.665072 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9586e5f-b84f-4dcd-a3f2-377cde5c575a None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:27.665319 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9586e5f-b84f-4dcd-a3f2-377cde5c575a None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:27.666984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 475/941] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:27.672482 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60042a60-46b2-4149-851b-d8267114271a None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:27.672769 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60042a60-46b2-4149-851b-d8267114271a None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:27.673051 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60042a60-46b2-4149-851b-d8267114271a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:27.679410 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ce228-5763-4d55-b676-f0db7ef80987 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:27.696601 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-60042a60-46b2-4149-851b-d8267114271a None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:27.698188 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-60042a60-46b2-4149-851b-d8267114271a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:27.714980 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:27.718096 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210d532-ef9e-45df-935e-1ce9121c493b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:27.718844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210d532-ef9e-45df-935e-1ce9121c493b None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:27.719232 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210d532-ef9e-45df-935e-1ce9121c493b None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:27.719608 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210d532-ef9e-45df-935e-1ce9121c493b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:27.731912 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210d532-ef9e-45df-935e-1ce9121c493b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:27.733787 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210d532-ef9e-45df-935e-1ce9121c493b None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:27.753552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-3210d532-ef9e-45df-935e-1ce9121c493b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:27.753552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:27.753552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:27.753552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:27.753552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:27.753552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:27.753552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:27.753552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:27.753552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:27.753552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:27.753552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:27.753552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:27.753552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:06:27.753552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:06:27.753552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:06:27.753552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:06:27.754796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:27.754796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:27.754796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:27.754796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:27.754796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:27.754796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:27.754796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:27.754796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:27.754796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:27.754796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:27.754796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:27.754796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:27.754796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:27.754796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:27.754796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:27.754796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:27.754796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:06:27.755901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:06:27.755901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:27.755901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:27.757134 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 467/942] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:27.762069 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210d532-ef9e-45df-935e-1ce9121c493b None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:27.787598 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 476/943] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 04:06:27.827620 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:27.883012 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210d532-ef9e-45df-935e-1ce9121c493b None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:27.918812 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9bfafe-c123-4039-a91c-42a9b02884dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:27.919735 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bfafe-c123-4039-a91c-42a9b02884dd None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:27.920166 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bfafe-c123-4039-a91c-42a9b02884dd None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:27.920609 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bfafe-c123-4039-a91c-42a9b02884dd None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:27.921452 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bfafe-c123-4039-a91c-42a9b02884dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:27.921904 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bfafe-c123-4039-a91c-42a9b02884dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:27.923443 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bfafe-c123-4039-a91c-42a9b02884dd None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:27.936439 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 468/944] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:27.942255 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60042a60-46b2-4149-851b-d8267114271a None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:28.051138 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60042a60-46b2-4149-851b-d8267114271a None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:28.085229 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9bfafe-c123-4039-a91c-42a9b02884dd None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:28.087445 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6b661-e4ca-4975-8499-7350b55defac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:28.088095 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6b661-e4ca-4975-8499-7350b55defac None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:28.088368 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6b661-e4ca-4975-8499-7350b55defac None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:28.088636 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6b661-e4ca-4975-8499-7350b55defac None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:28.100924 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6b661-e4ca-4975-8499-7350b55defac None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:28.102684 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6b661-e4ca-4975-8499-7350b55defac None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:28.117396 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-80a6b661-e4ca-4975-8499-7350b55defac None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 04:06:28.117396 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:28.117396 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:28.117396 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:28.117396 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:28.117396 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:28.117396 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:28.117396 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:28.117396 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:28.117396 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:28.117396 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:28.117396 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:28.117396 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:06:28.117396 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:06:28.117396 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:06:28.117396 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:06:28.118425 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:28.118425 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:28.118425 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:06:28.118425 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:06:28.118425 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:06:28.118425 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:06:28.118425 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:28.118425 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:28.118425 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:28.118425 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:28.118425 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:28.118425 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:28.118425 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:28.118425 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:28.118425 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:28.118425 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:28.118425 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:28.118425 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:28.119405 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:28.119405 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:28.119405 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:06:28.119405 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:06:28.119405 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:06:28.119405 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:06:28.119405 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:06:28.119405 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:06:28.119405 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 04:06:28.119405 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:28.119405 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 477/945] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Aug 23 04:06:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:28.125762 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6b661-e4ca-4975-8499-7350b55defac None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:28.141379 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:28.234805 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9bfafe-c123-4039-a91c-42a9b02884dd None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:28.246966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:28.254975 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6b661-e4ca-4975-8499-7350b55defac None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:28.272713 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a67541-7625-40d6-a88f-c87b8441551a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:28.273809 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a67541-7625-40d6-a88f-c87b8441551a None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:28.274320 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a67541-7625-40d6-a88f-c87b8441551a None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:28.274844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a67541-7625-40d6-a88f-c87b8441551a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:28.275647 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a67541-7625-40d6-a88f-c87b8441551a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:28.277255 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a67541-7625-40d6-a88f-c87b8441551a None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:28.288188 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-24a67541-7625-40d6-a88f-c87b8441551a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 04:06:28.288188 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:28.288188 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 04:06:28.288188 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 04:06:28.288188 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 04:06:28.288188 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 04:06:28.288188 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 04:06:28.288188 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:28.288188 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 04:06:28.288188 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:28.288188 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 04:06:28.288188 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:28.288188 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:28.288188 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:28.288188 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:28.288188 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:28.288188 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:28.289263 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:28.289263 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:28.289263 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:28.289263 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:28.289263 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:28.289263 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:28.289263 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 04:06:28.289263 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 04:06:28.289263 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 04:06:28.289263 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 04:06:28.289263 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:28.289263 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:28.289263 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:28.289263 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:28.289263 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:28.289263 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:28.290130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:28.290130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:28.290130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:28.290130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:28.290130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:28.290130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:28.290130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:28.290130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:28.290130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:28.290130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:28.290130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 04:06:28.290130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:28.290130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 04:06:28.290130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:28.293424 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 469/946] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 23 04:06:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:28.296301 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a67541-7625-40d6-a88f-c87b8441551a None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:28.298713 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c04ce-e3a6-45c0-9515-cb9e5de72d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:28.299337 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c04ce-e3a6-45c0-9515-cb9e5de72d1b None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:28.299625 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c04ce-e3a6-45c0-9515-cb9e5de72d1b None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:28.299976 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c04ce-e3a6-45c0-9515-cb9e5de72d1b None admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:28.300638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c04ce-e3a6-45c0-9515-cb9e5de72d1b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:28.300949 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c04ce-e3a6-45c0-9515-cb9e5de72d1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:28.302756 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c04ce-e3a6-45c0-9515-cb9e5de72d1b None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:28.324945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 478/947] 10.222.0.42 () {56 vars in 1149 bytes} [Tue Aug 23 04:06:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:28.328093 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c04ce-e3a6-45c0-9515-cb9e5de72d1b None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:28.409897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:28.422309 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a67541-7625-40d6-a88f-c87b8441551a None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:28.449189 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c04ce-e3a6-45c0-9515-cb9e5de72d1b None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:28.458882 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927dad0-65b9-422d-a370-d59ddc7f68af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:28.459500 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927dad0-65b9-422d-a370-d59ddc7f68af None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:28.459782 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927dad0-65b9-422d-a370-d59ddc7f68af None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:28.460252 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927dad0-65b9-422d-a370-d59ddc7f68af None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:28.460685 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927dad0-65b9-422d-a370-d59ddc7f68af None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:28.460992 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927dad0-65b9-422d-a370-d59ddc7f68af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:28.462400 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927dad0-65b9-422d-a370-d59ddc7f68af None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:28.467399 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 470/948] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Aug 23 04:06:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:28.468521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724f78a-c8e8-458b-bb32-0269da43941b None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:28.468813 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724f78a-c8e8-458b-bb32-0269da43941b None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:28.469116 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724f78a-c8e8-458b-bb32-0269da43941b None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:28.470505 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 471/949] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:28.473912 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724f78a-c8e8-458b-bb32-0269da43941b None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:28.496115 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc8307-ebf0-497b-bb1c-c1a46b85247a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:28.497045 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc8307-ebf0-497b-bb1c-c1a46b85247a None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:28.497591 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc8307-ebf0-497b-bb1c-c1a46b85247a None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:28.498083 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc8307-ebf0-497b-bb1c-c1a46b85247a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:28.510538 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc8307-ebf0-497b-bb1c-c1a46b85247a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:28.512454 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc8307-ebf0-497b-bb1c-c1a46b85247a None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:28.520053 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:28.527554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-70dc8307-ebf0-497b-bb1c-c1a46b85247a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:28.527554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:28.527554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:28.527554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:28.527554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:28.527554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:28.527554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:28.527554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:28.527554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:28.527554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:28.527554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:28.527554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:28.527554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:06:28.527554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:06:28.527554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:06:28.527554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:06:28.532162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:28.532162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:28.532162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:28.532162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:28.532162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:28.532162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:28.532162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:28.532162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:28.532162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:28.532162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:28.532162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:28.532162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:28.532162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:28.532162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:28.532162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:28.532162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:28.532162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:06:28.533377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:06:28.533377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:28.533377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:28.534084 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 479/950] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:28.535325 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab39587-a1a6-418c-87c5-7858162ecbba None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:28.535605 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab39587-a1a6-418c-87c5-7858162ecbba None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:28.535882 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab39587-a1a6-418c-87c5-7858162ecbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:28.554275 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-3ab39587-a1a6-418c-87c5-7858162ecbba None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:28.555393 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-3ab39587-a1a6-418c-87c5-7858162ecbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:28.587835 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724f78a-c8e8-458b-bb32-0269da43941b None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:28.623896 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da9c2d-4396-4862-8fa7-491ef0ac2da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:28.624501 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da9c2d-4396-4862-8fa7-491ef0ac2da7 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:28.624785 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da9c2d-4396-4862-8fa7-491ef0ac2da7 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:28.625060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da9c2d-4396-4862-8fa7-491ef0ac2da7 None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:28.625730 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da9c2d-4396-4862-8fa7-491ef0ac2da7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:28.626036 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da9c2d-4396-4862-8fa7-491ef0ac2da7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:28.627930 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da9c2d-4396-4862-8fa7-491ef0ac2da7 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:28.633263 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 480/951] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:28.633263 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab39587-a1a6-418c-87c5-7858162ecbba None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:28.638125 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 472/952] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Aug 23 04:06:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:28.643972 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da9c2d-4396-4862-8fa7-491ef0ac2da7 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:28.695751 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:28.752125 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab39587-a1a6-418c-87c5-7858162ecbba None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:28.774921 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da9c2d-4396-4862-8fa7-491ef0ac2da7 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:28.776988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:28.790586 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56248e-c6de-440c-ae93-214fe3a8e4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:28.791331 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56248e-c6de-440c-ae93-214fe3a8e4fe None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:28.791708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56248e-c6de-440c-ae93-214fe3a8e4fe None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:28.792074 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56248e-c6de-440c-ae93-214fe3a8e4fe None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:28.793023 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee56248e-c6de-440c-ae93-214fe3a8e4fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:28.793236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee56248e-c6de-440c-ae93-214fe3a8e4fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:28.794716 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee56248e-c6de-440c-ae93-214fe3a8e4fe None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:28.809220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 481/953] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:28.815624 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56248e-c6de-440c-ae93-214fe3a8e4fe None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:28.819686 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acaa241-0bea-4e47-b685-189668bc346b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:28.820382 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaa241-0bea-4e47-b685-189668bc346b None admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:28.824063 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaa241-0bea-4e47-b685-189668bc346b None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:28.824063 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaa241-0bea-4e47-b685-189668bc346b None admin] PATH_INFO: `/v3/endpoints` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:28.824063 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acaa241-0bea-4e47-b685-189668bc346b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:28.824063 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acaa241-0bea-4e47-b685-189668bc346b None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:28.905206 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 473/954] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:06:28 2022] POST /identity/v3/endpoints => generated 349 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:06:28.910096 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acaa241-0bea-4e47-b685-189668bc346b None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:28.931306 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56248e-c6de-440c-ae93-214fe3a8e4fe None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:28.942613 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:28.976856 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef08159-e7e9-4401-9cfe-473ea788460a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:28.977700 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef08159-e7e9-4401-9cfe-473ea788460a None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:28.978082 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef08159-e7e9-4401-9cfe-473ea788460a None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:28.978460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef08159-e7e9-4401-9cfe-473ea788460a None admin] PATH_INFO: `/v3/projects/service` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:28.987901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef08159-e7e9-4401-9cfe-473ea788460a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:28.989586 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef08159-e7e9-4401-9cfe-473ea788460a None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:29.002864 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-2ef08159-e7e9-4401-9cfe-473ea788460a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:06:29.002864 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:29.002864 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:29.002864 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:29.002864 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:29.002864 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:29.002864 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:29.002864 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:29.002864 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:29.002864 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:29.002864 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:29.002864 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:29.002864 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:06:29.002864 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:06:29.002864 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:06:29.004119 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:06:29.004119 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:29.004119 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:29.004119 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:29.004119 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:29.004119 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:29.004119 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:29.004119 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:29.004119 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:29.004119 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:29.004119 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:29.004119 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:29.004119 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:29.004119 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:29.004119 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:29.004119 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:29.004119 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:29.005340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:06:29.005340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:06:29.005340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:06:29.005340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:06:29.005340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:06:29.005340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:06:29.005340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:06:29.005340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:29.011148 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 482/955] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:06:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:29.012282 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef08159-e7e9-4401-9cfe-473ea788460a None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:29.068412 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acaa241-0bea-4e47-b685-189668bc346b None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:29.115363 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c09af-e1a9-4d2b-b89e-caeb99c0992e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:29.116563 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c09af-e1a9-4d2b-b89e-caeb99c0992e None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:29.116949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c09af-e1a9-4d2b-b89e-caeb99c0992e None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:29.117348 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c09af-e1a9-4d2b-b89e-caeb99c0992e None admin] PATH_INFO: `/v3/services/compute` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:29.118379 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c09af-e1a9-4d2b-b89e-caeb99c0992e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:29.120135 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c09af-e1a9-4d2b-b89e-caeb99c0992e None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:29.133030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-6a9c09af-e1a9-4d2b-b89e-caeb99c0992e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 04:06:29.133030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:29.133030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 04:06:29.133030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 04:06:29.133030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 04:06:29.133030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 04:06:29.133030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 04:06:29.133030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:29.133030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 04:06:29.133030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:29.133030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 04:06:29.133030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:29.133030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:29.133030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:29.133030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:29.133030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:29.133030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:29.134391 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:29.134391 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:29.134391 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:29.134391 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:29.134391 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:29.134391 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:29.134391 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 04:06:29.134391 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 04:06:29.134391 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 04:06:29.134391 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 04:06:29.134391 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:29.134391 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:29.134391 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:29.134391 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:29.134391 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:29.134391 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:29.135320 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:29.135320 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:29.135320 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:29.135320 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:29.135320 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:29.135320 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:29.135320 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:29.135320 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:29.135320 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:29.135320 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:29.135320 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 04:06:29.135320 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:29.135320 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 04:06:29.135320 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:29.136094 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 474/956] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:06:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:29.142784 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c09af-e1a9-4d2b-b89e-caeb99c0992e None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:29.149630 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef08159-e7e9-4401-9cfe-473ea788460a None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:29.169820 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:29.194924 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d1420-9a12-4244-b155-58adbe29cf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:29.195966 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d1420-9a12-4244-b155-58adbe29cf43 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:29.196349 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d1420-9a12-4244-b155-58adbe29cf43 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:29.196747 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d1420-9a12-4244-b155-58adbe29cf43 None admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:29.197749 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d1420-9a12-4244-b155-58adbe29cf43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:29.198166 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d1420-9a12-4244-b155-58adbe29cf43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:29.200001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d1420-9a12-4244-b155-58adbe29cf43 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:29.223980 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 483/957] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:06:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:29.225833 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d1420-9a12-4244-b155-58adbe29cf43 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:29.261590 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c09af-e1a9-4d2b-b89e-caeb99c0992e None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:29.262556 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:29.310683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bbdf4-470b-4b34-a7cb-2b0529e1d90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:29.311333 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bbdf4-470b-4b34-a7cb-2b0529e1d90e None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:29.311618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bbdf4-470b-4b34-a7cb-2b0529e1d90e None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:29.311894 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bbdf4-470b-4b34-a7cb-2b0529e1d90e None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:29.312529 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36bbdf4-470b-4b34-a7cb-2b0529e1d90e None admin] RBAC: Adding query filter params (name=compute) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:29.312836 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36bbdf4-470b-4b34-a7cb-2b0529e1d90e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:29.314766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36bbdf4-470b-4b34-a7cb-2b0529e1d90e None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:29.325533 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 475/958] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 23 04:06:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:29.326364 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bbdf4-470b-4b34-a7cb-2b0529e1d90e None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:29.356272 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d1420-9a12-4244-b155-58adbe29cf43 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:29.405871 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77eb5cb-5e82-449a-a8bc-f5ca6eaa5cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:29.407804 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77eb5cb-5e82-449a-a8bc-f5ca6eaa5cce None admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:29.408275 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77eb5cb-5e82-449a-a8bc-f5ca6eaa5cce None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:29.408829 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77eb5cb-5e82-449a-a8bc-f5ca6eaa5cce None admin] PATH_INFO: `/v3/projects/a7ada12a1e3a42949c00f483efd522ba/users/826b9a7c343b4dbc9aeb3dbc0b75fc92/roles/3c58c3168e8e4a6d8bcb887f5c3f4a10` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:29.411802 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77eb5cb-5e82-449a-a8bc-f5ca6eaa5cce None admin] RBAC: Authorizing `identity:create_grant(project_id=a7ada12a1e3a42949c00f483efd522ba, user_id=826b9a7c343b4dbc9aeb3dbc0b75fc92, role_id=3c58c3168e8e4a6d8bcb887f5c3f4a10)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:29.413979 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77eb5cb-5e82-449a-a8bc-f5ca6eaa5cce None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:29.423243 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:29.438189 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bbdf4-470b-4b34-a7cb-2b0529e1d90e None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:29.472941 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9044945-f7da-4139-ac92-b504f83747ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:29.473602 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9044945-f7da-4139-ac92-b504f83747ee None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:29.473891 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9044945-f7da-4139-ac92-b504f83747ee None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:29.474169 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9044945-f7da-4139-ac92-b504f83747ee None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:29.474834 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9044945-f7da-4139-ac92-b504f83747ee None admin] RBAC: Adding query filter params (type=compute) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:29.475112 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9044945-f7da-4139-ac92-b504f83747ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:29.476484 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9044945-f7da-4139-ac92-b504f83747ee None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:29.480892 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 476/959] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 23 04:06:29 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:29.499334 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 484/960] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 23 04:06:29 2022] PUT /identity/v3/projects/a7ada12a1e3a42949c00f483efd522ba/users/826b9a7c343b4dbc9aeb3dbc0b75fc92/roles/3c58c3168e8e4a6d8bcb887f5c3f4a10 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:06:29.676159 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25738dde-0000-4422-a6d2-cfc848cb7b96 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:29.676493 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25738dde-0000-4422-a6d2-cfc848cb7b96 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:29.676728 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25738dde-0000-4422-a6d2-cfc848cb7b96 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:29.678699 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 477/961] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:29.684685 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc9c8a-79c0-48ae-8730-40ef49fa7292 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:29.685182 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc9c8a-79c0-48ae-8730-40ef49fa7292 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:29.685612 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc9c8a-79c0-48ae-8730-40ef49fa7292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:29.705735 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-8bbc9c8a-79c0-48ae-8730-40ef49fa7292 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:29.707157 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-8bbc9c8a-79c0-48ae-8730-40ef49fa7292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:29.779843 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 485/962] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:30.055345 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25738dde-0000-4422-a6d2-cfc848cb7b96 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:30.160580 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25738dde-0000-4422-a6d2-cfc848cb7b96 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:30.196611 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0cf38-ba55-4b79-a11e-3883bf62a097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:30.197534 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0cf38-ba55-4b79-a11e-3883bf62a097 None admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:30.197972 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0cf38-ba55-4b79-a11e-3883bf62a097 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:30.198444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0cf38-ba55-4b79-a11e-3883bf62a097 None admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:30.199261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e0cf38-ba55-4b79-a11e-3883bf62a097 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:30.200885 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e0cf38-ba55-4b79-a11e-3883bf62a097 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:30.203640 dv-cinder-854070-1-smb devstack@keystone.service[82354]: WARNING keystone.server.flask.common [None req-35e0cf38-ba55-4b79-a11e-3883bf62a097 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 23 04:06:30.255168 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.sql.core [None req-35e0cf38-ba55-4b79-a11e-3883bf62a097 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 04:06:30.255168 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 23 04:06:30.255168 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [parameters: {'user_id': 'f34fcb4a0a404ee0b43707c0a866be0c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 23 04:06:30.255168 dv-cinder-854070-1-smb devstack@keystone.service[82354]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82354) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 04:06:30.277998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-35e0cf38-ba55-4b79-a11e-3883bf62a097 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 23 04:06:30.277998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:30.277998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 04:06:30.277998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 04:06:30.277998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 04:06:30.277998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 04:06:30.277998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 04:06:30.277998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 04:06:30.277998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 04:06:30.277998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application conn.query(q) Aug 23 04:06:30.277998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 04:06:30.277998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 04:06:30.277998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 04:06:30.277998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application result.read() Aug 23 04:06:30.277998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 04:06:30.279295 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 04:06:30.279295 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 04:06:30.279295 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 04:06:30.279295 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 04:06:30.279295 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 04:06:30.279295 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 04:06:30.279295 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 04:06:30.279295 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 04:06:30.279295 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:30.279295 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 04:06:30.279295 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:30.279295 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:30.279295 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 04:06:30.279295 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 04:06:30.279295 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 23 04:06:30.279295 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 23 04:06:30.279295 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 04:06:30.279295 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application next(self.gen) Aug 23 04:06:30.280537 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 04:06:30.280537 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application yield resource Aug 23 04:06:30.280537 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 04:06:30.280537 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application next(self.gen) Aug 23 04:06:30.280537 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 04:06:30.280537 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 04:06:30.280537 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 04:06:30.280537 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 04:06:30.280537 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 04:06:30.280537 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise self.value Aug 23 04:06:30.280537 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 04:06:30.280537 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 04:06:30.280537 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 04:06:30.280537 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application session.commit() Aug 23 04:06:30.280537 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 04:06:30.280537 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 04:06:30.280537 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 04:06:30.281750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 04:06:30.281750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 04:06:30.281750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application self.session.flush() Aug 23 04:06:30.281750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 04:06:30.281750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 04:06:30.281750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 04:06:30.281750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 04:06:30.281750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 04:06:30.281750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application compat.raise_( Aug 23 04:06:30.281750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 04:06:30.281750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception Aug 23 04:06:30.281750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 04:06:30.281750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 04:06:30.281750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 04:06:30.281750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 04:06:30.281750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 04:06:30.281750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 04:06:30.282948 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 04:06:30.282948 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 04:06:30.282948 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 23 04:06:30.282948 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 23 04:06:30.282948 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 04:06:30.282948 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 04:06:30.282948 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 04:06:30.282948 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 04:06:30.282948 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 04:06:30.282948 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 04:06:30.282948 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 04:06:30.282948 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 04:06:30.282948 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 04:06:30.282948 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 04:06:30.282948 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 04:06:30.282948 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception Aug 23 04:06:30.283817 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 04:06:30.283817 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 04:06:30.283817 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 04:06:30.283817 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 04:06:30.283817 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 04:06:30.283817 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 04:06:30.283817 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 04:06:30.283817 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application conn.query(q) Aug 23 04:06:30.283817 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 04:06:30.283817 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 04:06:30.283817 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 04:06:30.283817 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application result.read() Aug 23 04:06:30.283817 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 04:06:30.283817 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 04:06:30.283817 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 04:06:30.283817 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 04:06:30.284692 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 04:06:30.284692 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 04:06:30.284692 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 04:06:30.284692 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 04:06:30.284692 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 04:06:30.284692 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 23 04:06:30.284692 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f34fcb4a0a404ee0b43707c0a866be0c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 23 04:06:30.284692 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 04:06:30.284692 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:30.284692 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 04:06:30.284692 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:30.284692 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:30.284692 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:30.284692 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:30.284692 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:30.285628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:30.285628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:30.285628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:30.285628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:30.285628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:30.285628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:30.285628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:30.285628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 23 04:06:30.285628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 23 04:06:30.285628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:30.285628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:30.285628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:06:30.285628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:06:30.285628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:06:30.285628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:06:30.285628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 23 04:06:30.285628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 23 04:06:30.286631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 23 04:06:30.286631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 23 04:06:30.286631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 04:06:30.286631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 04:06:30.286631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 23 04:06:30.286631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:30.288751 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 478/963] 10.222.0.42 () {60 vars in 1131 bytes} [Tue Aug 23 04:06:30 2022] POST /identity/v3/users => generated 160 bytes in 234 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:30.295265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc9c8a-79c0-48ae-8730-40ef49fa7292 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:30.325461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:30.404969 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc9c8a-79c0-48ae-8730-40ef49fa7292 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:30.445832 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46787098-6add-4184-8bbe-f49f2e92fa50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:30.446480 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46787098-6add-4184-8bbe-f49f2e92fa50 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:30.446814 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46787098-6add-4184-8bbe-f49f2e92fa50 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:30.447090 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46787098-6add-4184-8bbe-f49f2e92fa50 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:30.454871 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46787098-6add-4184-8bbe-f49f2e92fa50 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:30.456322 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46787098-6add-4184-8bbe-f49f2e92fa50 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:30.467904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-46787098-6add-4184-8bbe-f49f2e92fa50 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 04:06:30.467904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:30.467904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:30.467904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:30.467904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:30.467904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:30.467904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:30.467904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:30.467904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:30.467904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:30.467904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:30.467904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:30.467904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:06:30.467904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:06:30.467904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:06:30.467904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:06:30.468863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:30.468863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:30.468863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:06:30.468863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:06:30.468863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:06:30.468863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:06:30.468863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:30.468863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:30.468863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:30.468863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:30.468863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:30.468863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:30.468863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:30.468863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:30.468863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:30.468863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:30.468863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:30.468863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:30.469867 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:30.469867 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:30.469867 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:06:30.469867 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:06:30.469867 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:06:30.469867 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:06:30.469867 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:06:30.469867 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:06:30.469867 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 04:06:30.469867 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:30.469867 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 486/964] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:06:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:30.477598 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0cf38-ba55-4b79-a11e-3883bf62a097 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:30.505707 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:30.589245 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0cf38-ba55-4b79-a11e-3883bf62a097 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:30.630697 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac36e6-6bed-42f4-9d89-14ada6f939fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:30.631702 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac36e6-6bed-42f4-9d89-14ada6f939fb None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:30.632191 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac36e6-6bed-42f4-9d89-14ada6f939fb None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:30.632670 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac36e6-6bed-42f4-9d89-14ada6f939fb None admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:30.633654 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac36e6-6bed-42f4-9d89-14ada6f939fb None admin] RBAC: Adding query filter params (name=cinder) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:30.634165 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac36e6-6bed-42f4-9d89-14ada6f939fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:30.636002 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac36e6-6bed-42f4-9d89-14ada6f939fb None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:30.678172 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 479/965] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 23 04:06:30 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:30.863477 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0daf8b-0984-4633-87a7-e7f1221c2ee8 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:30.863477 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0daf8b-0984-4633-87a7-e7f1221c2ee8 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:30.863477 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0daf8b-0984-4633-87a7-e7f1221c2ee8 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:30.863477 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 487/966] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:30.869124 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de69ff3-360b-4aae-93d8-59bf6497ce5f None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:30.869488 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de69ff3-360b-4aae-93d8-59bf6497ce5f None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:30.869842 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de69ff3-360b-4aae-93d8-59bf6497ce5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:30.889135 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-1de69ff3-360b-4aae-93d8-59bf6497ce5f None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:30.890983 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-1de69ff3-360b-4aae-93d8-59bf6497ce5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:30.959647 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:30.964794 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 480/967] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:31.232612 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0daf8b-0984-4633-87a7-e7f1221c2ee8 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:31.312917 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:31.341576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0daf8b-0984-4633-87a7-e7f1221c2ee8 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:31.378301 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08358398-aaa3-4445-b27d-ec92b394f587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:31.378942 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08358398-aaa3-4445-b27d-ec92b394f587 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:31.379227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08358398-aaa3-4445-b27d-ec92b394f587 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:31.379504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08358398-aaa3-4445-b27d-ec92b394f587 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:31.380098 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08358398-aaa3-4445-b27d-ec92b394f587 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:31.381506 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08358398-aaa3-4445-b27d-ec92b394f587 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:31.390199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-08358398-aaa3-4445-b27d-ec92b394f587 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 04:06:31.390199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:31.390199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 04:06:31.390199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 04:06:31.390199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 04:06:31.390199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 04:06:31.390199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 04:06:31.390199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:31.390199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 04:06:31.390199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:31.390199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 04:06:31.390199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:31.390199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:31.390199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:31.390199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:31.390199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:31.390199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:31.391219 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:31.391219 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:31.391219 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:31.391219 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:31.391219 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:31.391219 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:31.391219 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 04:06:31.391219 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 04:06:31.391219 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 04:06:31.391219 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 04:06:31.391219 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:31.391219 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:31.391219 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:31.391219 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:31.391219 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:31.391219 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:31.392595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:31.392595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:31.392595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:31.392595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:31.392595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:31.392595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:31.392595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:31.392595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:31.392595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:31.392595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:31.392595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 04:06:31.392595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:31.392595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 04:06:31.392595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:31.394027 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 488/968] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 23 04:06:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:31.397766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de69ff3-360b-4aae-93d8-59bf6497ce5f None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:31.472129 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab286ff0-63fc-49dd-a150-7136d8740d80 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:31.472456 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab286ff0-63fc-49dd-a150-7136d8740d80 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:31.472701 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab286ff0-63fc-49dd-a150-7136d8740d80 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:31.474223 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 489/969] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 04:06:31.479155 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241af0c-f5ce-41d5-b058-cd1c63cde8cf None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:31.479439 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241af0c-f5ce-41d5-b058-cd1c63cde8cf None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:31.479708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241af0c-f5ce-41d5-b058-cd1c63cde8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:31.497496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-a241af0c-f5ce-41d5-b058-cd1c63cde8cf None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:31.498604 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-a241af0c-f5ce-41d5-b058-cd1c63cde8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:31.499865 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de69ff3-360b-4aae-93d8-59bf6497ce5f None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:31.534343 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc1b75-d7d4-464f-8655-e5b291d8eaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:31.534959 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc1b75-d7d4-464f-8655-e5b291d8eaa7 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:31.535243 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc1b75-d7d4-464f-8655-e5b291d8eaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:31.535518 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc1b75-d7d4-464f-8655-e5b291d8eaa7 None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:31.536153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc1b75-d7d4-464f-8655-e5b291d8eaa7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:31.536460 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc1b75-d7d4-464f-8655-e5b291d8eaa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:31.537856 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc1b75-d7d4-464f-8655-e5b291d8eaa7 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:31.542614 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 481/970] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Aug 23 04:06:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:31.543750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ca197-9353-41a1-9852-120d6e39938a None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:31.544039 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ca197-9353-41a1-9852-120d6e39938a None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:31.544318 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ca197-9353-41a1-9852-120d6e39938a None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:31.545549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 482/971] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:31.548491 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ca197-9353-41a1-9852-120d6e39938a None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:31.571978 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 490/972] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 04:06:31.573331 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142567d5-79ca-48a6-916b-2e39088042bf None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:31.573616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142567d5-79ca-48a6-916b-2e39088042bf None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:31.573888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142567d5-79ca-48a6-916b-2e39088042bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:31.593115 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-142567d5-79ca-48a6-916b-2e39088042bf None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:31.594632 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-142567d5-79ca-48a6-916b-2e39088042bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:31.615201 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:31.654562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ca197-9353-41a1-9852-120d6e39938a None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:31.660416 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:31.665985 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 491/973] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:31.693643 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319de1c-0c99-45e8-9686-3c0eb733fea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:31.694253 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319de1c-0c99-45e8-9686-3c0eb733fea8 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:31.694532 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319de1c-0c99-45e8-9686-3c0eb733fea8 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:31.694802 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319de1c-0c99-45e8-9686-3c0eb733fea8 None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:31.695423 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319de1c-0c99-45e8-9686-3c0eb733fea8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:31.695725 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319de1c-0c99-45e8-9686-3c0eb733fea8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:31.697080 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319de1c-0c99-45e8-9686-3c0eb733fea8 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:31.707139 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 483/974] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Aug 23 04:06:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:31.708684 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142567d5-79ca-48a6-916b-2e39088042bf None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:31.808544 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142567d5-79ca-48a6-916b-2e39088042bf None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:31.841995 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319de1c-0c99-45e8-9686-3c0eb733fea8 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:31.844259 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149764af-6f30-43d2-bb64-6bb477f9effc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:31.845731 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149764af-6f30-43d2-bb64-6bb477f9effc None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:31.846019 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149764af-6f30-43d2-bb64-6bb477f9effc None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:31.846328 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149764af-6f30-43d2-bb64-6bb477f9effc None admin] PATH_INFO: `/v3/endpoints` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:31.848037 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149764af-6f30-43d2-bb64-6bb477f9effc None admin] RBAC: Adding query filter params (interface=admin, service_id=cd8e234366804b5d9217fdbeead249b7, region_id=RegionOne) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:31.848359 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149764af-6f30-43d2-bb64-6bb477f9effc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:31.849774 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149764af-6f30-43d2-bb64-6bb477f9effc None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:31.860529 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 492/975] 10.222.0.42 () {56 vars in 1249 bytes} [Tue Aug 23 04:06:31 2022] GET /identity/v3/endpoints?service_id=cd8e234366804b5d9217fdbeead249b7&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:31.861806 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149764af-6f30-43d2-bb64-6bb477f9effc None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:31.930758 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:31.953989 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319de1c-0c99-45e8-9686-3c0eb733fea8 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:31.970986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149764af-6f30-43d2-bb64-6bb477f9effc None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:31.981504 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:31.989147 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47730cd-542d-4a65-840a-2e6dd6771fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:31.992182 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47730cd-542d-4a65-840a-2e6dd6771fa9 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:31.992182 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47730cd-542d-4a65-840a-2e6dd6771fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:31.992182 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47730cd-542d-4a65-840a-2e6dd6771fa9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:32.000159 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47730cd-542d-4a65-840a-2e6dd6771fa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:06:32.004891 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-c47730cd-542d-4a65-840a-2e6dd6771fa9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 04:06:32.004891 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:32.004891 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:32.004891 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:32.004891 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:32.004891 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:32.004891 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:32.004891 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:32.004891 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:32.004891 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:32.004891 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:32.004891 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:32.004891 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:06:32.004891 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:06:32.004891 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:06:32.004891 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:06:32.005901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:06:32.005901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:06:32.005901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:06:32.005901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:06:32.005901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:32.005901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:32.005901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:32.005901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:32.005901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:32.005901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:32.005901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:32.005901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:32.005901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:32.005901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:32.005901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:32.005901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:32.006787 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:32.006787 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:32.006787 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:32.006787 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:32.006787 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:06:32.006787 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:06:32.006787 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:06:32.006787 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:06:32.006787 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:06:32.006787 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:06:32.006787 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 04:06:32.006787 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:32.007480 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a4d46-d249-43cf-8363-75d1fd0145a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:32.007578 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 484/976] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Aug 23 04:06:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:06:32.007578 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47730cd-542d-4a65-840a-2e6dd6771fa9 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:32.008133 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a4d46-d249-43cf-8363-75d1fd0145a3 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:32.008566 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a4d46-d249-43cf-8363-75d1fd0145a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:32.008848 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a4d46-d249-43cf-8363-75d1fd0145a3 None admin] PATH_INFO: `/v3/services` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:32.009504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a4d46-d249-43cf-8363-75d1fd0145a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:32.010964 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a4d46-d249-43cf-8363-75d1fd0145a3 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:32.017680 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 493/977] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Aug 23 04:06:31 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:06:32.017680 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a4d46-d249-43cf-8363-75d1fd0145a3 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:32.125416 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47730cd-542d-4a65-840a-2e6dd6771fa9 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:32.127761 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a4d46-d249-43cf-8363-75d1fd0145a3 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:32.155379 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:32.166341 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e12c6-c12e-4f35-b9b5-bb24147cb19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:32.166957 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e12c6-c12e-4f35-b9b5-bb24147cb19a None admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:32.167240 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e12c6-c12e-4f35-b9b5-bb24147cb19a None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:32.167514 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e12c6-c12e-4f35-b9b5-bb24147cb19a None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:32.168368 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fb4d4-a6bc-4a92-a7c6-31174b6c2159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:32.168520 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e12c6-c12e-4f35-b9b5-bb24147cb19a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:32.168665 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fb4d4-a6bc-4a92-a7c6-31174b6c2159 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:32.168665 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fb4d4-a6bc-4a92-a7c6-31174b6c2159 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:32.168891 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fb4d4-a6bc-4a92-a7c6-31174b6c2159 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:32.169623 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fb4d4-a6bc-4a92-a7c6-31174b6c2159 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:32.169764 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e12c6-c12e-4f35-b9b5-bb24147cb19a None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:32.169955 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fb4d4-a6bc-4a92-a7c6-31174b6c2159 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:32.171285 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fb4d4-a6bc-4a92-a7c6-31174b6c2159 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:32.180940 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 494/978] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Aug 23 04:06:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:32.186595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fb4d4-a6bc-4a92-a7c6-31174b6c2159 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:32.241982 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 485/979] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 23 04:06:32 2022] POST /identity/v3/services => generated 242 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:06:32.302600 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fb4d4-a6bc-4a92-a7c6-31174b6c2159 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:32.349362 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b0eb9-ed44-4da0-b76f-6911899bf988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:32.350051 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b0eb9-ed44-4da0-b76f-6911899bf988 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:32.350287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b0eb9-ed44-4da0-b76f-6911899bf988 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:32.350566 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b0eb9-ed44-4da0-b76f-6911899bf988 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:32.365175 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b0eb9-ed44-4da0-b76f-6911899bf988 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:32.369931 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b0eb9-ed44-4da0-b76f-6911899bf988 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:32.388154 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-ad8b0eb9-ed44-4da0-b76f-6911899bf988 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:32.388154 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:32.388154 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:32.388154 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:32.388154 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:32.388154 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:32.388154 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:32.388154 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:32.388154 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:32.388154 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:32.388154 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:32.388154 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:32.388154 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:06:32.388154 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:06:32.388154 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:06:32.388154 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:06:32.389307 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:32.389307 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:32.389307 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:32.389307 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:32.389307 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:32.389307 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:32.389307 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:32.389307 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:32.389307 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:32.389307 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:32.389307 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:32.389307 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:32.389307 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:32.389307 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:32.389307 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:32.389307 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:32.389307 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:06:32.390315 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:06:32.390315 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:32.390315 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:32.390315 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 495/980] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:06:32.395874 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e12c6-c12e-4f35-b9b5-bb24147cb19a None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:32.449047 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:32.503478 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e12c6-c12e-4f35-b9b5-bb24147cb19a None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:32.538981 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77697103-68be-41bd-a9a0-d64867c3d407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:32.539598 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77697103-68be-41bd-a9a0-d64867c3d407 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:32.539879 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77697103-68be-41bd-a9a0-d64867c3d407 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:32.540151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77697103-68be-41bd-a9a0-d64867c3d407 None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:32.540794 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77697103-68be-41bd-a9a0-d64867c3d407 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:32.541120 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77697103-68be-41bd-a9a0-d64867c3d407 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:32.542484 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77697103-68be-41bd-a9a0-d64867c3d407 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:32.559647 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 486/981] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:32.561244 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b0eb9-ed44-4da0-b76f-6911899bf988 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:32.598884 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:32.663679 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b0eb9-ed44-4da0-b76f-6911899bf988 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:32.698017 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ced92-65ad-415d-9caa-129d27f73ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:32.698656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ced92-65ad-415d-9caa-129d27f73ede None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:32.698936 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ced92-65ad-415d-9caa-129d27f73ede None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:32.699206 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ced92-65ad-415d-9caa-129d27f73ede None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:32.706865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ced92-65ad-415d-9caa-129d27f73ede None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:32.708311 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ced92-65ad-415d-9caa-129d27f73ede None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:32.719189 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-9c8ced92-65ad-415d-9caa-129d27f73ede None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 04:06:32.719189 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:32.719189 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:32.719189 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:32.719189 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:32.719189 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:32.719189 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:32.719189 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:32.719189 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:32.719189 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:32.719189 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:32.719189 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:32.719189 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:06:32.719189 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:06:32.719189 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:06:32.719189 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:06:32.720192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:32.720192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:32.720192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:06:32.720192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:06:32.720192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:06:32.720192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:06:32.720192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:32.720192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:32.720192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:32.720192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:32.720192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:32.720192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:32.720192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:32.720192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:32.720192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:32.720192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:32.720192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:32.720192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:32.721220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:32.721220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:32.721220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:06:32.721220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:06:32.721220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:06:32.721220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:06:32.721220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:06:32.721220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:06:32.721220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 04:06:32.721220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:32.725070 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 496/982] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Aug 23 04:06:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:32.726480 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77697103-68be-41bd-a9a0-d64867c3d407 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:32.826361 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77697103-68be-41bd-a9a0-d64867c3d407 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:32.835702 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:32.859924 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141f2f9-f524-4010-8f5d-5fbea50093d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:32.861051 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141f2f9-f524-4010-8f5d-5fbea50093d3 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:32.861360 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141f2f9-f524-4010-8f5d-5fbea50093d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:32.861683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141f2f9-f524-4010-8f5d-5fbea50093d3 None admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:32.862658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141f2f9-f524-4010-8f5d-5fbea50093d3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:32.862961 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141f2f9-f524-4010-8f5d-5fbea50093d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:32.864957 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141f2f9-f524-4010-8f5d-5fbea50093d3 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:32.883430 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 487/983] 10.222.0.42 () {56 vars in 1149 bytes} [Tue Aug 23 04:06:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:32.889036 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ced92-65ad-415d-9caa-129d27f73ede None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:32.991085 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:32.997564 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ced92-65ad-415d-9caa-129d27f73ede None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:33.030711 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf8b64-97d6-4aab-81ce-3151afdc98d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:33.031337 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf8b64-97d6-4aab-81ce-3151afdc98d6 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:33.031613 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf8b64-97d6-4aab-81ce-3151afdc98d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:33.031883 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf8b64-97d6-4aab-81ce-3151afdc98d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:33.099601 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf8b64-97d6-4aab-81ce-3151afdc98d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:33.101054 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf8b64-97d6-4aab-81ce-3151afdc98d6 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:33.198762 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:33.206333 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 497/984] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:06:32 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 04:06:33.216134 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141f2f9-f524-4010-8f5d-5fbea50093d3 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:33.316946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141f2f9-f524-4010-8f5d-5fbea50093d3 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:33.352327 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea66e39-1e5d-4ef2-9726-85a977724c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:33.352994 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea66e39-1e5d-4ef2-9726-85a977724c97 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:33.353304 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea66e39-1e5d-4ef2-9726-85a977724c97 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:33.353580 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea66e39-1e5d-4ef2-9726-85a977724c97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:33.365316 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea66e39-1e5d-4ef2-9726-85a977724c97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:33.366846 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea66e39-1e5d-4ef2-9726-85a977724c97 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:33.381547 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-6ea66e39-1e5d-4ef2-9726-85a977724c97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:33.381547 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:33.381547 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:33.381547 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:33.381547 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:33.381547 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:33.381547 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:33.381547 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:33.381547 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:33.381547 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:33.381547 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:33.381547 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:33.381547 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:06:33.381547 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:06:33.381547 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:06:33.381547 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:06:33.382521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:33.382521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:33.382521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:33.382521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:33.382521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:33.382521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:33.382521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:33.382521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:33.382521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:33.382521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:33.382521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:33.382521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:33.382521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:33.382521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:33.382521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:33.382521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:33.382521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:06:33.388047 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:06:33.388047 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:33.388047 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:33.388047 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 488/985] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:33.389736 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf8b64-97d6-4aab-81ce-3151afdc98d6 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:33.490847 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf8b64-97d6-4aab-81ce-3151afdc98d6 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:33.525139 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89af6a3-4df2-47b2-aa0d-af23c99deb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:33.525822 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89af6a3-4df2-47b2-aa0d-af23c99deb49 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:33.526115 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89af6a3-4df2-47b2-aa0d-af23c99deb49 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:33.526391 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89af6a3-4df2-47b2-aa0d-af23c99deb49 None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:33.527044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89af6a3-4df2-47b2-aa0d-af23c99deb49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:33.527349 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89af6a3-4df2-47b2-aa0d-af23c99deb49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:33.528717 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89af6a3-4df2-47b2-aa0d-af23c99deb49 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:33.544860 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 498/986] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:33.546468 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea66e39-1e5d-4ef2-9726-85a977724c97 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:33.566536 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:33.650936 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea66e39-1e5d-4ef2-9726-85a977724c97 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:33.685948 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba657b1-9ddf-40b5-9ec2-d5b8c917f0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:33.686583 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba657b1-9ddf-40b5-9ec2-d5b8c917f0d5 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:33.686871 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba657b1-9ddf-40b5-9ec2-d5b8c917f0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:33.687198 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba657b1-9ddf-40b5-9ec2-d5b8c917f0d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:33.694542 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba657b1-9ddf-40b5-9ec2-d5b8c917f0d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:33.696034 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba657b1-9ddf-40b5-9ec2-d5b8c917f0d5 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:33.708086 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-eba657b1-9ddf-40b5-9ec2-d5b8c917f0d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:06:33.708086 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:33.708086 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:33.708086 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:33.708086 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:33.708086 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:33.708086 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:33.708086 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:33.708086 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:33.708086 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:33.708086 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:33.708086 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:33.708086 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:06:33.708086 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:06:33.708086 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:06:33.709009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:06:33.709009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:33.709009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:33.709009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:33.709009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:33.709009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:33.709009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:33.709009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:33.709009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:33.709009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:33.709009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:33.709009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:33.709009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:33.709009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:33.709009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:33.709009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:33.709009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:33.710693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:06:33.710693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:06:33.710693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:06:33.710693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:06:33.710693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:06:33.710693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:06:33.710693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:06:33.710693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:33.710693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 489/987] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:06:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:06:33.717159 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89af6a3-4df2-47b2-aa0d-af23c99deb49 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:33.775530 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:33.820876 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89af6a3-4df2-47b2-aa0d-af23c99deb49 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:33.856709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74da73-23ea-43b5-99de-badf45db79a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:33.857626 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74da73-23ea-43b5-99de-badf45db79a3 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:33.858074 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74da73-23ea-43b5-99de-badf45db79a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:33.858550 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74da73-23ea-43b5-99de-badf45db79a3 None admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:33.859463 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec74da73-23ea-43b5-99de-badf45db79a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:33.859930 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec74da73-23ea-43b5-99de-badf45db79a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:33.861555 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec74da73-23ea-43b5-99de-badf45db79a3 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:33.874621 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 499/988] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:06:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:33.881932 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba657b1-9ddf-40b5-9ec2-d5b8c917f0d5 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:33.953585 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e4470-9f78-446c-8b21-d67438ac69f5 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:33.953870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e4470-9f78-446c-8b21-d67438ac69f5 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:33.954858 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e4470-9f78-446c-8b21-d67438ac69f5 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:33.957383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 500/989] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 04:06:33.962753 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa0bb5-698f-443c-8698-40c30ba68f7f None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:33.963112 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa0bb5-698f-443c-8698-40c30ba68f7f None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:33.963467 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa0bb5-698f-443c-8698-40c30ba68f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:33.975392 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:33.981415 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-eaaa0bb5-698f-443c-8698-40c30ba68f7f None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:33.982665 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-eaaa0bb5-698f-443c-8698-40c30ba68f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:33.998259 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba657b1-9ddf-40b5-9ec2-d5b8c917f0d5 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:34.036041 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8c26d-293b-4b58-bf4f-8850269d91c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:34.036580 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8c26d-293b-4b58-bf4f-8850269d91c2 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:34.036869 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8c26d-293b-4b58-bf4f-8850269d91c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:34.037178 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8c26d-293b-4b58-bf4f-8850269d91c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:34.037921 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8c26d-293b-4b58-bf4f-8850269d91c2 None admin] RBAC: Adding query filter params (role.id=3c58c3168e8e4a6d8bcb887f5c3f4a10, scope.project.id=a7ada12a1e3a42949c00f483efd522ba, user.id=826b9a7c343b4dbc9aeb3dbc0b75fc92) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:34.038330 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8c26d-293b-4b58-bf4f-8850269d91c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:34.039775 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8c26d-293b-4b58-bf4f-8850269d91c2 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:34.046132 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 490/990] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:06:33 2022] GET /identity/v3/role_assignments?user.id=826b9a7c343b4dbc9aeb3dbc0b75fc92&scope.project.id=a7ada12a1e3a42949c00f483efd522ba&role.id=3c58c3168e8e4a6d8bcb887f5c3f4a10 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:34.054863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 501/991] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:33 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:34.197158 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d52371-c1a6-4bb8-9322-dd11c8005c82 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:34.197454 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d52371-c1a6-4bb8-9322-dd11c8005c82 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:34.197728 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d52371-c1a6-4bb8-9322-dd11c8005c82 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:34.199080 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 491/992] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:34.204983 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddda96-2e0d-41fc-bc35-f637ccc1606c None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:34.205301 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddda96-2e0d-41fc-bc35-f637ccc1606c None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:34.205586 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddda96-2e0d-41fc-bc35-f637ccc1606c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:34.225656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-9eddda96-2e0d-41fc-bc35-f637ccc1606c None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:34.226862 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-9eddda96-2e0d-41fc-bc35-f637ccc1606c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:34.272765 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:34.298415 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 502/993] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:34 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 04:06:34.322550 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d52371-c1a6-4bb8-9322-dd11c8005c82 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:34.429323 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d52371-c1a6-4bb8-9322-dd11c8005c82 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:34.463419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619055b-0b33-4113-bd39-d2ee34260868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:34.464119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619055b-0b33-4113-bd39-d2ee34260868 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:34.464405 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619055b-0b33-4113-bd39-d2ee34260868 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:34.464680 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619055b-0b33-4113-bd39-d2ee34260868 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:34.465350 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619055b-0b33-4113-bd39-d2ee34260868 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:34.466722 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619055b-0b33-4113-bd39-d2ee34260868 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:34.476209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-a619055b-0b33-4113-bd39-d2ee34260868 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 04:06:34.476209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:34.476209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 04:06:34.476209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 04:06:34.476209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 04:06:34.476209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 04:06:34.476209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 04:06:34.476209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:34.476209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 04:06:34.476209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:34.476209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 04:06:34.476209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:34.476209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:34.476209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:34.476209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:34.476209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:34.476209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:34.481366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:34.481366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:34.481366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:34.481366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:34.481366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:34.481366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:34.481366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 04:06:34.481366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 04:06:34.481366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 04:06:34.481366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 04:06:34.481366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:34.481366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:34.481366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:34.481366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:34.481366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:34.481366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:34.482255 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:34.482255 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:34.482255 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:34.482255 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:34.482255 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:34.482255 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:34.482255 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:34.482255 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:34.482255 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:34.482255 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:34.482255 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 04:06:34.482255 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:34.482255 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 04:06:34.482255 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:34.482255 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 492/994] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 23 04:06:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:34.484226 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddda96-2e0d-41fc-bc35-f637ccc1606c None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:34.566481 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619055b-0b33-4113-bd39-d2ee34260868 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:34.576190 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:34.598047 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddda96-2e0d-41fc-bc35-f637ccc1606c None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:34.635628 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce3de2-44d3-415e-ba4a-8f708e4a93fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:34.636248 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce3de2-44d3-415e-ba4a-8f708e4a93fe None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:34.636533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce3de2-44d3-415e-ba4a-8f708e4a93fe None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:34.636807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce3de2-44d3-415e-ba4a-8f708e4a93fe None admin] PATH_INFO: `/v3/services` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:34.637473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce3de2-44d3-415e-ba4a-8f708e4a93fe None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:34.637787 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce3de2-44d3-415e-ba4a-8f708e4a93fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:34.639161 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce3de2-44d3-415e-ba4a-8f708e4a93fe None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:34.644211 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 503/995] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Aug 23 04:06:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:34.649598 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce3de2-44d3-415e-ba4a-8f708e4a93fe None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:34.670120 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619055b-0b33-4113-bd39-d2ee34260868 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:34.694670 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:34.706805 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0c269-e8d3-4a4f-967d-5aa685d98dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:34.707446 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0c269-e8d3-4a4f-967d-5aa685d98dd9 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:34.707719 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0c269-e8d3-4a4f-967d-5aa685d98dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:34.708003 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0c269-e8d3-4a4f-967d-5aa685d98dd9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:34.708572 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f0c269-e8d3-4a4f-967d-5aa685d98dd9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:34.709969 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f0c269-e8d3-4a4f-967d-5aa685d98dd9 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:34.718830 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-62f0c269-e8d3-4a4f-967d-5aa685d98dd9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 04:06:34.718830 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:34.718830 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 04:06:34.718830 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 04:06:34.718830 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 04:06:34.718830 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 04:06:34.718830 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 04:06:34.718830 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:34.718830 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 04:06:34.718830 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:34.718830 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 04:06:34.718830 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:34.718830 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:34.718830 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:34.718830 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:34.718830 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:34.718830 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:34.720419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:34.720419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:34.720419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:34.720419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:34.720419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:34.720419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:34.720419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 04:06:34.720419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 04:06:34.720419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 04:06:34.720419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 04:06:34.720419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:34.720419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:34.720419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:34.720419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:34.720419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:34.720419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:34.721350 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:34.721350 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:34.721350 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:34.721350 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:34.721350 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:34.721350 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:34.721350 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:34.721350 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:34.721350 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:34.721350 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:34.721350 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 04:06:34.721350 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:34.721350 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 04:06:34.721350 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:34.721350 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 493/996] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:06:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:06:34.726175 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0c269-e8d3-4a4f-967d-5aa685d98dd9 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:34.761177 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce3de2-44d3-415e-ba4a-8f708e4a93fe None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:34.797576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ca9f6-7efc-416e-86ff-93f3483332ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:34.798241 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ca9f6-7efc-416e-86ff-93f3483332ed None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:34.798568 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ca9f6-7efc-416e-86ff-93f3483332ed None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:34.798773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ca9f6-7efc-416e-86ff-93f3483332ed None admin] PATH_INFO: `/v3/services` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:34.799406 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ca9f6-7efc-416e-86ff-93f3483332ed None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:34.799708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ca9f6-7efc-416e-86ff-93f3483332ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:34.801075 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ca9f6-7efc-416e-86ff-93f3483332ed None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:34.802661 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:34.811238 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 504/997] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Aug 23 04:06:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:34.819930 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ca9f6-7efc-416e-86ff-93f3483332ed None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:34.835833 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0c269-e8d3-4a4f-967d-5aa685d98dd9 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:34.873925 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3a4a7-1142-49a8-b145-e0effd0392bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:34.874539 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3a4a7-1142-49a8-b145-e0effd0392bc None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:34.874825 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3a4a7-1142-49a8-b145-e0effd0392bc None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:34.875104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3a4a7-1142-49a8-b145-e0effd0392bc None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:34.875770 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3a4a7-1142-49a8-b145-e0effd0392bc None admin] RBAC: Adding query filter params (name=compute) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:34.876082 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3a4a7-1142-49a8-b145-e0effd0392bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:34.877483 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3a4a7-1142-49a8-b145-e0effd0392bc None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:34.885132 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 494/998] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 23 04:06:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:34.887800 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3a4a7-1142-49a8-b145-e0effd0392bc None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:34.919906 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ca9f6-7efc-416e-86ff-93f3483332ed None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:34.923270 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:34.960817 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15c6f0-61ce-4ce9-8039-48748dad27fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:34.961514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15c6f0-61ce-4ce9-8039-48748dad27fb None admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:34.961798 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15c6f0-61ce-4ce9-8039-48748dad27fb None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:34.962068 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15c6f0-61ce-4ce9-8039-48748dad27fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:34.962737 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15c6f0-61ce-4ce9-8039-48748dad27fb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:34.964097 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15c6f0-61ce-4ce9-8039-48748dad27fb None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:34.999610 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3a4a7-1142-49a8-b145-e0effd0392bc None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:35.034112 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317ca65-0f9a-4d2d-857f-b2713e689286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:35.034721 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317ca65-0f9a-4d2d-857f-b2713e689286 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:35.034999 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317ca65-0f9a-4d2d-857f-b2713e689286 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:35.035275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317ca65-0f9a-4d2d-857f-b2713e689286 None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:35.035897 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317ca65-0f9a-4d2d-857f-b2713e689286 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:35.036199 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317ca65-0f9a-4d2d-857f-b2713e689286 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:35.037757 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317ca65-0f9a-4d2d-857f-b2713e689286 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:35.038965 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:35.042970 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 495/999] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 23 04:06:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:35.049299 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317ca65-0f9a-4d2d-857f-b2713e689286 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:35.065118 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 505/1000] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:06:34 2022] POST /identity/v3/endpoints => generated 325 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:06:35.169846 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317ca65-0f9a-4d2d-857f-b2713e689286 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:35.212894 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730696c9-e370-4b2c-9416-0762dc37615e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:35.213534 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730696c9-e370-4b2c-9416-0762dc37615e None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:35.213809 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730696c9-e370-4b2c-9416-0762dc37615e None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:35.214079 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730696c9-e370-4b2c-9416-0762dc37615e None admin] PATH_INFO: `/v3/endpoints` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:35.214798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730696c9-e370-4b2c-9416-0762dc37615e None admin] RBAC: Adding query filter params (interface=public, service_id=23e28ac45bbb49a79617e4c6e40e7fc5, region_id=RegionOne) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:35.215105 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730696c9-e370-4b2c-9416-0762dc37615e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:35.216453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730696c9-e370-4b2c-9416-0762dc37615e None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:35.222334 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 496/1001] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Aug 23 04:06:35 2022] GET /identity/v3/endpoints?service_id=23e28ac45bbb49a79617e4c6e40e7fc5&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:35.227869 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15c6f0-61ce-4ce9-8039-48748dad27fb None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:35.333427 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15c6f0-61ce-4ce9-8039-48748dad27fb None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:35.366176 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa809e-9d19-4575-b740-208c745772e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:35.366781 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa809e-9d19-4575-b740-208c745772e2 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:35.367052 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa809e-9d19-4575-b740-208c745772e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:35.367316 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa809e-9d19-4575-b740-208c745772e2 None admin] PATH_INFO: `/v3/services` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:35.367926 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa809e-9d19-4575-b740-208c745772e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:35.369312 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa809e-9d19-4575-b740-208c745772e2 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:35.381150 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 506/1002] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Aug 23 04:06:35 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:06:35.992375 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411024a5-c05d-458b-a4ce-b87c7911db41 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:35.992854 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411024a5-c05d-458b-a4ce-b87c7911db41 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:35.992958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411024a5-c05d-458b-a4ce-b87c7911db41 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:35.994440 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 497/1003] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:35.999514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6fc0e-aced-4c06-961a-f387e4c8404e None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:35.999891 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6fc0e-aced-4c06-961a-f387e4c8404e None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:36.000061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6fc0e-aced-4c06-961a-f387e4c8404e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:36.019103 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-60c6fc0e-aced-4c06-961a-f387e4c8404e None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:36.020298 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-60c6fc0e-aced-4c06-961a-f387e4c8404e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:36.043314 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:36.093152 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 507/1004] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:35 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:36.360617 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411024a5-c05d-458b-a4ce-b87c7911db41 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:36.423269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:36.469601 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411024a5-c05d-458b-a4ce-b87c7911db41 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:36.503815 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570452f3-b905-41bc-9a13-6062dd9804f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:36.504453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570452f3-b905-41bc-9a13-6062dd9804f1 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:36.504736 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570452f3-b905-41bc-9a13-6062dd9804f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:36.505014 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570452f3-b905-41bc-9a13-6062dd9804f1 None admin] PATH_INFO: `/v3/services/image` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:36.505630 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570452f3-b905-41bc-9a13-6062dd9804f1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:36.506999 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570452f3-b905-41bc-9a13-6062dd9804f1 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:36.515798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-570452f3-b905-41bc-9a13-6062dd9804f1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 04:06:36.515798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:36.515798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 04:06:36.515798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 04:06:36.515798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 04:06:36.515798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 04:06:36.515798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 04:06:36.515798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:36.515798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 04:06:36.515798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:36.515798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 04:06:36.515798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:36.515798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:36.515798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:36.515798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:36.515798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:36.515798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:36.516846 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:36.516846 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:36.516846 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:36.516846 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:36.516846 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:36.516846 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:36.516846 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 04:06:36.516846 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 04:06:36.516846 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 04:06:36.516846 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 04:06:36.516846 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:36.516846 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:36.516846 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:36.516846 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:36.516846 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:36.516846 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:36.517763 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:36.517763 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:36.517763 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:36.517763 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:36.517763 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:36.517763 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:36.517763 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:36.517763 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:36.517763 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:36.517763 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:36.517763 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 04:06:36.517763 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:36.517763 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 04:06:36.517763 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:36.521172 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 498/1005] 10.222.0.42 () {56 vars in 1105 bytes} [Tue Aug 23 04:06:36 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:36.522908 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6fc0e-aced-4c06-961a-f387e4c8404e None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:36.625558 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6fc0e-aced-4c06-961a-f387e4c8404e None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:36.660506 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32a0f2-2fda-477c-92ef-95e43543f131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:36.661156 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32a0f2-2fda-477c-92ef-95e43543f131 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:36.661440 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32a0f2-2fda-477c-92ef-95e43543f131 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:36.661715 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32a0f2-2fda-477c-92ef-95e43543f131 None admin] PATH_INFO: `/v3/services` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:36.662357 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32a0f2-2fda-477c-92ef-95e43543f131 None admin] RBAC: Adding query filter params (name=image) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:36.662661 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32a0f2-2fda-477c-92ef-95e43543f131 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:36.664029 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32a0f2-2fda-477c-92ef-95e43543f131 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:36.674247 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 508/1006] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:36.675449 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570452f3-b905-41bc-9a13-6062dd9804f1 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:36.775659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570452f3-b905-41bc-9a13-6062dd9804f1 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:36.799207 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:36.811368 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115a8e4-4bac-46cf-8d53-263ddcc72330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:36.811982 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115a8e4-4bac-46cf-8d53-263ddcc72330 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:36.812263 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115a8e4-4bac-46cf-8d53-263ddcc72330 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:36.812536 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115a8e4-4bac-46cf-8d53-263ddcc72330 None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:36.813219 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115a8e4-4bac-46cf-8d53-263ddcc72330 None admin] RBAC: Adding query filter params (type=image) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:36.813524 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115a8e4-4bac-46cf-8d53-263ddcc72330 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:36.814909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115a8e4-4bac-46cf-8d53-263ddcc72330 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:36.825207 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 499/1007] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:36 2022] GET /identity/v3/services?type=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:36.975634 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9d29a-50d2-4b0c-89fc-70b00ba8fd72 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:36.975919 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9d29a-50d2-4b0c-89fc-70b00ba8fd72 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:36.976190 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9d29a-50d2-4b0c-89fc-70b00ba8fd72 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:36.977584 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 509/1008] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:36.982944 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1672706-beab-49ba-8a29-791c32aa98bd None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:36.983241 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1672706-beab-49ba-8a29-791c32aa98bd None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:36.983521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1672706-beab-49ba-8a29-791c32aa98bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:37.002473 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-d1672706-beab-49ba-8a29-791c32aa98bd None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:37.003666 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-d1672706-beab-49ba-8a29-791c32aa98bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:37.073857 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 500/1009] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:36 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 04:06:37.277299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71640f-df59-40b7-856a-fec0e1397313 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:37.277807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71640f-df59-40b7-856a-fec0e1397313 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:37.277807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71640f-df59-40b7-856a-fec0e1397313 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:37.279238 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 510/1010] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:37.284961 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a609e8d-eb7c-4230-a4a8-8c631ccf0f32 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:37.285302 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a609e8d-eb7c-4230-a4a8-8c631ccf0f32 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:37.285594 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a609e8d-eb7c-4230-a4a8-8c631ccf0f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:37.305050 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-3a609e8d-eb7c-4230-a4a8-8c631ccf0f32 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:37.306270 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-3a609e8d-eb7c-4230-a4a8-8c631ccf0f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:37.341492 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71640f-df59-40b7-856a-fec0e1397313 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:37.367149 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:37.377146 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 501/1011] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:37 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:37.452551 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71640f-df59-40b7-856a-fec0e1397313 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:37.487045 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa96ca6-707b-4714-8025-d635fffcff6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:37.487954 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa96ca6-707b-4714-8025-d635fffcff6e None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:37.488419 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa96ca6-707b-4714-8025-d635fffcff6e None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:37.488866 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa96ca6-707b-4714-8025-d635fffcff6e None admin] PATH_INFO: `/v3/domains/default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:37.490181 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa96ca6-707b-4714-8025-d635fffcff6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:37.491777 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa96ca6-707b-4714-8025-d635fffcff6e None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:37.493904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 511/1012] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:37.499412 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a609e8d-eb7c-4230-a4a8-8c631ccf0f32 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:37.550340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:37.604786 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a609e8d-eb7c-4230-a4a8-8c631ccf0f32 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:37.638679 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fccd4c-9e72-4751-8ced-bc31e76381e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:37.639288 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fccd4c-9e72-4751-8ced-bc31e76381e6 None admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:37.639571 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fccd4c-9e72-4751-8ced-bc31e76381e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:37.639853 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fccd4c-9e72-4751-8ced-bc31e76381e6 None admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:37.640494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fccd4c-9e72-4751-8ced-bc31e76381e6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:37.642016 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fccd4c-9e72-4751-8ced-bc31e76381e6 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:37.653123 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa96ca6-707b-4714-8025-d635fffcff6e None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:37.715357 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 502/1013] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 23 04:06:37 2022] POST /identity/v3/projects => generated 311 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:06:37.754582 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:37.764881 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa96ca6-707b-4714-8025-d635fffcff6e None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:37.804453 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75835fc-70f3-4309-a9a9-cd45f6c59dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:37.805020 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75835fc-70f3-4309-a9a9-cd45f6c59dc7 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:37.805327 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75835fc-70f3-4309-a9a9-cd45f6c59dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:37.805599 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75835fc-70f3-4309-a9a9-cd45f6c59dc7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:37.806261 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75835fc-70f3-4309-a9a9-cd45f6c59dc7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:37.807683 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75835fc-70f3-4309-a9a9-cd45f6c59dc7 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:37.817515 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-b75835fc-70f3-4309-a9a9-cd45f6c59dc7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 04:06:37.817515 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:37.817515 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 04:06:37.817515 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 04:06:37.817515 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 04:06:37.817515 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 04:06:37.817515 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 04:06:37.817515 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:37.817515 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 04:06:37.817515 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:37.817515 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 04:06:37.817515 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:37.817515 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:37.817515 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:37.817515 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:37.817515 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:37.817515 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:37.818641 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:37.818641 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:37.818641 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:37.818641 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:37.818641 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:37.818641 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:37.818641 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 04:06:37.818641 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 04:06:37.818641 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 04:06:37.818641 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 04:06:37.818641 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:37.818641 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:37.818641 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:37.818641 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:37.818641 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:37.818641 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:37.822246 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:37.822246 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:37.822246 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:37.822246 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:37.822246 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:37.822246 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:37.822246 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:37.822246 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:37.822246 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:37.822246 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:37.822246 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 04:06:37.822246 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:37.822246 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 04:06:37.822246 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:37.822246 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 512/1014] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:06:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:06:37.825012 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fccd4c-9e72-4751-8ced-bc31e76381e6 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:37.930222 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:37.934382 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fccd4c-9e72-4751-8ced-bc31e76381e6 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:37.976037 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce318d3-a11c-456a-97b2-d69dcb9b93c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:37.976659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce318d3-a11c-456a-97b2-d69dcb9b93c6 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:37.976938 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce318d3-a11c-456a-97b2-d69dcb9b93c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:37.977242 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce318d3-a11c-456a-97b2-d69dcb9b93c6 None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:37.977871 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce318d3-a11c-456a-97b2-d69dcb9b93c6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:37.978172 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce318d3-a11c-456a-97b2-d69dcb9b93c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:37.979528 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce318d3-a11c-456a-97b2-d69dcb9b93c6 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:37.984333 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 503/1015] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 23 04:06:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:37.990742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75835fc-70f3-4309-a9a9-cd45f6c59dc7 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:38.093587 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75835fc-70f3-4309-a9a9-cd45f6c59dc7 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:38.128105 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05820a5-a9c8-4562-aa57-4a9703145353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:38.128722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05820a5-a9c8-4562-aa57-4a9703145353 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:38.129003 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05820a5-a9c8-4562-aa57-4a9703145353 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:38.129301 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05820a5-a9c8-4562-aa57-4a9703145353 None admin] PATH_INFO: `/v3/services` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:38.129929 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05820a5-a9c8-4562-aa57-4a9703145353 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:38.130233 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05820a5-a9c8-4562-aa57-4a9703145353 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:38.131595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05820a5-a9c8-4562-aa57-4a9703145353 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:38.141134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 513/1016] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 23 04:06:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:38.142711 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce318d3-a11c-456a-97b2-d69dcb9b93c6 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:38.245506 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce318d3-a11c-456a-97b2-d69dcb9b93c6 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:38.279863 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a26ca5-8d6c-415e-8f87-c2d3139da605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:38.280829 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a26ca5-8d6c-415e-8f87-c2d3139da605 None admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:38.281330 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a26ca5-8d6c-415e-8f87-c2d3139da605 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:38.282344 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a26ca5-8d6c-415e-8f87-c2d3139da605 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:38.283226 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a26ca5-8d6c-415e-8f87-c2d3139da605 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:38.284792 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a26ca5-8d6c-415e-8f87-c2d3139da605 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:38.359759 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 504/1017] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:06:38 2022] POST /identity/v3/endpoints => generated 334 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:06:38.733966 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac81d90-b4c5-41e6-9189-00262fcd89ff None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:38.734503 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac81d90-b4c5-41e6-9189-00262fcd89ff None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:38.734585 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac81d90-b4c5-41e6-9189-00262fcd89ff None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:38.736050 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 514/1018] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:38.741534 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946bcdc-75ab-4a81-bb1c-20fa168b3a0a None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:38.742072 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946bcdc-75ab-4a81-bb1c-20fa168b3a0a None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:38.742565 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946bcdc-75ab-4a81-bb1c-20fa168b3a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:38.760838 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-3946bcdc-75ab-4a81-bb1c-20fa168b3a0a None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:38.762394 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-3946bcdc-75ab-4a81-bb1c-20fa168b3a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:38.777494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:38.839071 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 505/1019] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:38 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:39.108842 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac81d90-b4c5-41e6-9189-00262fcd89ff None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:39.129904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:39.215116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac81d90-b4c5-41e6-9189-00262fcd89ff None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:39.248496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ed9f5-ac88-4db0-8b14-9542e3bb555b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:39.249136 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ed9f5-ac88-4db0-8b14-9542e3bb555b None admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:39.249426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ed9f5-ac88-4db0-8b14-9542e3bb555b None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:39.249701 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ed9f5-ac88-4db0-8b14-9542e3bb555b None admin] PATH_INFO: `/v3/services` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:39.250943 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ed9f5-ac88-4db0-8b14-9542e3bb555b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:39.252315 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ed9f5-ac88-4db0-8b14-9542e3bb555b None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:39.337626 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 515/1020] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 23 04:06:39 2022] POST /identity/v3/services => generated 242 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:06:39.682632 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d296d4a-9327-4d79-9b09-9187ccdf1301 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:39.683190 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d296d4a-9327-4d79-9b09-9187ccdf1301 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:39.683190 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d296d4a-9327-4d79-9b09-9187ccdf1301 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:39.684782 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 506/1021] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:39.690609 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ccb3b-1e86-4fc8-ab03-dc72ea470a8c None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:39.690904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ccb3b-1e86-4fc8-ab03-dc72ea470a8c None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:39.691183 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ccb3b-1e86-4fc8-ab03-dc72ea470a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:39.709534 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-282ccb3b-1e86-4fc8-ab03-dc72ea470a8c None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:39.710723 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-282ccb3b-1e86-4fc8-ab03-dc72ea470a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:39.783728 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 516/1022] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:40.054589 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d296d4a-9327-4d79-9b09-9187ccdf1301 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:40.156022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d296d4a-9327-4d79-9b09-9187ccdf1301 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:40.191086 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372212d8-3f51-4150-9438-40686b4d636d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:40.191726 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372212d8-3f51-4150-9438-40686b4d636d None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:40.192016 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372212d8-3f51-4150-9438-40686b4d636d None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:40.192281 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372212d8-3f51-4150-9438-40686b4d636d None admin] PATH_INFO: `/v3/domains/default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:40.193437 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372212d8-3f51-4150-9438-40686b4d636d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:40.194866 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372212d8-3f51-4150-9438-40686b4d636d None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:40.196603 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 507/1023] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:40.202168 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ccb3b-1e86-4fc8-ab03-dc72ea470a8c None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:40.206086 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:40.304781 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ccb3b-1e86-4fc8-ab03-dc72ea470a8c None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:40.335172 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1503072-3345-44fe-9093-817e3a24de7b None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:40.335485 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1503072-3345-44fe-9093-817e3a24de7b None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:40.335726 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1503072-3345-44fe-9093-817e3a24de7b None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:40.337239 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 508/1024] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 04:06:40.342321 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc86f0b-5b5a-42dc-9029-dbd2584a72a5 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:40.342610 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc86f0b-5b5a-42dc-9029-dbd2584a72a5 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:40.342880 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc86f0b-5b5a-42dc-9029-dbd2584a72a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:40.345322 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f201686-b5e2-4339-9011-6c9bb9273278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:40.345948 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f201686-b5e2-4339-9011-6c9bb9273278 None admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:40.346228 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f201686-b5e2-4339-9011-6c9bb9273278 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:40.346503 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f201686-b5e2-4339-9011-6c9bb9273278 None admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:40.347157 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f201686-b5e2-4339-9011-6c9bb9273278 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:40.348601 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f201686-b5e2-4339-9011-6c9bb9273278 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:40.362638 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-acc86f0b-5b5a-42dc-9029-dbd2584a72a5 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:40.363905 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-acc86f0b-5b5a-42dc-9029-dbd2584a72a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:40.371598 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:40.432225 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 509/1025] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 04:06:40.437130 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 517/1026] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 23 04:06:40 2022] POST /identity/v3/users => generated 285 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:06:40.711805 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc86f0b-5b5a-42dc-9029-dbd2584a72a5 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:40.812362 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc86f0b-5b5a-42dc-9029-dbd2584a72a5 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:40.847769 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eeb6df-baeb-45b3-895e-8a922b2951ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:40.848406 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eeb6df-baeb-45b3-895e-8a922b2951ef None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:40.848686 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eeb6df-baeb-45b3-895e-8a922b2951ef None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:40.848958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eeb6df-baeb-45b3-895e-8a922b2951ef None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:40.859079 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eeb6df-baeb-45b3-895e-8a922b2951ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:06:40.864322 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-39eeb6df-baeb-45b3-895e-8a922b2951ef None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 04:06:40.864322 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:40.864322 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:40.864322 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:40.864322 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:40.864322 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:40.864322 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:40.864322 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:40.864322 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:40.864322 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:40.864322 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:40.864322 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:40.864322 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:06:40.864322 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:06:40.864322 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:06:40.864322 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:06:40.865519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:06:40.865519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:06:40.865519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:06:40.865519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:06:40.865519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:40.865519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:40.865519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:40.865519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:40.865519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:40.865519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:40.865519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:40.865519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:40.865519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:40.865519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:40.865519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:40.865519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:40.866899 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:40.866899 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:40.866899 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:40.866899 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:40.866899 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:06:40.866899 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:06:40.866899 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:06:40.866899 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:06:40.866899 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:06:40.866899 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:06:40.866899 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 04:06:40.866899 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:40.867870 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 510/1027] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Aug 23 04:06:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:40.871528 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f201686-b5e2-4339-9011-6c9bb9273278 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:40.931843 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:40.979105 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f201686-b5e2-4339-9011-6c9bb9273278 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:41.014044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b8ff2-0d16-466f-ad05-0f4906dd9b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:41.014657 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b8ff2-0d16-466f-ad05-0f4906dd9b9f None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:41.014971 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b8ff2-0d16-466f-ad05-0f4906dd9b9f None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:41.015202 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b8ff2-0d16-466f-ad05-0f4906dd9b9f None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:41.015898 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b8ff2-0d16-466f-ad05-0f4906dd9b9f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:41.016201 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b8ff2-0d16-466f-ad05-0f4906dd9b9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:41.017651 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b8ff2-0d16-466f-ad05-0f4906dd9b9f None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:41.025920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 518/1028] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Aug 23 04:06:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:41.031322 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eeb6df-baeb-45b3-895e-8a922b2951ef None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:41.034825 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:41.135319 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eeb6df-baeb-45b3-895e-8a922b2951ef None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:41.169480 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94470cc6-0387-41dc-80cb-b367cb9a8965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:41.170118 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94470cc6-0387-41dc-80cb-b367cb9a8965 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:41.170402 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94470cc6-0387-41dc-80cb-b367cb9a8965 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:41.170678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94470cc6-0387-41dc-80cb-b367cb9a8965 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:41.181723 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94470cc6-0387-41dc-80cb-b367cb9a8965 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:41.183171 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94470cc6-0387-41dc-80cb-b367cb9a8965 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:41.197654 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-94470cc6-0387-41dc-80cb-b367cb9a8965 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:41.197654 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:41.197654 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:41.197654 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:41.197654 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:41.197654 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:41.197654 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:41.197654 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:41.197654 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:41.197654 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:41.197654 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:41.197654 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:41.197654 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:06:41.197654 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:06:41.197654 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:06:41.197654 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:06:41.198613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:41.198613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:41.198613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:41.198613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:41.198613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:41.198613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:41.198613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:41.198613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:41.198613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:41.198613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:41.198613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:41.198613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:41.198613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:41.198613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:41.198613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:41.198613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:41.198613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:06:41.199549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:06:41.199549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:41.199549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:41.199549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 511/1029] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:06:41.206146 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b8ff2-0d16-466f-ad05-0f4906dd9b9f None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:41.264456 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669d31b-2391-42d6-8488-913d4dc903a0 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:41.264674 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669d31b-2391-42d6-8488-913d4dc903a0 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:41.264927 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669d31b-2391-42d6-8488-913d4dc903a0 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:41.266485 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 512/1030] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:41.271083 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec307b-86ad-4dae-826c-4ee85cc0cfc6 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:41.271371 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec307b-86ad-4dae-826c-4ee85cc0cfc6 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:41.271646 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec307b-86ad-4dae-826c-4ee85cc0cfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:41.293795 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-e5ec307b-86ad-4dae-826c-4ee85cc0cfc6 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:41.295277 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-e5ec307b-86ad-4dae-826c-4ee85cc0cfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:41.312544 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b8ff2-0d16-466f-ad05-0f4906dd9b9f None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:41.337553 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:41.349488 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839946e-be91-4a26-adfe-5d07415e7b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:41.350176 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839946e-be91-4a26-adfe-5d07415e7b04 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:41.350447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839946e-be91-4a26-adfe-5d07415e7b04 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:41.350720 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839946e-be91-4a26-adfe-5d07415e7b04 None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:41.351369 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839946e-be91-4a26-adfe-5d07415e7b04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:41.351671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839946e-be91-4a26-adfe-5d07415e7b04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:41.353026 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839946e-be91-4a26-adfe-5d07415e7b04 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:41.355049 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:41.365688 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 519/1031] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:41.371316 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839946e-be91-4a26-adfe-5d07415e7b04 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:41.380145 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 513/1032] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 04:06:41.473472 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839946e-be91-4a26-adfe-5d07415e7b04 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:41.508532 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe270ad-de15-4a5b-a371-f2834594a9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:41.509200 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe270ad-de15-4a5b-a371-f2834594a9ae None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:41.509487 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe270ad-de15-4a5b-a371-f2834594a9ae None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:41.509766 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe270ad-de15-4a5b-a371-f2834594a9ae None admin] PATH_INFO: `/v3/users/nova` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:41.517451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe270ad-de15-4a5b-a371-f2834594a9ae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:41.518874 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe270ad-de15-4a5b-a371-f2834594a9ae None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:41.530270 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-1fe270ad-de15-4a5b-a371-f2834594a9ae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 04:06:41.530270 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:41.530270 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:41.530270 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:41.530270 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:41.530270 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:41.530270 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:41.530270 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:41.530270 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:41.530270 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:41.530270 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:41.530270 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:41.530270 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:06:41.530270 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:06:41.530270 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:06:41.530270 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:06:41.531250 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:41.531250 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:41.531250 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:06:41.531250 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:06:41.531250 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:06:41.531250 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:06:41.531250 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:41.531250 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:41.531250 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:41.531250 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:41.531250 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:41.531250 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:41.531250 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:41.531250 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:41.531250 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:41.531250 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:41.531250 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:41.531250 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:41.532791 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:41.532791 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:41.532791 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:06:41.532791 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:06:41.532791 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:06:41.532791 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:06:41.532791 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:06:41.532791 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:06:41.532791 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 04:06:41.532791 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:41.532791 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 520/1033] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Aug 23 04:06:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:41.537623 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec307b-86ad-4dae-826c-4ee85cc0cfc6 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:41.637207 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec307b-86ad-4dae-826c-4ee85cc0cfc6 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:41.641644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe270ad-de15-4a5b-a371-f2834594a9ae None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:41.674532 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9f9a6-aaee-4f9e-a928-41415cd1d8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:41.675148 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9f9a6-aaee-4f9e-a928-41415cd1d8a8 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:41.675433 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9f9a6-aaee-4f9e-a928-41415cd1d8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:41.675705 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9f9a6-aaee-4f9e-a928-41415cd1d8a8 None admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:41.676431 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9f9a6-aaee-4f9e-a928-41415cd1d8a8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:41.677004 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9f9a6-aaee-4f9e-a928-41415cd1d8a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:41.678468 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9f9a6-aaee-4f9e-a928-41415cd1d8a8 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:41.686419 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:41.700830 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 514/1034] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Aug 23 04:06:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:41.706380 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9f9a6-aaee-4f9e-a928-41415cd1d8a8 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:41.746747 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe270ad-de15-4a5b-a371-f2834594a9ae None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:41.752010 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:41.780196 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720ddd7-1fcf-4004-83bd-bdc14d26fd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:41.780772 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720ddd7-1fcf-4004-83bd-bdc14d26fd50 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:41.781049 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720ddd7-1fcf-4004-83bd-bdc14d26fd50 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:41.781383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720ddd7-1fcf-4004-83bd-bdc14d26fd50 None admin] PATH_INFO: `/v3/services/image` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:41.781977 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720ddd7-1fcf-4004-83bd-bdc14d26fd50 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:41.783349 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720ddd7-1fcf-4004-83bd-bdc14d26fd50 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:41.792579 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-a720ddd7-1fcf-4004-83bd-bdc14d26fd50 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 04:06:41.792579 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:41.792579 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 04:06:41.792579 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 04:06:41.792579 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 04:06:41.792579 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 04:06:41.792579 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 04:06:41.792579 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:41.792579 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 04:06:41.792579 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:41.792579 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 04:06:41.792579 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:41.792579 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:41.792579 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:41.792579 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:41.792579 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:41.792579 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:41.799027 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:41.799027 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:41.799027 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:41.799027 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:41.799027 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:41.799027 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:41.799027 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 04:06:41.799027 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 04:06:41.799027 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 04:06:41.799027 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 04:06:41.799027 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:41.799027 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:41.799027 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:41.799027 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:41.799027 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:41.799027 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:41.800038 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:41.800038 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:41.800038 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:41.800038 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:41.800038 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:41.800038 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:41.800038 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:41.800038 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:41.800038 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:41.800038 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:41.800038 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 04:06:41.800038 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:41.800038 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 04:06:41.800038 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:41.800038 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 521/1035] 10.222.0.42 () {56 vars in 1105 bytes} [Tue Aug 23 04:06:41 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:06:41.801037 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720ddd7-1fcf-4004-83bd-bdc14d26fd50 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:41.823006 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9f9a6-aaee-4f9e-a928-41415cd1d8a8 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:41.860964 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02ba32-87e7-4f21-81dd-5db14efe4d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:41.861721 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02ba32-87e7-4f21-81dd-5db14efe4d8a None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:41.862008 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02ba32-87e7-4f21-81dd-5db14efe4d8a None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:41.862406 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02ba32-87e7-4f21-81dd-5db14efe4d8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:41.908901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720ddd7-1fcf-4004-83bd-bdc14d26fd50 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:41.915843 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:41.937520 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02ba32-87e7-4f21-81dd-5db14efe4d8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:41.940355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02ba32-87e7-4f21-81dd-5db14efe4d8a None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:41.947940 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbd5fc-5f18-45f2-b2be-3b3c62205db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:41.948565 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbd5fc-5f18-45f2-b2be-3b3c62205db7 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:41.948842 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbd5fc-5f18-45f2-b2be-3b3c62205db7 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:41.949122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbd5fc-5f18-45f2-b2be-3b3c62205db7 None admin] PATH_INFO: `/v3/services` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:41.949768 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fbd5fc-5f18-45f2-b2be-3b3c62205db7 None admin] RBAC: Adding query filter params (name=image) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:41.950071 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fbd5fc-5f18-45f2-b2be-3b3c62205db7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:41.951438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fbd5fc-5f18-45f2-b2be-3b3c62205db7 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:41.957461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 522/1036] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:41.962919 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbd5fc-5f18-45f2-b2be-3b3c62205db7 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:41.990004 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:42.050815 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 515/1037] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:06:41 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 04:06:42.056631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02ba32-87e7-4f21-81dd-5db14efe4d8a None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:42.073113 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbd5fc-5f18-45f2-b2be-3b3c62205db7 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:42.108562 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ec932-a08e-4213-87ef-c70953fd5c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:42.109498 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ec932-a08e-4213-87ef-c70953fd5c58 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:42.109953 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ec932-a08e-4213-87ef-c70953fd5c58 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:42.110401 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ec932-a08e-4213-87ef-c70953fd5c58 None admin] PATH_INFO: `/v3/services` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:42.111229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ec932-a08e-4213-87ef-c70953fd5c58 None admin] RBAC: Adding query filter params (type=image) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:42.111678 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ec932-a08e-4213-87ef-c70953fd5c58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:42.113215 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ec932-a08e-4213-87ef-c70953fd5c58 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:42.118654 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 523/1038] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:42.124426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ec932-a08e-4213-87ef-c70953fd5c58 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:42.161317 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:42.164374 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02ba32-87e7-4f21-81dd-5db14efe4d8a None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:42.200151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0084d3-15ce-4ee7-96b3-9da9af5678fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:42.200789 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0084d3-15ce-4ee7-96b3-9da9af5678fd None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:42.201073 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0084d3-15ce-4ee7-96b3-9da9af5678fd None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:42.201373 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0084d3-15ce-4ee7-96b3-9da9af5678fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:42.212491 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0084d3-15ce-4ee7-96b3-9da9af5678fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:42.213977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0084d3-15ce-4ee7-96b3-9da9af5678fd None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:42.215669 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:42.228576 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-ec0084d3-15ce-4ee7-96b3-9da9af5678fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:42.228576 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:42.228576 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:42.228576 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:42.228576 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:42.228576 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:42.228576 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:42.228576 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:42.228576 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:42.228576 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:42.228576 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:42.228576 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:42.228576 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:06:42.228576 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:06:42.228576 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:06:42.228576 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:06:42.229613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:42.229613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:42.229613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:42.229613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:42.229613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:42.229613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:42.229613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:42.229613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:42.229613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:42.229613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:42.229613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:42.229613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:42.229613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:42.229613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:42.229613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:42.229613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:42.229613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:06:42.230556 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:06:42.230556 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:42.230556 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:42.230556 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 516/1039] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:06:42.235211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0084d3-15ce-4ee7-96b3-9da9af5678fd None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:42.236989 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ec932-a08e-4213-87ef-c70953fd5c58 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:42.273780 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e9d44-9ac9-4a44-af5b-9aa566156c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:42.274402 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e9d44-9ac9-4a44-af5b-9aa566156c98 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:42.274683 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e9d44-9ac9-4a44-af5b-9aa566156c98 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:42.274954 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e9d44-9ac9-4a44-af5b-9aa566156c98 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:42.275667 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e9d44-9ac9-4a44-af5b-9aa566156c98 None admin] RBAC: Adding query filter params (interface=public, service_id=ce519f2d2cef4c7fb7e437b973b8981e, region_id=RegionOne) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:42.275975 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e9d44-9ac9-4a44-af5b-9aa566156c98 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:42.277357 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e9d44-9ac9-4a44-af5b-9aa566156c98 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:42.282642 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 524/1040] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Aug 23 04:06:42 2022] GET /identity/v3/endpoints?service_id=ce519f2d2cef4c7fb7e437b973b8981e&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:42.287928 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e9d44-9ac9-4a44-af5b-9aa566156c98 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:42.346457 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0084d3-15ce-4ee7-96b3-9da9af5678fd None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:42.387628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76bec1b-6e6d-41e3-8403-fda182f499b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:42.389116 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bec1b-6e6d-41e3-8403-fda182f499b3 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:42.389616 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bec1b-6e6d-41e3-8403-fda182f499b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:42.390222 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bec1b-6e6d-41e3-8403-fda182f499b3 None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:42.392240 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76bec1b-6e6d-41e3-8403-fda182f499b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:42.392853 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76bec1b-6e6d-41e3-8403-fda182f499b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:42.393763 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:42.394960 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76bec1b-6e6d-41e3-8403-fda182f499b3 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:42.397332 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e9d44-9ac9-4a44-af5b-9aa566156c98 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:42.409642 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 517/1041] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:42.410886 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ae3fc-4fc0-4669-8abd-a39721f611f9 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:42.411173 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ae3fc-4fc0-4669-8abd-a39721f611f9 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:42.411441 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ae3fc-4fc0-4669-8abd-a39721f611f9 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:42.412782 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 518/1042] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:42.415552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ae3fc-4fc0-4669-8abd-a39721f611f9 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:42.432442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b05a21-36cf-42fe-ae11-802ff9446989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:42.433052 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b05a21-36cf-42fe-ae11-802ff9446989 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:42.433355 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b05a21-36cf-42fe-ae11-802ff9446989 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:42.433624 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b05a21-36cf-42fe-ae11-802ff9446989 None admin] PATH_INFO: `/v3/services` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:42.434235 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b05a21-36cf-42fe-ae11-802ff9446989 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:42.435597 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b05a21-36cf-42fe-ae11-802ff9446989 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:42.442252 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 525/1043] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Aug 23 04:06:42 2022] GET /identity/v3/services => generated 1957 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:06:42.443398 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf90f36-1e58-4298-b210-80b124aba2e0 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:42.443685 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf90f36-1e58-4298-b210-80b124aba2e0 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:42.443956 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf90f36-1e58-4298-b210-80b124aba2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:42.463468 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-3cf90f36-1e58-4298-b210-80b124aba2e0 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:42.464831 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-3cf90f36-1e58-4298-b210-80b124aba2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:42.475845 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:42.529589 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ae3fc-4fc0-4669-8abd-a39721f611f9 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:42.548272 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 526/1044] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:42.567803 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89805d23-ee84-451a-8d50-7f62cd3f5e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:42.568453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89805d23-ee84-451a-8d50-7f62cd3f5e64 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:42.568732 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89805d23-ee84-451a-8d50-7f62cd3f5e64 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:42.569009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89805d23-ee84-451a-8d50-7f62cd3f5e64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:42.576603 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89805d23-ee84-451a-8d50-7f62cd3f5e64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:42.578091 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89805d23-ee84-451a-8d50-7f62cd3f5e64 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:42.592158 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-89805d23-ee84-451a-8d50-7f62cd3f5e64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:06:42.592158 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:42.592158 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:42.592158 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:42.592158 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:42.592158 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:42.592158 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:42.592158 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:42.592158 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:42.592158 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:42.592158 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:42.592158 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:42.592158 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:06:42.592158 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:06:42.592158 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:06:42.593076 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:06:42.593076 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:42.593076 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:42.593076 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:42.593076 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:42.593076 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:42.593076 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:42.593076 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:42.593076 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:42.593076 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:42.593076 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:42.593076 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:42.593076 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:42.593076 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:42.593076 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:42.593076 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:42.593076 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:42.594621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:06:42.594621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:06:42.594621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:06:42.594621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:06:42.594621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:06:42.594621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:06:42.594621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:06:42.594621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:42.594621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 519/1045] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:06:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:42.601168 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf90f36-1e58-4298-b210-80b124aba2e0 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:42.694800 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:42.704468 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf90f36-1e58-4298-b210-80b124aba2e0 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:42.738214 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18c6a6-7ae4-4f98-9ec5-98cdcbb0cc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:42.738832 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18c6a6-7ae4-4f98-9ec5-98cdcbb0cc00 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:42.739115 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18c6a6-7ae4-4f98-9ec5-98cdcbb0cc00 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:42.739386 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18c6a6-7ae4-4f98-9ec5-98cdcbb0cc00 None admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:42.740085 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b18c6a6-7ae4-4f98-9ec5-98cdcbb0cc00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:42.740393 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b18c6a6-7ae4-4f98-9ec5-98cdcbb0cc00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:42.741853 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b18c6a6-7ae4-4f98-9ec5-98cdcbb0cc00 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:42.754379 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 527/1046] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:06:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:42.760105 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89805d23-ee84-451a-8d50-7f62cd3f5e64 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:42.816973 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18c6a6-7ae4-4f98-9ec5-98cdcbb0cc00 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:42.864135 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89805d23-ee84-451a-8d50-7f62cd3f5e64 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:42.879593 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:42.902251 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266fd13-34b4-4d24-8779-b03de7398576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:42.902873 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266fd13-34b4-4d24-8779-b03de7398576 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:42.903152 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266fd13-34b4-4d24-8779-b03de7398576 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:42.903425 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266fd13-34b4-4d24-8779-b03de7398576 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:42.904161 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266fd13-34b4-4d24-8779-b03de7398576 None admin] RBAC: Adding query filter params (role.id=3c58c3168e8e4a6d8bcb887f5c3f4a10, scope.project.id=a7ada12a1e3a42949c00f483efd522ba, user.id=1e0236a0acac4b87be977878b5186551) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:42.904472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266fd13-34b4-4d24-8779-b03de7398576 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:42.905956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266fd13-34b4-4d24-8779-b03de7398576 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:42.912249 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 520/1047] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:06:42 2022] GET /identity/v3/role_assignments?user.id=1e0236a0acac4b87be977878b5186551&scope.project.id=a7ada12a1e3a42949c00f483efd522ba&role.id=3c58c3168e8e4a6d8bcb887f5c3f4a10 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:42.932500 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18c6a6-7ae4-4f98-9ec5-98cdcbb0cc00 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:42.977638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542902f-dee3-41a5-9038-9edc3117bd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:42.978293 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542902f-dee3-41a5-9038-9edc3117bd06 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:42.978572 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542902f-dee3-41a5-9038-9edc3117bd06 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:42.978839 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542902f-dee3-41a5-9038-9edc3117bd06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:42.990768 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542902f-dee3-41a5-9038-9edc3117bd06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:06:42.996173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-9542902f-dee3-41a5-9038-9edc3117bd06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:06:42.996173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:42.996173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:42.996173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:42.996173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:42.996173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:42.996173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:42.996173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:42.996173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:42.996173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:42.996173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:42.996173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:42.996173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:06:42.996173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:06:42.996173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:06:42.996173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:06:42.997460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:06:42.997460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:06:42.997460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:06:42.997460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:06:42.997460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:42.997460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:42.997460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:42.997460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:42.997460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:42.997460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:42.997460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:42.997460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:42.997460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:42.997460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:42.997460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:42.997460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:42.998352 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:42.998352 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:42.998352 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:42.998352 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:42.998352 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:06:42.998352 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:06:42.998352 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:06:42.998352 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:06:42.998352 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:06:42.998352 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:06:42.998352 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:06:42.998352 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:43.001430 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 528/1048] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:06:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:06:43.003964 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266fd13-34b4-4d24-8779-b03de7398576 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:43.111506 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266fd13-34b4-4d24-8779-b03de7398576 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:43.145402 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d173513-492f-420d-99d2-6b5d8c03d96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:43.146014 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d173513-492f-420d-99d2-6b5d8c03d96f None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:43.146293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d173513-492f-420d-99d2-6b5d8c03d96f None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:43.146566 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d173513-492f-420d-99d2-6b5d8c03d96f None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:43.147227 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d173513-492f-420d-99d2-6b5d8c03d96f None admin] RBAC: Adding query filter params (name=admin) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:43.147528 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d173513-492f-420d-99d2-6b5d8c03d96f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:43.148879 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d173513-492f-420d-99d2-6b5d8c03d96f None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:43.157683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 521/1049] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:06:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:43.163258 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542902f-dee3-41a5-9038-9edc3117bd06 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:43.179037 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:43.265529 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542902f-dee3-41a5-9038-9edc3117bd06 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:43.299408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85d6d8-1e31-4bec-88c8-ffa61f096022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:43.300053 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85d6d8-1e31-4bec-88c8-ffa61f096022 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:43.300333 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85d6d8-1e31-4bec-88c8-ffa61f096022 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:43.300600 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85d6d8-1e31-4bec-88c8-ffa61f096022 None admin] PATH_INFO: `/v3/users/882f7798c8004d5c84c3c8fa8df57a17` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:43.315134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85d6d8-1e31-4bec-88c8-ffa61f096022 None admin] RBAC: Authorizing `identity:get_user(user_id=882f7798c8004d5c84c3c8fa8df57a17)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:43.316579 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85d6d8-1e31-4bec-88c8-ffa61f096022 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:43.318523 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 529/1050] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:06:43 2022] GET /identity/v3/users/882f7798c8004d5c84c3c8fa8df57a17 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:43.324216 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d173513-492f-420d-99d2-6b5d8c03d96f None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:43.369774 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:43.429256 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d173513-492f-420d-99d2-6b5d8c03d96f None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:43.465787 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba73fcb-bd6a-465b-9f2b-088db36a5ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:43.466808 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba73fcb-bd6a-465b-9f2b-088db36a5ea9 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:43.467317 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba73fcb-bd6a-465b-9f2b-088db36a5ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:43.467792 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba73fcb-bd6a-465b-9f2b-088db36a5ea9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:43.539210 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba73fcb-bd6a-465b-9f2b-088db36a5ea9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:43.541006 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba73fcb-bd6a-465b-9f2b-088db36a5ea9 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:43.582533 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:43.643897 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 522/1051] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:06:43 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 04:06:43.645786 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85d6d8-1e31-4bec-88c8-ffa61f096022 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:43.719700 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:43.751999 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85d6d8-1e31-4bec-88c8-ffa61f096022 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:43.787745 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53ef56-663d-43c4-9eea-7ed11596c367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:43.788397 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53ef56-663d-43c4-9eea-7ed11596c367 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:43.788689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53ef56-663d-43c4-9eea-7ed11596c367 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:43.788976 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53ef56-663d-43c4-9eea-7ed11596c367 None admin] PATH_INFO: `/v3/projects/d633d76ebca14303a6e540b3edfd1f98` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:43.790117 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53ef56-663d-43c4-9eea-7ed11596c367 None admin] RBAC: Authorizing `identity:get_project(project_id=d633d76ebca14303a6e540b3edfd1f98)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:43.791616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53ef56-663d-43c4-9eea-7ed11596c367 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:43.797610 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 530/1052] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:06:43 2022] GET /identity/v3/projects/d633d76ebca14303a6e540b3edfd1f98 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:43.799879 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba73fcb-bd6a-465b-9f2b-088db36a5ea9 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:43.900921 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba73fcb-bd6a-465b-9f2b-088db36a5ea9 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:43.936342 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04b7ce-85b2-4b54-86cf-c757b2b629f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:43.936950 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04b7ce-85b2-4b54-86cf-c757b2b629f1 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:43.937263 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04b7ce-85b2-4b54-86cf-c757b2b629f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:43.938094 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04b7ce-85b2-4b54-86cf-c757b2b629f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:43.938821 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04b7ce-85b2-4b54-86cf-c757b2b629f1 None admin] RBAC: Adding query filter params (role.id=255d9e4004c54505a7cda1b8af74e5f1, scope.project.id=d633d76ebca14303a6e540b3edfd1f98, user.id=882f7798c8004d5c84c3c8fa8df57a17) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:43.939130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04b7ce-85b2-4b54-86cf-c757b2b629f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:43.940551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04b7ce-85b2-4b54-86cf-c757b2b629f1 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:43.948709 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 523/1053] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:06:43 2022] GET /identity/v3/role_assignments?user.id=882f7798c8004d5c84c3c8fa8df57a17&scope.project.id=d633d76ebca14303a6e540b3edfd1f98&role.id=255d9e4004c54505a7cda1b8af74e5f1 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:44.356449 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b6390-414e-4566-be4c-6ddf1b8b11ef None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:44.357002 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b6390-414e-4566-be4c-6ddf1b8b11ef None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:44.357002 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b6390-414e-4566-be4c-6ddf1b8b11ef None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:44.358527 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 531/1054] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:44.363485 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f0057-0e0e-49a4-8973-6733a23ba0ff None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:44.363768 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f0057-0e0e-49a4-8973-6733a23ba0ff None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:44.364035 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f0057-0e0e-49a4-8973-6733a23ba0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:44.371276 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:44.383162 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-476f0057-0e0e-49a4-8973-6733a23ba0ff None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:44.388628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-476f0057-0e0e-49a4-8973-6733a23ba0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:44.451917 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 524/1055] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:44.714817 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b6390-414e-4566-be4c-6ddf1b8b11ef None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:44.815969 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356ce69-f6e7-430e-8deb-87a2a98daa29 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:44.816499 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356ce69-f6e7-430e-8deb-87a2a98daa29 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:44.816499 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356ce69-f6e7-430e-8deb-87a2a98daa29 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:44.821125 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 525/1056] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 04:06:44.821260 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b6390-414e-4566-be4c-6ddf1b8b11ef None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:44.824568 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780c3c2-4da9-4594-9e30-e7385013c7d0 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:44.824857 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780c3c2-4da9-4594-9e30-e7385013c7d0 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:44.825170 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780c3c2-4da9-4594-9e30-e7385013c7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:44.842952 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-7780c3c2-4da9-4594-9e30-e7385013c7d0 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:44.844316 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-7780c3c2-4da9-4594-9e30-e7385013c7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:44.860148 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4f97d-bede-434b-be10-49893973954f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:44.860784 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4f97d-bede-434b-be10-49893973954f None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:44.861061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4f97d-bede-434b-be10-49893973954f None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:44.861361 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4f97d-bede-434b-be10-49893973954f None admin] PATH_INFO: `/v3/services/image` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:44.861944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4f97d-bede-434b-be10-49893973954f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:44.863302 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4f97d-bede-434b-be10-49893973954f None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:44.872097 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-7bf4f97d-bede-434b-be10-49893973954f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 04:06:44.872097 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:44.872097 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 04:06:44.872097 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 04:06:44.872097 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 04:06:44.872097 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 04:06:44.872097 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 04:06:44.872097 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:44.872097 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 04:06:44.872097 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:44.872097 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 04:06:44.872097 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:44.872097 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:44.872097 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:44.872097 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:44.872097 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:44.872097 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:44.873438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:44.873438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:44.873438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:44.873438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:44.873438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:44.873438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:44.873438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 04:06:44.873438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 04:06:44.873438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 04:06:44.873438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 04:06:44.873438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:44.873438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:44.873438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:44.873438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:44.873438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:44.873438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:44.874536 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:44.874536 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:44.874536 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:44.874536 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:44.874536 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:44.874536 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:44.874536 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:44.874536 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:44.874536 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:44.874536 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:44.874536 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 04:06:44.874536 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:06:44.874536 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 04:06:44.874536 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:44.874536 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 532/1057] 10.222.0.42 () {56 vars in 1105 bytes} [Tue Aug 23 04:06:44 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:44.879533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4f97d-bede-434b-be10-49893973954f None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:44.882309 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:44.929147 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 526/1058] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 04:06:44.992832 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4f97d-bede-434b-be10-49893973954f None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:45.029674 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f7c6c-6141-4b9e-a7e6-2fd67a402ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:45.030652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f7c6c-6141-4b9e-a7e6-2fd67a402ca2 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:45.031638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f7c6c-6141-4b9e-a7e6-2fd67a402ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:45.032118 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f7c6c-6141-4b9e-a7e6-2fd67a402ca2 None admin] PATH_INFO: `/v3/services` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:45.032944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f7c6c-6141-4b9e-a7e6-2fd67a402ca2 None admin] RBAC: Adding query filter params (name=image) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:45.033452 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f7c6c-6141-4b9e-a7e6-2fd67a402ca2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:45.034999 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f7c6c-6141-4b9e-a7e6-2fd67a402ca2 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:45.040322 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 533/1059] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:45.045709 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780c3c2-4da9-4594-9e30-e7385013c7d0 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:45.109295 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:45.148508 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780c3c2-4da9-4594-9e30-e7385013c7d0 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:45.182038 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3149d-8dca-4974-a6db-26ae58c9505e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:45.182651 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3149d-8dca-4974-a6db-26ae58c9505e None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:45.182937 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3149d-8dca-4974-a6db-26ae58c9505e None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:45.183215 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3149d-8dca-4974-a6db-26ae58c9505e None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:45.183843 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd3149d-8dca-4974-a6db-26ae58c9505e None admin] RBAC: Adding query filter params (type=image) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:45.184148 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd3149d-8dca-4974-a6db-26ae58c9505e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:45.185560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd3149d-8dca-4974-a6db-26ae58c9505e None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:45.190968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 527/1060] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:45.195848 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f7c6c-6141-4b9e-a7e6-2fd67a402ca2 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:45.196469 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3149d-8dca-4974-a6db-26ae58c9505e None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:45.263121 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:45.300359 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f7c6c-6141-4b9e-a7e6-2fd67a402ca2 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:45.301143 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3149d-8dca-4974-a6db-26ae58c9505e None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:45.331570 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:45.335138 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c78bc-27c6-47de-8107-69690c9d776e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:45.336033 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c78bc-27c6-47de-8107-69690c9d776e None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:45.336473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c78bc-27c6-47de-8107-69690c9d776e None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:45.336734 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c78bc-27c6-47de-8107-69690c9d776e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:45.339975 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb8681-ef9b-4643-a443-514da7bc1c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:45.340592 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb8681-ef9b-4643-a443-514da7bc1c95 None admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:45.340878 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb8681-ef9b-4643-a443-514da7bc1c95 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:45.341183 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb8681-ef9b-4643-a443-514da7bc1c95 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:45.341868 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb8681-ef9b-4643-a443-514da7bc1c95 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:45.343244 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb8681-ef9b-4643-a443-514da7bc1c95 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:45.347746 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c78bc-27c6-47de-8107-69690c9d776e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:06:45.353132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-db1c78bc-27c6-47de-8107-69690c9d776e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 04:06:45.353132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:45.353132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:45.353132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:45.353132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:45.353132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:45.353132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:45.353132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:45.353132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:45.353132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:45.353132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:45.353132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:45.353132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:06:45.353132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:06:45.353132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:06:45.353132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:06:45.360931 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:06:45.360931 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:06:45.360931 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:06:45.360931 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:06:45.360931 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:45.360931 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:45.360931 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:45.360931 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:45.360931 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:45.360931 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:45.360931 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:45.360931 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:45.360931 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:45.360931 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:45.360931 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:45.360931 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:45.361882 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:45.361882 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:45.361882 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:45.361882 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:45.361882 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:06:45.361882 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:06:45.361882 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:06:45.361882 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:06:45.361882 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:06:45.361882 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:06:45.361882 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 04:06:45.361882 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:45.361882 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 534/1061] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Aug 23 04:06:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:45.361882 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c78bc-27c6-47de-8107-69690c9d776e None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:45.429263 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 528/1062] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:06:45 2022] POST /identity/v3/endpoints => generated 327 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:06:45.477178 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c78bc-27c6-47de-8107-69690c9d776e None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:45.505957 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:45.523115 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb59dffc-1869-4039-825b-188daae7e143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:45.523664 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59dffc-1869-4039-825b-188daae7e143 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:45.523947 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59dffc-1869-4039-825b-188daae7e143 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:45.524221 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59dffc-1869-4039-825b-188daae7e143 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:45.525001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb59dffc-1869-4039-825b-188daae7e143 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:45.525346 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb59dffc-1869-4039-825b-188daae7e143 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:45.526747 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb59dffc-1869-4039-825b-188daae7e143 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:45.540908 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 535/1063] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Aug 23 04:06:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:45.542537 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb8681-ef9b-4643-a443-514da7bc1c95 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:45.648317 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb8681-ef9b-4643-a443-514da7bc1c95 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:45.689506 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b670cf-b827-4ae7-b115-870c1131d307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:45.690150 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b670cf-b827-4ae7-b115-870c1131d307 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:45.690430 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b670cf-b827-4ae7-b115-870c1131d307 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:45.690702 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b670cf-b827-4ae7-b115-870c1131d307 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:45.701391 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b670cf-b827-4ae7-b115-870c1131d307 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:45.702870 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b670cf-b827-4ae7-b115-870c1131d307 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:45.717381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-f9b670cf-b827-4ae7-b115-870c1131d307 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:45.717381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:45.717381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:45.717381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:45.717381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:45.717381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:45.717381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:45.717381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:45.717381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:45.717381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:45.717381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:45.717381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:45.717381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:06:45.717381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:06:45.717381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:06:45.717381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:06:45.718396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:45.718396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:45.718396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:45.718396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:45.718396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:45.718396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:45.718396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:45.718396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:45.718396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:45.718396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:45.718396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:45.718396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:45.718396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:45.718396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:45.718396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:45.718396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:45.718396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:06:45.719370 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:06:45.719370 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:45.719370 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:45.719370 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 529/1064] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:06:45.725662 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb59dffc-1869-4039-825b-188daae7e143 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:45.827498 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cde3d5-9e78-4450-988e-4a016a222033 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:45.828612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cde3d5-9e78-4450-988e-4a016a222033 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:45.828612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cde3d5-9e78-4450-988e-4a016a222033 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:45.830252 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 530/1065] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:45.831496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb59dffc-1869-4039-825b-188daae7e143 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:45.835837 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ad422-c8ca-4f7a-b228-0940c8f83b23 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:45.836124 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ad422-c8ca-4f7a-b228-0940c8f83b23 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:45.836402 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ad422-c8ca-4f7a-b228-0940c8f83b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:45.855293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-7e0ad422-c8ca-4f7a-b228-0940c8f83b23 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:45.856474 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-7e0ad422-c8ca-4f7a-b228-0940c8f83b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:45.868342 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011752b-a28e-41c1-8010-55680add953d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:45.869172 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011752b-a28e-41c1-8010-55680add953d None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:45.869595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011752b-a28e-41c1-8010-55680add953d None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:45.870041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011752b-a28e-41c1-8010-55680add953d None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:45.870838 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4011752b-a28e-41c1-8010-55680add953d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:45.871320 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4011752b-a28e-41c1-8010-55680add953d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:45.872749 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4011752b-a28e-41c1-8010-55680add953d None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:45.886084 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 536/1066] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:45.891406 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:45.892752 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011752b-a28e-41c1-8010-55680add953d None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:45.932465 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 531/1067] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 04:06:45.943877 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:46.002139 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011752b-a28e-41c1-8010-55680add953d None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:46.036643 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c033f8e-e973-495b-8ec7-a2a4e9b443b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:46.037301 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c033f8e-e973-495b-8ec7-a2a4e9b443b7 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:46.037583 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c033f8e-e973-495b-8ec7-a2a4e9b443b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:46.037852 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c033f8e-e973-495b-8ec7-a2a4e9b443b7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:46.044764 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c033f8e-e973-495b-8ec7-a2a4e9b443b7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:46.046217 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c033f8e-e973-495b-8ec7-a2a4e9b443b7 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:46.058169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-9c033f8e-e973-495b-8ec7-a2a4e9b443b7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 04:06:46.058169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:46.058169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:46.058169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:46.058169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:46.058169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:46.058169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:46.058169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:46.058169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:46.058169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:46.058169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:46.058169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:46.058169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:06:46.058169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:06:46.058169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:06:46.058169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:06:46.059134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:46.059134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:46.059134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:06:46.059134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:06:46.059134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:06:46.059134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:06:46.059134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:46.059134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:46.059134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:46.059134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:46.059134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:46.059134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:46.059134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:46.059134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:46.059134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:46.059134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:46.059134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:46.059134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:46.060111 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:46.060111 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:46.060111 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:06:46.060111 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:06:46.060111 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:06:46.060111 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:06:46.060111 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:06:46.060111 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:06:46.060111 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 04:06:46.060111 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:46.060111 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 537/1068] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Aug 23 04:06:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:46.065744 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ad422-c8ca-4f7a-b228-0940c8f83b23 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:46.165412 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ad422-c8ca-4f7a-b228-0940c8f83b23 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:46.199386 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330614b-57c7-4790-96de-feabdb961c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:46.199997 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330614b-57c7-4790-96de-feabdb961c3d None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:46.200280 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330614b-57c7-4790-96de-feabdb961c3d None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:46.200554 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330614b-57c7-4790-96de-feabdb961c3d None admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:46.201312 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330614b-57c7-4790-96de-feabdb961c3d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:46.201621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330614b-57c7-4790-96de-feabdb961c3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:46.203078 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330614b-57c7-4790-96de-feabdb961c3d None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:46.205603 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c033f8e-e973-495b-8ec7-a2a4e9b443b7 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:46.225431 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 532/1069] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Aug 23 04:06:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:46.226517 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330614b-57c7-4790-96de-feabdb961c3d None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:46.252512 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:46.321883 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c033f8e-e973-495b-8ec7-a2a4e9b443b7 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:46.324395 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:46.330979 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330614b-57c7-4790-96de-feabdb961c3d None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:46.356563 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a4cda-f20e-490d-90c7-00d05f897e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:46.357227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a4cda-f20e-490d-90c7-00d05f897e05 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:46.357505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a4cda-f20e-490d-90c7-00d05f897e05 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:46.357776 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a4cda-f20e-490d-90c7-00d05f897e05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:46.367958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9595a8-bd3f-4fdd-bbd5-6084b0fcc7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:46.368408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a4cda-f20e-490d-90c7-00d05f897e05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:06:46.368890 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9595a8-bd3f-4fdd-bbd5-6084b0fcc7c0 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:46.369060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9595a8-bd3f-4fdd-bbd5-6084b0fcc7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:46.369352 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9595a8-bd3f-4fdd-bbd5-6084b0fcc7c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:46.373496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-773a4cda-f20e-490d-90c7-00d05f897e05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:06:46.373496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:46.373496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:46.373496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:46.373496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:46.373496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:46.373496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:46.373496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:46.373496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:46.373496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:46.373496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:46.373496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:46.373496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:06:46.373496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:06:46.373496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:06:46.373496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:06:46.374541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:06:46.374541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:06:46.374541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:06:46.374541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:06:46.374541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:46.374541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:46.374541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:46.374541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:46.374541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:46.374541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:46.374541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:46.374541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:46.374541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:46.374541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:46.374541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:46.374541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:46.376014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:46.376014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:46.376014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:46.376014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:46.376014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:06:46.376014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:06:46.376014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:06:46.376014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:06:46.376014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:06:46.376014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:06:46.376014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:06:46.376014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:46.376014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 538/1070] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:06:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:46.382326 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a4cda-f20e-490d-90c7-00d05f897e05 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:46.385323 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9595a8-bd3f-4fdd-bbd5-6084b0fcc7c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:46.386782 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9595a8-bd3f-4fdd-bbd5-6084b0fcc7c0 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:46.401621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-8e9595a8-bd3f-4fdd-bbd5-6084b0fcc7c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:46.401621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:46.401621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:46.401621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:46.401621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:46.401621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:46.401621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:46.401621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:46.401621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:46.401621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:46.401621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:46.401621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:46.401621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:06:46.401621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:06:46.401621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:06:46.401621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:06:46.402618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:46.402618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:46.402618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:46.402618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:46.402618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:46.402618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:46.402618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:46.402618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:46.402618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:46.402618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:46.402618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:46.402618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:46.402618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:46.402618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:46.402618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:46.402618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:46.402618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:06:46.408815 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:06:46.408815 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:46.408815 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:46.408815 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 533/1071] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:46.408815 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9595a8-bd3f-4fdd-bbd5-6084b0fcc7c0 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:46.492216 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a4cda-f20e-490d-90c7-00d05f897e05 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:46.493953 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:46.518847 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9595a8-bd3f-4fdd-bbd5-6084b0fcc7c0 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:46.528821 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a53a10-9c7b-45e8-9d1a-cce3834c5791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:46.529481 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a53a10-9c7b-45e8-9d1a-cce3834c5791 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:46.529757 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a53a10-9c7b-45e8-9d1a-cce3834c5791 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:46.530028 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a53a10-9c7b-45e8-9d1a-cce3834c5791 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:46.530696 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a53a10-9c7b-45e8-9d1a-cce3834c5791 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:46.531518 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a53a10-9c7b-45e8-9d1a-cce3834c5791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:46.532974 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a53a10-9c7b-45e8-9d1a-cce3834c5791 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:46.544433 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 539/1072] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:06:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:46.550993 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a53a10-9c7b-45e8-9d1a-cce3834c5791 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:46.564120 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a729ff-1cc8-4d27-9cbb-08c56222b120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:46.564740 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a729ff-1cc8-4d27-9cbb-08c56222b120 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:46.565028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a729ff-1cc8-4d27-9cbb-08c56222b120 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:46.565503 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a729ff-1cc8-4d27-9cbb-08c56222b120 None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:46.566162 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a729ff-1cc8-4d27-9cbb-08c56222b120 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:46.566470 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a729ff-1cc8-4d27-9cbb-08c56222b120 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:46.567831 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a729ff-1cc8-4d27-9cbb-08c56222b120 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:46.580026 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 534/1073] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:46.580736 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:46.585308 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a729ff-1cc8-4d27-9cbb-08c56222b120 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:46.658598 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a53a10-9c7b-45e8-9d1a-cce3834c5791 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:46.692883 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a729ff-1cc8-4d27-9cbb-08c56222b120 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:46.694390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436dea1-887e-407a-81cf-82546f7606a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:46.695028 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436dea1-887e-407a-81cf-82546f7606a2 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:46.695313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436dea1-887e-407a-81cf-82546f7606a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:46.696157 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436dea1-887e-407a-81cf-82546f7606a2 None admin] PATH_INFO: `/v3/users/882f7798c8004d5c84c3c8fa8df57a17` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:46.696735 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436dea1-887e-407a-81cf-82546f7606a2 None admin] RBAC: Authorizing `identity:get_user(user_id=882f7798c8004d5c84c3c8fa8df57a17)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:46.698207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436dea1-887e-407a-81cf-82546f7606a2 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:46.704406 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 540/1074] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:06:46 2022] GET /identity/v3/users/882f7798c8004d5c84c3c8fa8df57a17 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:46.705375 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436dea1-887e-407a-81cf-82546f7606a2 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:46.733321 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bad80f-83b5-49d7-bfe1-467697a4b78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:46.734093 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bad80f-83b5-49d7-bfe1-467697a4b78a None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:46.734938 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bad80f-83b5-49d7-bfe1-467697a4b78a None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:46.735272 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bad80f-83b5-49d7-bfe1-467697a4b78a None admin] PATH_INFO: `/v3/projects/service` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:46.738115 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:46.742924 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bad80f-83b5-49d7-bfe1-467697a4b78a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:46.744588 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bad80f-83b5-49d7-bfe1-467697a4b78a None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:46.756210 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-92bad80f-83b5-49d7-bfe1-467697a4b78a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:06:46.756210 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:46.756210 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:46.756210 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:46.756210 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:46.756210 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:46.756210 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:46.756210 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:46.756210 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:46.756210 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:46.756210 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:46.756210 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:46.756210 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:06:46.756210 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:06:46.756210 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:06:46.757364 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:06:46.757364 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:46.757364 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:46.757364 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:46.757364 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:46.757364 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:46.757364 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:46.757364 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:46.757364 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:46.757364 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:46.757364 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:46.757364 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:46.757364 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:46.757364 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:46.757364 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:46.757364 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:46.757364 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:46.758843 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:06:46.758843 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:06:46.758843 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:06:46.758843 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:06:46.758843 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:06:46.758843 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:06:46.758843 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:06:46.758843 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:46.761436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 535/1075] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:06:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:46.762946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bad80f-83b5-49d7-bfe1-467697a4b78a None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:46.810671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:46.817462 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436dea1-887e-407a-81cf-82546f7606a2 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:46.856264 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525db95-d32c-4fba-8aed-3d0c9931e731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:46.856898 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525db95-d32c-4fba-8aed-3d0c9931e731 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:46.857213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525db95-d32c-4fba-8aed-3d0c9931e731 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:46.857492 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525db95-d32c-4fba-8aed-3d0c9931e731 None admin] PATH_INFO: `/v3/projects/d633d76ebca14303a6e540b3edfd1f98` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:46.858615 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525db95-d32c-4fba-8aed-3d0c9931e731 None admin] RBAC: Authorizing `identity:get_project(project_id=d633d76ebca14303a6e540b3edfd1f98)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:46.860081 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525db95-d32c-4fba-8aed-3d0c9931e731 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:46.866551 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 541/1076] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:06:46 2022] GET /identity/v3/projects/d633d76ebca14303a6e540b3edfd1f98 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:46.867525 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525db95-d32c-4fba-8aed-3d0c9931e731 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:46.882546 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bad80f-83b5-49d7-bfe1-467697a4b78a None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:46.923238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898a1bd-fb7f-4d34-8558-87d3b4881100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:46.923961 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898a1bd-fb7f-4d34-8558-87d3b4881100 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:46.924317 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898a1bd-fb7f-4d34-8558-87d3b4881100 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:46.924663 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898a1bd-fb7f-4d34-8558-87d3b4881100 None admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:46.925469 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898a1bd-fb7f-4d34-8558-87d3b4881100 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:46.925889 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898a1bd-fb7f-4d34-8558-87d3b4881100 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:46.927765 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898a1bd-fb7f-4d34-8558-87d3b4881100 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:46.940703 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 536/1077] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:06:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:46.946861 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898a1bd-fb7f-4d34-8558-87d3b4881100 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:46.976588 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525db95-d32c-4fba-8aed-3d0c9931e731 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:47.006591 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:47.010678 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa54ef-ce33-410b-81b0-d9c1dd41aaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:47.017141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa54ef-ce33-410b-81b0-d9c1dd41aaa2 None admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:47.017141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa54ef-ce33-410b-81b0-d9c1dd41aaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:47.017141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa54ef-ce33-410b-81b0-d9c1dd41aaa2 None admin] PATH_INFO: `/v3/projects/d633d76ebca14303a6e540b3edfd1f98/users/882f7798c8004d5c84c3c8fa8df57a17/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:47.017141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa54ef-ce33-410b-81b0-d9c1dd41aaa2 None admin] RBAC: Authorizing `identity:create_grant(project_id=d633d76ebca14303a6e540b3edfd1f98, user_id=882f7798c8004d5c84c3c8fa8df57a17, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:47.017141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa54ef-ce33-410b-81b0-d9c1dd41aaa2 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:47.052676 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898a1bd-fb7f-4d34-8558-87d3b4881100 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:47.068190 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 542/1078] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 23 04:06:46 2022] PUT /identity/v3/projects/d633d76ebca14303a6e540b3edfd1f98/users/882f7798c8004d5c84c3c8fa8df57a17/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:06:47.099949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255877d-9511-40db-9d02-2c1dc829763a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:47.100638 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255877d-9511-40db-9d02-2c1dc829763a None admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:47.100921 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255877d-9511-40db-9d02-2c1dc829763a None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:47.101255 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255877d-9511-40db-9d02-2c1dc829763a None admin] PATH_INFO: `/v3/projects/a7ada12a1e3a42949c00f483efd522ba/users/1e0236a0acac4b87be977878b5186551/roles/3c58c3168e8e4a6d8bcb887f5c3f4a10` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:47.103525 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255877d-9511-40db-9d02-2c1dc829763a None admin] RBAC: Authorizing `identity:create_grant(project_id=a7ada12a1e3a42949c00f483efd522ba, user_id=1e0236a0acac4b87be977878b5186551, role_id=3c58c3168e8e4a6d8bcb887f5c3f4a10)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:47.104991 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255877d-9511-40db-9d02-2c1dc829763a None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:47.206090 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 537/1079] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 23 04:06:46 2022] PUT /identity/v3/projects/a7ada12a1e3a42949c00f483efd522ba/users/1e0236a0acac4b87be977878b5186551/roles/3c58c3168e8e4a6d8bcb887f5c3f4a10 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:06:47.375743 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9b388-9103-4d4d-8237-82b168927d47 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:47.375743 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9b388-9103-4d4d-8237-82b168927d47 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:47.376317 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9b388-9103-4d4d-8237-82b168927d47 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:47.377401 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 543/1080] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:47.382465 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f7164-87a6-4406-a585-96b75c23bfaf None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:47.382758 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f7164-87a6-4406-a585-96b75c23bfaf None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:47.383036 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f7164-87a6-4406-a585-96b75c23bfaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:47.401744 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-d92f7164-87a6-4406-a585-96b75c23bfaf None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:47.402917 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-d92f7164-87a6-4406-a585-96b75c23bfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:47.468232 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 538/1081] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:47.735487 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9b388-9103-4d4d-8237-82b168927d47 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:47.760733 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:47.836834 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9b388-9103-4d4d-8237-82b168927d47 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:47.873305 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940417d-f37b-4d06-95b4-dc0cc921dd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:47.873906 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940417d-f37b-4d06-95b4-dc0cc921dd55 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:47.874183 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940417d-f37b-4d06-95b4-dc0cc921dd55 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:47.874465 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940417d-f37b-4d06-95b4-dc0cc921dd55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:47.941441 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4940417d-f37b-4d06-95b4-dc0cc921dd55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:47.942867 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4940417d-f37b-4d06-95b4-dc0cc921dd55 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:47.973907 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:48.049959 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 544/1082] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:06:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 04:06:48.055788 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f7164-87a6-4406-a585-96b75c23bfaf None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:48.103721 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:48.158286 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f7164-87a6-4406-a585-96b75c23bfaf None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:48.194514 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a07665-e487-4923-992b-011432109046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:48.195154 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a07665-e487-4923-992b-011432109046 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:48.195432 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a07665-e487-4923-992b-011432109046 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:48.195703 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a07665-e487-4923-992b-011432109046 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:48.205898 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a07665-e487-4923-992b-011432109046 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:48.207397 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a07665-e487-4923-992b-011432109046 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:48.222230 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-f7a07665-e487-4923-992b-011432109046 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:48.222230 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:48.222230 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:48.222230 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:48.222230 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:48.222230 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:48.222230 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:48.222230 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:48.222230 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:48.222230 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:48.222230 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:48.222230 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:48.222230 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:06:48.222230 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:06:48.222230 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:06:48.222230 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:06:48.223241 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:48.223241 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:48.223241 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:48.223241 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:48.223241 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:48.223241 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:48.223241 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:48.223241 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:48.223241 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:48.223241 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:48.223241 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:48.223241 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:48.223241 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:48.223241 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:48.223241 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:48.223241 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:48.223241 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:06:48.224191 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:06:48.224191 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:48.224191 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:48.225170 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 539/1083] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:48.229296 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940417d-f37b-4d06-95b4-dc0cc921dd55 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:48.329646 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940417d-f37b-4d06-95b4-dc0cc921dd55 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:48.352302 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:48.363963 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5724c9-300c-400f-8e5e-76b8f6f44803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:48.364572 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5724c9-300c-400f-8e5e-76b8f6f44803 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:48.364927 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5724c9-300c-400f-8e5e-76b8f6f44803 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:48.365169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5724c9-300c-400f-8e5e-76b8f6f44803 None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:48.365771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5724c9-300c-400f-8e5e-76b8f6f44803 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:48.366074 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5724c9-300c-400f-8e5e-76b8f6f44803 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:48.367433 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5724c9-300c-400f-8e5e-76b8f6f44803 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:48.379087 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 545/1084] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:48.993329 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c018d76-7683-40a3-b1a0-acbd82f59dab None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:48.993621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c018d76-7683-40a3-b1a0-acbd82f59dab None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:48.993896 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c018d76-7683-40a3-b1a0-acbd82f59dab None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:48.998971 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 540/1085] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:49.004725 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dc777-127c-4d25-a0cf-d2c780afed33 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:49.005018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dc777-127c-4d25-a0cf-d2c780afed33 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:49.005329 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dc777-127c-4d25-a0cf-d2c780afed33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:49.023663 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-671dc777-127c-4d25-a0cf-d2c780afed33 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:49.024847 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-671dc777-127c-4d25-a0cf-d2c780afed33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:49.094433 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 546/1086] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:49.103492 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef961da-33ed-4a64-a60d-a59316cdebe5 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:49.103957 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef961da-33ed-4a64-a60d-a59316cdebe5 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:49.104050 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef961da-33ed-4a64-a60d-a59316cdebe5 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:49.105422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 541/1087] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:49.111171 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe557f-af28-407d-a331-c0d1b5418f6f None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:49.111457 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe557f-af28-407d-a331-c0d1b5418f6f None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:49.111730 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe557f-af28-407d-a331-c0d1b5418f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:49.130113 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-1ffe557f-af28-407d-a331-c0d1b5418f6f None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:49.131302 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-1ffe557f-af28-407d-a331-c0d1b5418f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:49.196463 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 547/1088] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:49.360328 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef961da-33ed-4a64-a60d-a59316cdebe5 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:49.457635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:49.461935 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe557f-af28-407d-a331-c0d1b5418f6f None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:49.462402 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef961da-33ed-4a64-a60d-a59316cdebe5 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:49.497730 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35225062-0218-4561-bf7e-a19e5a7a7bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:49.498360 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35225062-0218-4561-bf7e-a19e5a7a7bb3 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:49.498641 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35225062-0218-4561-bf7e-a19e5a7a7bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:49.498916 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35225062-0218-4561-bf7e-a19e5a7a7bb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:49.505061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:49.508906 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35225062-0218-4561-bf7e-a19e5a7a7bb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:06:49.513596 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-35225062-0218-4561-bf7e-a19e5a7a7bb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:06:49.513596 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:49.513596 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:49.513596 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:49.513596 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:49.513596 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:49.513596 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:49.513596 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:49.513596 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:49.513596 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:49.513596 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:49.513596 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:49.513596 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:06:49.513596 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:06:49.513596 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:06:49.513596 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:06:49.518149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:06:49.518149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:06:49.518149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:06:49.518149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:06:49.518149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:49.518149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:49.518149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:49.518149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:49.518149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:49.518149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:49.518149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:49.518149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:49.518149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:49.518149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:49.518149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:49.518149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:49.519064 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:49.519064 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:49.519064 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:49.519064 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:49.519064 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:06:49.519064 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:06:49.519064 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:06:49.519064 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:06:49.519064 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:06:49.519064 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:06:49.519064 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:06:49.519064 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:06:49.519064 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 542/1089] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:06:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:49.520892 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35225062-0218-4561-bf7e-a19e5a7a7bb3 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:49.562010 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe557f-af28-407d-a331-c0d1b5418f6f None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:49.596558 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebac6b6-63e4-4590-aad7-e9d3af97f0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:49.597231 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebac6b6-63e4-4590-aad7-e9d3af97f0ce None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:49.597518 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebac6b6-63e4-4590-aad7-e9d3af97f0ce None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:49.597799 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebac6b6-63e4-4590-aad7-e9d3af97f0ce None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:49.607625 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebac6b6-63e4-4590-aad7-e9d3af97f0ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:06:49.612981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-2ebac6b6-63e4-4590-aad7-e9d3af97f0ce None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 04:06:49.612981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:49.612981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:49.612981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:49.612981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:49.612981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:49.612981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:49.612981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:49.612981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:49.612981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:49.612981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:49.612981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:49.612981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:06:49.612981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:06:49.612981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:06:49.612981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:06:49.614143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:06:49.614143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:06:49.614143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:06:49.614143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:06:49.614143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:49.614143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:49.614143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:49.614143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:49.614143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:49.614143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:49.614143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:49.614143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:49.614143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:49.614143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:49.614143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:49.614143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:49.615175 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:49.615175 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:49.615175 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:49.615175 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:49.615175 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:06:49.615175 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:06:49.615175 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:06:49.615175 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:06:49.615175 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:06:49.615175 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:06:49.615175 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 04:06:49.615175 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:49.615175 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 548/1090] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Aug 23 04:06:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:06:49.619861 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebac6b6-63e4-4590-aad7-e9d3af97f0ce None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:49.621614 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35225062-0218-4561-bf7e-a19e5a7a7bb3 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:49.654237 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2e178-4a29-47c4-9ef1-3652baf5570e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:49.654845 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2e178-4a29-47c4-9ef1-3652baf5570e None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:49.655129 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2e178-4a29-47c4-9ef1-3652baf5570e None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:49.655404 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2e178-4a29-47c4-9ef1-3652baf5570e None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:49.656575 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2e178-4a29-47c4-9ef1-3652baf5570e None admin] RBAC: Adding query filter params (name=admin) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:49.656884 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2e178-4a29-47c4-9ef1-3652baf5570e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:49.658296 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2e178-4a29-47c4-9ef1-3652baf5570e None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:49.666793 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 543/1091] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:06:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:49.673032 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2e178-4a29-47c4-9ef1-3652baf5570e None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:49.693502 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:49.721947 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebac6b6-63e4-4590-aad7-e9d3af97f0ce None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:49.723471 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:49.755457 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af307a9a-5a21-4ed8-8d21-d88e075a52d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:49.756057 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af307a9a-5a21-4ed8-8d21-d88e075a52d1 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:49.756335 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af307a9a-5a21-4ed8-8d21-d88e075a52d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:49.756601 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af307a9a-5a21-4ed8-8d21-d88e075a52d1 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:49.757296 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af307a9a-5a21-4ed8-8d21-d88e075a52d1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:49.757594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af307a9a-5a21-4ed8-8d21-d88e075a52d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:49.758950 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af307a9a-5a21-4ed8-8d21-d88e075a52d1 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:49.767686 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 549/1092] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Aug 23 04:06:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:49.769892 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2e178-4a29-47c4-9ef1-3652baf5570e None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:49.773212 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af307a9a-5a21-4ed8-8d21-d88e075a52d1 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:49.804039 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803969ad-1947-42d8-b19b-72eda5cc08a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:49.804673 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803969ad-1947-42d8-b19b-72eda5cc08a2 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:49.804952 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803969ad-1947-42d8-b19b-72eda5cc08a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:49.805272 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803969ad-1947-42d8-b19b-72eda5cc08a2 None admin] PATH_INFO: `/v3/users/882f7798c8004d5c84c3c8fa8df57a17` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:49.806394 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803969ad-1947-42d8-b19b-72eda5cc08a2 None admin] RBAC: Authorizing `identity:get_user(user_id=882f7798c8004d5c84c3c8fa8df57a17)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:49.807823 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803969ad-1947-42d8-b19b-72eda5cc08a2 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:49.809603 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 544/1093] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:06:49 2022] GET /identity/v3/users/882f7798c8004d5c84c3c8fa8df57a17 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:49.815660 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803969ad-1947-42d8-b19b-72eda5cc08a2 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:49.873931 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af307a9a-5a21-4ed8-8d21-d88e075a52d1 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:49.901520 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:49.907825 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56808cf7-9165-4a85-b0db-4109d723f449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:49.908450 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56808cf7-9165-4a85-b0db-4109d723f449 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:49.908726 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56808cf7-9165-4a85-b0db-4109d723f449 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:49.912975 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56808cf7-9165-4a85-b0db-4109d723f449 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:49.913733 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803969ad-1947-42d8-b19b-72eda5cc08a2 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:49.919289 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56808cf7-9165-4a85-b0db-4109d723f449 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:49.920714 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56808cf7-9165-4a85-b0db-4109d723f449 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:49.934966 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-56808cf7-9165-4a85-b0db-4109d723f449 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:49.934966 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:49.934966 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:49.934966 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:49.934966 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:49.934966 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:49.934966 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:49.934966 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:49.934966 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:49.934966 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:49.934966 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:49.934966 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:49.934966 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:06:49.934966 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:06:49.934966 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:06:49.934966 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:06:49.935985 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:49.935985 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:49.935985 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:49.935985 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:49.935985 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:49.935985 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:49.935985 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:49.935985 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:49.935985 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:49.935985 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:49.935985 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:49.935985 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:49.935985 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:49.935985 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:49.935985 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:49.935985 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:49.935985 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:06:49.936960 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:06:49.936960 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:49.936960 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:49.936960 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 550/1094] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:06:49.941779 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56808cf7-9165-4a85-b0db-4109d723f449 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:49.947808 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0da9d-1c91-40c4-899f-532aa6f1e914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:49.948422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0da9d-1c91-40c4-899f-532aa6f1e914 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:49.948707 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0da9d-1c91-40c4-899f-532aa6f1e914 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:49.948975 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0da9d-1c91-40c4-899f-532aa6f1e914 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:49.964289 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:50.016333 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e0da9d-1c91-40c4-899f-532aa6f1e914 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:50.017808 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e0da9d-1c91-40c4-899f-532aa6f1e914 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:50.047005 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56808cf7-9165-4a85-b0db-4109d723f449 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:50.081349 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a57ed1-1db1-439e-95fa-1e693fba589c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:50.081956 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a57ed1-1db1-439e-95fa-1e693fba589c None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:50.082236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a57ed1-1db1-439e-95fa-1e693fba589c None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:50.082505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a57ed1-1db1-439e-95fa-1e693fba589c None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:50.083145 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a57ed1-1db1-439e-95fa-1e693fba589c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:50.083446 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a57ed1-1db1-439e-95fa-1e693fba589c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:50.084833 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a57ed1-1db1-439e-95fa-1e693fba589c None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:50.096786 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 551/1095] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:50.102675 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a57ed1-1db1-439e-95fa-1e693fba589c None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:50.108080 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:50.120437 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 545/1096] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:06:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 04:06:50.126387 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0da9d-1c91-40c4-899f-532aa6f1e914 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:50.179368 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:50.201395 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a57ed1-1db1-439e-95fa-1e693fba589c None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:50.224047 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0da9d-1c91-40c4-899f-532aa6f1e914 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:50.235189 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fb46c-70a6-4273-a207-68ad4b160a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:50.235822 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fb46c-70a6-4273-a207-68ad4b160a60 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:50.236103 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fb46c-70a6-4273-a207-68ad4b160a60 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:50.236373 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fb46c-70a6-4273-a207-68ad4b160a60 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:50.243236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2fb46c-70a6-4273-a207-68ad4b160a60 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:50.244671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2fb46c-70a6-4273-a207-68ad4b160a60 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:50.256485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-7c2fb46c-70a6-4273-a207-68ad4b160a60 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 04:06:50.256485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:50.256485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:50.256485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:50.256485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:50.256485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:50.256485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:50.256485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:50.256485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:50.256485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:50.256485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:50.256485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:50.256485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:06:50.256485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:06:50.256485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:06:50.256485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:06:50.257655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:50.257655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:50.257655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:06:50.257655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:06:50.257655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:06:50.257655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:06:50.257655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:50.257655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:50.257655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:50.257655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:50.257655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:50.257655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:50.257655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:50.257655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:50.257655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:50.257655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:50.257655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:50.257655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:50.258690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:50.258690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:50.258690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:06:50.258690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:06:50.258690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:06:50.258690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:06:50.258690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:06:50.258690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:06:50.258690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 04:06:50.258690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:50.259254 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4877d8-c371-42cc-af10-83ce17805f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:50.259254 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4877d8-c371-42cc-af10-83ce17805f67 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:50.259254 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4877d8-c371-42cc-af10-83ce17805f67 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:50.259497 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 552/1097] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Aug 23 04:06:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:50.259570 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4877d8-c371-42cc-af10-83ce17805f67 None admin] PATH_INFO: `/v3/projects/d633d76ebca14303a6e540b3edfd1f98` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:50.259570 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4877d8-c371-42cc-af10-83ce17805f67 None admin] RBAC: Authorizing `identity:get_project(project_id=d633d76ebca14303a6e540b3edfd1f98)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:50.260728 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4877d8-c371-42cc-af10-83ce17805f67 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:50.262736 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 546/1098] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:06:50 2022] GET /identity/v3/projects/d633d76ebca14303a6e540b3edfd1f98 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:50.263241 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fb46c-70a6-4273-a207-68ad4b160a60 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:50.268815 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4877d8-c371-42cc-af10-83ce17805f67 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:50.324095 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:50.364302 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fb46c-70a6-4273-a207-68ad4b160a60 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:50.366825 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4877d8-c371-42cc-af10-83ce17805f67 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:50.398594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb00bda-7dcf-4d33-91f4-ce0a313d59fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:50.399214 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb00bda-7dcf-4d33-91f4-ce0a313d59fc None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:50.399495 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb00bda-7dcf-4d33-91f4-ce0a313d59fc None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:50.399772 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb00bda-7dcf-4d33-91f4-ce0a313d59fc None admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:50.399889 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d0ba8-231e-4a09-a1dc-70c494af9fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:50.400384 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d0ba8-231e-4a09-a1dc-70c494af9fa8 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:50.400494 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb00bda-7dcf-4d33-91f4-ce0a313d59fc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:50.400665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d0ba8-231e-4a09-a1dc-70c494af9fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:50.400807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb00bda-7dcf-4d33-91f4-ce0a313d59fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:50.400976 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d0ba8-231e-4a09-a1dc-70c494af9fa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:50.401692 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d0ba8-231e-4a09-a1dc-70c494af9fa8 None admin] RBAC: Adding query filter params (role.id=255d9e4004c54505a7cda1b8af74e5f1, scope.project.id=d633d76ebca14303a6e540b3edfd1f98, user.id=882f7798c8004d5c84c3c8fa8df57a17) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:50.402002 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d0ba8-231e-4a09-a1dc-70c494af9fa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:50.402265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb00bda-7dcf-4d33-91f4-ce0a313d59fc None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:50.403409 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d0ba8-231e-4a09-a1dc-70c494af9fa8 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:50.404774 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:50.409809 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 547/1099] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:06:50 2022] GET /identity/v3/role_assignments?user.id=882f7798c8004d5c84c3c8fa8df57a17&scope.project.id=d633d76ebca14303a6e540b3edfd1f98&role.id=255d9e4004c54505a7cda1b8af74e5f1 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:06:50.420866 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 553/1100] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Aug 23 04:06:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:50.428138 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d0ba8-231e-4a09-a1dc-70c494af9fa8 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:50.534553 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d0ba8-231e-4a09-a1dc-70c494af9fa8 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:50.555257 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:50.568982 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6d8fe-8dca-4fb8-b1a4-302452067b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:50.569696 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6d8fe-8dca-4fb8-b1a4-302452067b2b None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:50.569980 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6d8fe-8dca-4fb8-b1a4-302452067b2b None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:50.570253 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6d8fe-8dca-4fb8-b1a4-302452067b2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:50.636870 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6d8fe-8dca-4fb8-b1a4-302452067b2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:50.638362 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6d8fe-8dca-4fb8-b1a4-302452067b2b None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:50.734401 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 548/1101] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:06:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 04:06:50.740252 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb00bda-7dcf-4d33-91f4-ce0a313d59fc None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:50.855395 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb00bda-7dcf-4d33-91f4-ce0a313d59fc None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:50.888747 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d25404-35cd-4269-9670-1f0b665afa11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:50.889413 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d25404-35cd-4269-9670-1f0b665afa11 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:50.889695 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d25404-35cd-4269-9670-1f0b665afa11 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:50.890483 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d25404-35cd-4269-9670-1f0b665afa11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:50.900385 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d25404-35cd-4269-9670-1f0b665afa11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:50.901855 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d25404-35cd-4269-9670-1f0b665afa11 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:50.916401 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-48d25404-35cd-4269-9670-1f0b665afa11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:50.916401 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:50.916401 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:50.916401 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:50.916401 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:50.916401 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:50.916401 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:50.916401 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:50.916401 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:50.916401 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:50.916401 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:50.916401 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:50.916401 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:06:50.916401 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:06:50.916401 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:06:50.916401 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:06:50.917541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:50.917541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:50.917541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:50.917541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:50.917541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:50.917541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:50.917541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:50.917541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:50.917541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:50.917541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:50.917541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:50.917541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:50.917541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:50.917541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:50.917541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:50.917541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:50.917541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:06:50.918480 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:06:50.918480 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:06:50.918480 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:50.918480 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 554/1102] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:50.923172 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6d8fe-8dca-4fb8-b1a4-302452067b2b None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:50.946512 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:51.022434 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6d8fe-8dca-4fb8-b1a4-302452067b2b None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:51.054479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8ee47-03d3-4ca7-bb6d-f21ecc8b4a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:51.055086 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8ee47-03d3-4ca7-bb6d-f21ecc8b4a20 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:51.055367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8ee47-03d3-4ca7-bb6d-f21ecc8b4a20 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:51.055637 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8ee47-03d3-4ca7-bb6d-f21ecc8b4a20 None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:51.056273 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8ee47-03d3-4ca7-bb6d-f21ecc8b4a20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:51.056573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8ee47-03d3-4ca7-bb6d-f21ecc8b4a20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:51.057952 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8ee47-03d3-4ca7-bb6d-f21ecc8b4a20 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:51.069335 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 549/1103] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:51.074879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d25404-35cd-4269-9670-1f0b665afa11 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:51.120571 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:51.173448 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d25404-35cd-4269-9670-1f0b665afa11 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:51.206504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927a61c-2467-4071-930d-66662acb982f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:51.207125 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927a61c-2467-4071-930d-66662acb982f None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:51.207404 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927a61c-2467-4071-930d-66662acb982f None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:51.207673 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927a61c-2467-4071-930d-66662acb982f None admin] PATH_INFO: `/v3/projects/service` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:51.214029 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927a61c-2467-4071-930d-66662acb982f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:51.215458 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927a61c-2467-4071-930d-66662acb982f None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:51.226212 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-9927a61c-2467-4071-930d-66662acb982f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:06:51.226212 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:06:51.226212 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:06:51.226212 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:06:51.226212 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:06:51.226212 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:06:51.226212 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:06:51.226212 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:06:51.226212 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:06:51.226212 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:06:51.226212 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:06:51.226212 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:06:51.226212 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:06:51.226212 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:06:51.226212 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:06:51.227210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:06:51.227210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:06:51.227210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:06:51.227210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:06:51.227210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:06:51.227210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:06:51.227210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:06:51.227210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:06:51.227210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:06:51.227210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:06:51.227210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:06:51.227210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:06:51.227210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:06:51.227210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:06:51.227210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:06:51.227210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:06:51.227210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:06:51.228137 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:06:51.228137 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:06:51.228137 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:06:51.228137 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:06:51.228137 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:06:51.228137 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:06:51.228137 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:06:51.228137 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:06:51.231000 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 555/1104] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:06:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:06:51.233049 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8ee47-03d3-4ca7-bb6d-f21ecc8b4a20 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:51.313333 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:51.331628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8ee47-03d3-4ca7-bb6d-f21ecc8b4a20 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:51.364638 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233e133-8e9e-48c5-ba38-813108a7119d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:51.365287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233e133-8e9e-48c5-ba38-813108a7119d None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:51.365571 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233e133-8e9e-48c5-ba38-813108a7119d None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:51.365841 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233e133-8e9e-48c5-ba38-813108a7119d None admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:51.366528 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233e133-8e9e-48c5-ba38-813108a7119d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:51.366834 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233e133-8e9e-48c5-ba38-813108a7119d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:51.368253 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233e133-8e9e-48c5-ba38-813108a7119d None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:51.380589 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 550/1105] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:06:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:51.386641 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927a61c-2467-4071-930d-66662acb982f None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:51.489750 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927a61c-2467-4071-930d-66662acb982f None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:51.496518 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:51.524907 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885da54-f727-4337-87f3-0015d5a79c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:51.525556 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885da54-f727-4337-87f3-0015d5a79c16 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:51.525837 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885da54-f727-4337-87f3-0015d5a79c16 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:51.526108 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885da54-f727-4337-87f3-0015d5a79c16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:51.526847 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885da54-f727-4337-87f3-0015d5a79c16 None admin] RBAC: Adding query filter params (role.id=3c58c3168e8e4a6d8bcb887f5c3f4a10, scope.project.id=a7ada12a1e3a42949c00f483efd522ba, user.id=1e0236a0acac4b87be977878b5186551) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:51.527155 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885da54-f727-4337-87f3-0015d5a79c16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:51.528608 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885da54-f727-4337-87f3-0015d5a79c16 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:51.535023 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 556/1106] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:06:51 2022] GET /identity/v3/role_assignments?user.id=1e0236a0acac4b87be977878b5186551&scope.project.id=a7ada12a1e3a42949c00f483efd522ba&role.id=3c58c3168e8e4a6d8bcb887f5c3f4a10 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:52.349288 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81051c67-f75b-49b3-b904-214779eda7b2 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:52.349775 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81051c67-f75b-49b3-b904-214779eda7b2 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:52.349775 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81051c67-f75b-49b3-b904-214779eda7b2 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:52.351093 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 551/1107] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:52.356197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6651d-9ad2-4753-af8b-3c3435e7d0ba None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:52.356597 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6651d-9ad2-4753-af8b-3c3435e7d0ba None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:52.356751 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6651d-9ad2-4753-af8b-3c3435e7d0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:52.374430 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-01e6651d-9ad2-4753-af8b-3c3435e7d0ba None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:52.375613 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-01e6651d-9ad2-4753-af8b-3c3435e7d0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:52.441169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 557/1108] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:52.711862 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81051c67-f75b-49b3-b904-214779eda7b2 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:52.812564 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81051c67-f75b-49b3-b904-214779eda7b2 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:52.845416 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4257007-2d2c-450a-a52d-438f4d0161bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:52.846037 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4257007-2d2c-450a-a52d-438f4d0161bd None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:52.846317 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4257007-2d2c-450a-a52d-438f4d0161bd None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:52.846590 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4257007-2d2c-450a-a52d-438f4d0161bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:52.847783 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4257007-2d2c-450a-a52d-438f4d0161bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:52.849237 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4257007-2d2c-450a-a52d-438f4d0161bd None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:52.850788 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 552/1109] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:06:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:52.856382 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6651d-9ad2-4753-af8b-3c3435e7d0ba None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:52.951412 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:52.954374 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6651d-9ad2-4753-af8b-3c3435e7d0ba None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:52.992528 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ab77b-e63e-4b33-8634-d8b8ec36c9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:52.993072 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ab77b-e63e-4b33-8634-d8b8ec36c9d5 None admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:52.993556 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ab77b-e63e-4b33-8634-d8b8ec36c9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:52.993839 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ab77b-e63e-4b33-8634-d8b8ec36c9d5 None admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:52.994492 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ab77b-e63e-4b33-8634-d8b8ec36c9d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:52.995932 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ab77b-e63e-4b33-8634-d8b8ec36c9d5 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:53.083858 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 558/1110] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 23 04:06:52 2022] POST /identity/v3/users => generated 286 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:06:55.004308 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c6b99-91bf-4944-ab0c-13aae3a2ad5f None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:55.004736 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c6b99-91bf-4944-ab0c-13aae3a2ad5f None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:55.004853 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c6b99-91bf-4944-ab0c-13aae3a2ad5f None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:55.006324 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 553/1111] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:55.011456 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456caef7-5075-40e7-ae44-1216677e4ede None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:55.011845 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456caef7-5075-40e7-ae44-1216677e4ede None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:55.012011 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456caef7-5075-40e7-ae44-1216677e4ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:55.030207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-456caef7-5075-40e7-ae44-1216677e4ede None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:55.031395 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-456caef7-5075-40e7-ae44-1216677e4ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:55.095884 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 559/1112] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:55.361518 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c6b99-91bf-4944-ab0c-13aae3a2ad5f None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:55.372258 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:55.459781 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c6b99-91bf-4944-ab0c-13aae3a2ad5f None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:55.492667 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d179133-8410-46b5-964f-ef032c00a258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:55.493309 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d179133-8410-46b5-964f-ef032c00a258 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:55.493589 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d179133-8410-46b5-964f-ef032c00a258 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:55.493860 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d179133-8410-46b5-964f-ef032c00a258 None admin] PATH_INFO: `/v3/roles/5434f93251a0417c890b94b90b40ab71` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:55.495224 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d179133-8410-46b5-964f-ef032c00a258 None admin] RBAC: Authorizing `identity:get_role(role_id=5434f93251a0417c890b94b90b40ab71)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:55.496578 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d179133-8410-46b5-964f-ef032c00a258 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:55.497892 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 554/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:06:55 2022] GET /identity/v3/roles/5434f93251a0417c890b94b90b40ab71 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:55.503646 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456caef7-5075-40e7-ae44-1216677e4ede None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:55.585025 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:55.601319 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456caef7-5075-40e7-ae44-1216677e4ede None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:55.634836 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c26af-4509-4e55-99c8-65f199dfd6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:55.635461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c26af-4509-4e55-99c8-65f199dfd6c6 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:55.635741 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c26af-4509-4e55-99c8-65f199dfd6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:55.636014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c26af-4509-4e55-99c8-65f199dfd6c6 None admin] PATH_INFO: `/v3/users/44eb147743d748eda6c60eaaa48e0a71` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:55.648621 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c26af-4509-4e55-99c8-65f199dfd6c6 None admin] RBAC: Authorizing `identity:get_user(user_id=44eb147743d748eda6c60eaaa48e0a71)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:55.650089 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c26af-4509-4e55-99c8-65f199dfd6c6 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:55.651679 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 560/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:06:55 2022] GET /identity/v3/users/44eb147743d748eda6c60eaaa48e0a71 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:55.657860 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d179133-8410-46b5-964f-ef032c00a258 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:55.733152 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:55.755440 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d179133-8410-46b5-964f-ef032c00a258 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:55.789214 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b85396-fd99-4278-b66d-699ead5f7910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:55.789810 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b85396-fd99-4278-b66d-699ead5f7910 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:55.790094 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b85396-fd99-4278-b66d-699ead5f7910 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:55.790369 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b85396-fd99-4278-b66d-699ead5f7910 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:55.856323 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b85396-fd99-4278-b66d-699ead5f7910 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:55.857789 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b85396-fd99-4278-b66d-699ead5f7910 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:55.929699 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:55.952318 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 555/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:06:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 04:06:55.958030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c26af-4509-4e55-99c8-65f199dfd6c6 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:56.055714 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c26af-4509-4e55-99c8-65f199dfd6c6 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:56.088989 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701467f-dbb5-4b25-b028-1c12403c6fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:56.089783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701467f-dbb5-4b25-b028-1c12403c6fd8 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:56.090161 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701467f-dbb5-4b25-b028-1c12403c6fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:56.090531 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701467f-dbb5-4b25-b028-1c12403c6fd8 None admin] PATH_INFO: `/v3/projects/d633d76ebca14303a6e540b3edfd1f98` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:56.091780 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701467f-dbb5-4b25-b028-1c12403c6fd8 None admin] RBAC: Authorizing `identity:get_project(project_id=d633d76ebca14303a6e540b3edfd1f98)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:56.094004 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701467f-dbb5-4b25-b028-1c12403c6fd8 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:56.095585 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 561/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:06:55 2022] GET /identity/v3/projects/d633d76ebca14303a6e540b3edfd1f98 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:56.101750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b85396-fd99-4278-b66d-699ead5f7910 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:56.197349 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b85396-fd99-4278-b66d-699ead5f7910 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:56.230883 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa3729-fe01-4708-a826-0cbd095c790f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:56.231481 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa3729-fe01-4708-a826-0cbd095c790f None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:56.231762 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa3729-fe01-4708-a826-0cbd095c790f None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:56.232037 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa3729-fe01-4708-a826-0cbd095c790f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:56.232756 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa3729-fe01-4708-a826-0cbd095c790f None admin] RBAC: Adding query filter params (role.id=5434f93251a0417c890b94b90b40ab71, scope.project.id=d633d76ebca14303a6e540b3edfd1f98, user.id=44eb147743d748eda6c60eaaa48e0a71) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:06:56.233201 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa3729-fe01-4708-a826-0cbd095c790f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:56.234628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa3729-fe01-4708-a826-0cbd095c790f None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:56.239816 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 556/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:06:56 2022] GET /identity/v3/role_assignments?user.id=44eb147743d748eda6c60eaaa48e0a71&scope.project.id=d633d76ebca14303a6e540b3edfd1f98&role.id=5434f93251a0417c890b94b90b40ab71 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:58.094035 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d66c5-9170-46b3-823e-cc405bda00d7 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:58.094576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d66c5-9170-46b3-823e-cc405bda00d7 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:58.094576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d66c5-9170-46b3-823e-cc405bda00d7 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:58.095941 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 562/1118] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:06:58.101425 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a6119-4363-4fc5-9973-38a860798c1d None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:58.101833 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a6119-4363-4fc5-9973-38a860798c1d None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:58.101987 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a6119-4363-4fc5-9973-38a860798c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:58.120090 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-597a6119-4363-4fc5-9973-38a860798c1d None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:06:58.121292 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-597a6119-4363-4fc5-9973-38a860798c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:06:58.154544 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:58.186574 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 557/1119] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:06:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:06:58.454131 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d66c5-9170-46b3-823e-cc405bda00d7 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:58.469319 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:58.553907 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d66c5-9170-46b3-823e-cc405bda00d7 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:58.587705 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898adcf-82b8-4afc-ac0b-2ff9767e11c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:58.588323 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898adcf-82b8-4afc-ac0b-2ff9767e11c0 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:58.588601 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898adcf-82b8-4afc-ac0b-2ff9767e11c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:58.588870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898adcf-82b8-4afc-ac0b-2ff9767e11c0 None admin] PATH_INFO: `/v3/roles/5434f93251a0417c890b94b90b40ab71` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:58.590261 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898adcf-82b8-4afc-ac0b-2ff9767e11c0 None admin] RBAC: Authorizing `identity:get_role(role_id=5434f93251a0417c890b94b90b40ab71)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:58.591612 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898adcf-82b8-4afc-ac0b-2ff9767e11c0 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:58.593463 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 563/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:06:58 2022] GET /identity/v3/roles/5434f93251a0417c890b94b90b40ab71 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:58.599203 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a6119-4363-4fc5-9973-38a860798c1d None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:58.694979 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a6119-4363-4fc5-9973-38a860798c1d None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:58.727433 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395447f-7872-4e72-9e74-9253545caabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:58.728050 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395447f-7872-4e72-9e74-9253545caabd None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:58.728330 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395447f-7872-4e72-9e74-9253545caabd None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:58.728601 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395447f-7872-4e72-9e74-9253545caabd None admin] PATH_INFO: `/v3/users/44eb147743d748eda6c60eaaa48e0a71` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:58.729712 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395447f-7872-4e72-9e74-9253545caabd None admin] RBAC: Authorizing `identity:get_user(user_id=44eb147743d748eda6c60eaaa48e0a71)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:58.731138 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395447f-7872-4e72-9e74-9253545caabd None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:58.732645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 558/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:06:58 2022] GET /identity/v3/users/44eb147743d748eda6c60eaaa48e0a71 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:58.738414 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898adcf-82b8-4afc-ac0b-2ff9767e11c0 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:58.817259 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:58.835289 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898adcf-82b8-4afc-ac0b-2ff9767e11c0 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:58.868794 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ffec1-865c-4ea0-80b9-2b81be0dd6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:58.869430 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ffec1-865c-4ea0-80b9-2b81be0dd6b4 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:58.869707 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ffec1-865c-4ea0-80b9-2b81be0dd6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:58.869974 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ffec1-865c-4ea0-80b9-2b81be0dd6b4 None admin] PATH_INFO: `/v3/projects/d633d76ebca14303a6e540b3edfd1f98` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:58.871068 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ffec1-865c-4ea0-80b9-2b81be0dd6b4 None admin] RBAC: Authorizing `identity:get_project(project_id=d633d76ebca14303a6e540b3edfd1f98)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:58.872473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ffec1-865c-4ea0-80b9-2b81be0dd6b4 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:58.874686 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 564/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:06:58 2022] GET /identity/v3/projects/d633d76ebca14303a6e540b3edfd1f98 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:06:58.880505 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395447f-7872-4e72-9e74-9253545caabd None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:06:58.919040 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:06:58.980440 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395447f-7872-4e72-9e74-9253545caabd None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:06:59.013935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21646082-7f41-4d9a-8928-8042efcff421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:06:59.014632 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21646082-7f41-4d9a-8928-8042efcff421 None admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:06:59.014914 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21646082-7f41-4d9a-8928-8042efcff421 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:06:59.015187 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21646082-7f41-4d9a-8928-8042efcff421 None admin] PATH_INFO: `/v3/projects/d633d76ebca14303a6e540b3edfd1f98/users/44eb147743d748eda6c60eaaa48e0a71/roles/5434f93251a0417c890b94b90b40ab71` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:06:59.017337 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21646082-7f41-4d9a-8928-8042efcff421 None admin] RBAC: Authorizing `identity:create_grant(project_id=d633d76ebca14303a6e540b3edfd1f98, user_id=44eb147743d748eda6c60eaaa48e0a71, role_id=5434f93251a0417c890b94b90b40ab71)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:06:59.018765 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21646082-7f41-4d9a-8928-8042efcff421 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:06:59.071392 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 559/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 23 04:06:58 2022] PUT /identity/v3/projects/d633d76ebca14303a6e540b3edfd1f98/users/44eb147743d748eda6c60eaaa48e0a71/roles/5434f93251a0417c890b94b90b40ab71 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:07:00.947469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186eed1-d2c1-4d39-9970-2c216653c382 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:00.947984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186eed1-d2c1-4d39-9970-2c216653c382 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:00.948097 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186eed1-d2c1-4d39-9970-2c216653c382 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:00.949397 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 565/1124] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:07:00.954648 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffc84d-9ef1-4cbf-84a5-6053d351d96f None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:00.955120 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffc84d-9ef1-4cbf-84a5-6053d351d96f None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:00.955216 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffc84d-9ef1-4cbf-84a5-6053d351d96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:00.973535 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-36ffc84d-9ef1-4cbf-84a5-6053d351d96f None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:07:00.974715 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-36ffc84d-9ef1-4cbf-84a5-6053d351d96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:07:01.040134 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 560/1125] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:07:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:07:01.306708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186eed1-d2c1-4d39-9970-2c216653c382 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:01.406460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186eed1-d2c1-4d39-9970-2c216653c382 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:01.439382 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28a5a9-d2f9-4fb6-a00a-e7f9abd997ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:01.440001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28a5a9-d2f9-4fb6-a00a-e7f9abd997ae None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:01.440278 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28a5a9-d2f9-4fb6-a00a-e7f9abd997ae None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:01.440546 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28a5a9-d2f9-4fb6-a00a-e7f9abd997ae None admin] PATH_INFO: `/v3/roles/5434f93251a0417c890b94b90b40ab71` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:01.441923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28a5a9-d2f9-4fb6-a00a-e7f9abd997ae None admin] RBAC: Authorizing `identity:get_role(role_id=5434f93251a0417c890b94b90b40ab71)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:01.443273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28a5a9-d2f9-4fb6-a00a-e7f9abd997ae None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:01.444572 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 566/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:07:01 2022] GET /identity/v3/roles/5434f93251a0417c890b94b90b40ab71 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:07:01.450147 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffc84d-9ef1-4cbf-84a5-6053d351d96f None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:01.477501 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:01.547349 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffc84d-9ef1-4cbf-84a5-6053d351d96f None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:01.581323 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ec37d-03d7-431b-aad7-da5192081782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:01.581976 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ec37d-03d7-431b-aad7-da5192081782 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:01.582258 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ec37d-03d7-431b-aad7-da5192081782 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:01.582530 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ec37d-03d7-431b-aad7-da5192081782 None admin] PATH_INFO: `/v3/users/44eb147743d748eda6c60eaaa48e0a71` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:01.583629 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ec37d-03d7-431b-aad7-da5192081782 None admin] RBAC: Authorizing `identity:get_user(user_id=44eb147743d748eda6c60eaaa48e0a71)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:01.585065 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ec37d-03d7-431b-aad7-da5192081782 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:01.586639 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 561/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:07:01 2022] GET /identity/v3/users/44eb147743d748eda6c60eaaa48e0a71 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:07:01.592571 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28a5a9-d2f9-4fb6-a00a-e7f9abd997ae None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:01.610411 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:01.690049 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28a5a9-d2f9-4fb6-a00a-e7f9abd997ae None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:01.723106 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417c72f-3bb2-4c24-8387-9180895d0047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:01.723705 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417c72f-3bb2-4c24-8387-9180895d0047 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:01.723987 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417c72f-3bb2-4c24-8387-9180895d0047 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:01.724259 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417c72f-3bb2-4c24-8387-9180895d0047 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:01.788879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b417c72f-3bb2-4c24-8387-9180895d0047 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:01.790349 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b417c72f-3bb2-4c24-8387-9180895d0047 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:01.807110 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:01.887924 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 567/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:07:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 04:07:01.893881 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ec37d-03d7-431b-aad7-da5192081782 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:01.984491 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:01.990104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ec37d-03d7-431b-aad7-da5192081782 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:02.024193 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9dc75-9960-4791-a135-6183a275f647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:02.024820 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9dc75-9960-4791-a135-6183a275f647 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:02.025125 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9dc75-9960-4791-a135-6183a275f647 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:02.025406 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9dc75-9960-4791-a135-6183a275f647 None admin] PATH_INFO: `/v3/projects/d633d76ebca14303a6e540b3edfd1f98` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:02.026519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9dc75-9960-4791-a135-6183a275f647 None admin] RBAC: Authorizing `identity:get_project(project_id=d633d76ebca14303a6e540b3edfd1f98)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:02.027949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9dc75-9960-4791-a135-6183a275f647 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:02.029591 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 562/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:07:01 2022] GET /identity/v3/projects/d633d76ebca14303a6e540b3edfd1f98 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:07:02.035680 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417c72f-3bb2-4c24-8387-9180895d0047 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:02.132639 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417c72f-3bb2-4c24-8387-9180895d0047 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:02.148472 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:02.166061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea0b44-169c-43d5-8f50-30bfcfbcb5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:02.166656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea0b44-169c-43d5-8f50-30bfcfbcb5a1 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:02.166937 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea0b44-169c-43d5-8f50-30bfcfbcb5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:02.167208 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea0b44-169c-43d5-8f50-30bfcfbcb5a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:02.167976 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea0b44-169c-43d5-8f50-30bfcfbcb5a1 None admin] RBAC: Adding query filter params (role.id=5434f93251a0417c890b94b90b40ab71, scope.project.id=d633d76ebca14303a6e540b3edfd1f98, user.id=44eb147743d748eda6c60eaaa48e0a71) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:07:02.168477 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea0b44-169c-43d5-8f50-30bfcfbcb5a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:02.170677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea0b44-169c-43d5-8f50-30bfcfbcb5a1 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:02.176976 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 568/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:07:02 2022] GET /identity/v3/role_assignments?user.id=44eb147743d748eda6c60eaaa48e0a71&scope.project.id=d633d76ebca14303a6e540b3edfd1f98&role.id=5434f93251a0417c890b94b90b40ab71 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:07:04.074466 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18a85c-c90c-45d3-85f8-64e7aac81e7e None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:04.075030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18a85c-c90c-45d3-85f8-64e7aac81e7e None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:04.075030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18a85c-c90c-45d3-85f8-64e7aac81e7e None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:04.076346 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 563/1131] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:07:04.081665 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4897c-f06e-4495-b4b2-ef1e410fc4ac None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:04.082103 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4897c-f06e-4495-b4b2-ef1e410fc4ac None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:04.082203 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4897c-f06e-4495-b4b2-ef1e410fc4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:04.099795 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-45a4897c-f06e-4495-b4b2-ef1e410fc4ac None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:07:04.100970 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-45a4897c-f06e-4495-b4b2-ef1e410fc4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:07:04.165771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 569/1132] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:07:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:07:04.431797 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18a85c-c90c-45d3-85f8-64e7aac81e7e None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:04.528881 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18a85c-c90c-45d3-85f8-64e7aac81e7e None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:04.562144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4507a95-a61b-41c7-917e-40f105259149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:04.562761 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4507a95-a61b-41c7-917e-40f105259149 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:04.563041 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4507a95-a61b-41c7-917e-40f105259149 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:04.563310 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4507a95-a61b-41c7-917e-40f105259149 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:04.564401 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4507a95-a61b-41c7-917e-40f105259149 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:04.565849 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4507a95-a61b-41c7-917e-40f105259149 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:04.567372 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 564/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:07:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:07:04.573025 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4897c-f06e-4495-b4b2-ef1e410fc4ac None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:04.668432 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4897c-f06e-4495-b4b2-ef1e410fc4ac None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:04.679531 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:04.701794 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92e0d6-311a-4c2b-8a00-547b8d04a779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:04.702348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92e0d6-311a-4c2b-8a00-547b8d04a779 None admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:04.702628 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92e0d6-311a-4c2b-8a00-547b8d04a779 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:04.702907 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92e0d6-311a-4c2b-8a00-547b8d04a779 None admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:04.703543 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92e0d6-311a-4c2b-8a00-547b8d04a779 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:04.704973 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92e0d6-311a-4c2b-8a00-547b8d04a779 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:04.792369 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 570/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 23 04:07:04 2022] POST /identity/v3/projects => generated 311 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:07:06.707581 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460d2bb-765d-4ac8-bdd0-f5aac5fe2619 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:06.708156 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460d2bb-765d-4ac8-bdd0-f5aac5fe2619 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:06.708156 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460d2bb-765d-4ac8-bdd0-f5aac5fe2619 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:06.709481 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 565/1135] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:07:06.714589 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190311a-b313-4498-b9a3-9f44a25c13de None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:06.715047 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190311a-b313-4498-b9a3-9f44a25c13de None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:06.715146 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190311a-b313-4498-b9a3-9f44a25c13de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:06.732701 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-a190311a-b313-4498-b9a3-9f44a25c13de None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:07:06.733893 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-a190311a-b313-4498-b9a3-9f44a25c13de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:07:06.797289 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 571/1136] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:07:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:07:07.062828 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460d2bb-765d-4ac8-bdd0-f5aac5fe2619 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:07.093161 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:07.160736 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460d2bb-765d-4ac8-bdd0-f5aac5fe2619 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:07.193795 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b8f5c-4dcf-49db-99d9-7da73f09ff59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:07.194404 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b8f5c-4dcf-49db-99d9-7da73f09ff59 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:07.194681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b8f5c-4dcf-49db-99d9-7da73f09ff59 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:07.194951 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b8f5c-4dcf-49db-99d9-7da73f09ff59 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:07.196041 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b8f5c-4dcf-49db-99d9-7da73f09ff59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:07.197514 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b8f5c-4dcf-49db-99d9-7da73f09ff59 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:07.199030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 566/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:07:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:07:07.204662 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190311a-b313-4498-b9a3-9f44a25c13de None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:07.291487 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:07.300300 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190311a-b313-4498-b9a3-9f44a25c13de None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:07.333933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7875bb-606a-4795-9ae1-255eaa94674a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:07.334535 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7875bb-606a-4795-9ae1-255eaa94674a None admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:07.334815 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7875bb-606a-4795-9ae1-255eaa94674a None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:07.335088 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7875bb-606a-4795-9ae1-255eaa94674a None admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:07.335739 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7875bb-606a-4795-9ae1-255eaa94674a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:07.337236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7875bb-606a-4795-9ae1-255eaa94674a None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:07.402637 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 572/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 23 04:07:07 2022] POST /identity/v3/users => generated 286 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:07:09.324884 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f2107-eb20-4050-8d09-28f1d78f22c8 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:09.325429 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f2107-eb20-4050-8d09-28f1d78f22c8 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:09.325429 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f2107-eb20-4050-8d09-28f1d78f22c8 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:09.326728 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 567/1139] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:07:09.331809 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7eb0b-8a46-417f-bd86-b18dd75be894 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:09.332235 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7eb0b-8a46-417f-bd86-b18dd75be894 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:09.332363 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7eb0b-8a46-417f-bd86-b18dd75be894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:09.350024 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-02a7eb0b-8a46-417f-bd86-b18dd75be894 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:07:09.351203 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-02a7eb0b-8a46-417f-bd86-b18dd75be894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:07:09.415710 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 573/1140] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:07:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:07:09.691423 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f2107-eb20-4050-8d09-28f1d78f22c8 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:09.785364 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:09.789153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f2107-eb20-4050-8d09-28f1d78f22c8 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:09.821923 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aedcad-3b2b-4b92-9684-ccbc4f09f207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:09.822542 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aedcad-3b2b-4b92-9684-ccbc4f09f207 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:09.822820 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aedcad-3b2b-4b92-9684-ccbc4f09f207 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:09.823086 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aedcad-3b2b-4b92-9684-ccbc4f09f207 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:09.838234 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aedcad-3b2b-4b92-9684-ccbc4f09f207 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:07:09.843461 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-58aedcad-3b2b-4b92-9684-ccbc4f09f207 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:07:09.843461 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:07:09.843461 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:07:09.843461 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:07:09.843461 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:07:09.843461 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:07:09.843461 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:07:09.843461 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:07:09.843461 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:07:09.843461 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:07:09.843461 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:07:09.843461 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:07:09.843461 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:07:09.843461 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:07:09.843461 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:07:09.843461 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:07:09.844633 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:07:09.844633 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:07:09.844633 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:07:09.844633 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:07:09.844633 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:07:09.844633 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:07:09.844633 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:07:09.844633 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:07:09.844633 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:07:09.844633 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:07:09.844633 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:07:09.844633 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:07:09.844633 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:07:09.844633 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:07:09.844633 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:07:09.844633 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:07:09.845773 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:07:09.845773 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:07:09.845773 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:07:09.845773 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:07:09.845773 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:07:09.845773 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:07:09.845773 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:07:09.845773 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:07:09.845773 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:07:09.845773 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:07:09.845773 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:07:09.845773 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:07:09.845773 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 568/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:07:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:07:09.850760 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7eb0b-8a46-417f-bd86-b18dd75be894 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:09.928013 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:09.948813 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7eb0b-8a46-417f-bd86-b18dd75be894 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:09.982537 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbde0bf-b2c1-4406-823e-7a46d7e9e3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:09.983150 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbde0bf-b2c1-4406-823e-7a46d7e9e3ad None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:09.983433 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbde0bf-b2c1-4406-823e-7a46d7e9e3ad None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:09.983709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbde0bf-b2c1-4406-823e-7a46d7e9e3ad None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:09.984418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbde0bf-b2c1-4406-823e-7a46d7e9e3ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:07:09.984932 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbde0bf-b2c1-4406-823e-7a46d7e9e3ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:09.986654 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbde0bf-b2c1-4406-823e-7a46d7e9e3ad None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:09.994694 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 574/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:07:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:07:10.000563 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aedcad-3b2b-4b92-9684-ccbc4f09f207 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:10.099111 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aedcad-3b2b-4b92-9684-ccbc4f09f207 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:10.130956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a8659-15d8-4209-b349-a08516f656cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:10.131573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a8659-15d8-4209-b349-a08516f656cb None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:10.131856 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a8659-15d8-4209-b349-a08516f656cb None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:10.132130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a8659-15d8-4209-b349-a08516f656cb None admin] PATH_INFO: `/v3/users/0e9b22c1731642debfd7c8802a1f8712` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:10.145433 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a8659-15d8-4209-b349-a08516f656cb None admin] RBAC: Authorizing `identity:get_user(user_id=0e9b22c1731642debfd7c8802a1f8712)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:10.149772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a8659-15d8-4209-b349-a08516f656cb None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:10.149772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 569/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:07:09 2022] GET /identity/v3/users/0e9b22c1731642debfd7c8802a1f8712 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:07:10.154928 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbde0bf-b2c1-4406-823e-7a46d7e9e3ad None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:10.271618 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbde0bf-b2c1-4406-823e-7a46d7e9e3ad None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:10.304141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d5f34-3a37-4438-b477-470dedfd23ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:10.304736 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d5f34-3a37-4438-b477-470dedfd23ad None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:10.305014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d5f34-3a37-4438-b477-470dedfd23ad None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:10.305310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d5f34-3a37-4438-b477-470dedfd23ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:10.316987 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:10.371788 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d5f34-3a37-4438-b477-470dedfd23ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:10.373270 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d5f34-3a37-4438-b477-470dedfd23ad None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:10.468676 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 575/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:07:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 04:07:10.474656 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a8659-15d8-4209-b349-a08516f656cb None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:10.493266 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:10.571950 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a8659-15d8-4209-b349-a08516f656cb None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:10.605001 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ac017-2684-4013-a5bf-27f572cad70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:10.605655 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ac017-2684-4013-a5bf-27f572cad70c None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:10.605935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ac017-2684-4013-a5bf-27f572cad70c None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:10.606207 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ac017-2684-4013-a5bf-27f572cad70c None admin] PATH_INFO: `/v3/projects/e586a0d88eab47d49e0642cad6b617ac` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:10.607313 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ac017-2684-4013-a5bf-27f572cad70c None admin] RBAC: Authorizing `identity:get_project(project_id=e586a0d88eab47d49e0642cad6b617ac)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:10.608758 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ac017-2684-4013-a5bf-27f572cad70c None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:10.610396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 570/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:07:10 2022] GET /identity/v3/projects/e586a0d88eab47d49e0642cad6b617ac => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:07:10.616393 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d5f34-3a37-4438-b477-470dedfd23ad None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:10.656682 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:10.712426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d5f34-3a37-4438-b477-470dedfd23ad None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:10.744366 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72610a17-5054-4b1d-9e9e-253cefc5e349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:10.744953 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72610a17-5054-4b1d-9e9e-253cefc5e349 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:10.745254 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72610a17-5054-4b1d-9e9e-253cefc5e349 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:10.745523 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72610a17-5054-4b1d-9e9e-253cefc5e349 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:10.746243 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72610a17-5054-4b1d-9e9e-253cefc5e349 None admin] RBAC: Adding query filter params (role.id=255d9e4004c54505a7cda1b8af74e5f1, scope.project.id=e586a0d88eab47d49e0642cad6b617ac, user.id=0e9b22c1731642debfd7c8802a1f8712) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:07:10.746547 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72610a17-5054-4b1d-9e9e-253cefc5e349 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:10.748462 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72610a17-5054-4b1d-9e9e-253cefc5e349 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:10.753653 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 576/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:07:10 2022] GET /identity/v3/role_assignments?user.id=0e9b22c1731642debfd7c8802a1f8712&scope.project.id=e586a0d88eab47d49e0642cad6b617ac&role.id=255d9e4004c54505a7cda1b8af74e5f1 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:07:12.610299 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5effd-0d69-4185-928c-c2937f136d37 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:12.610848 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5effd-0d69-4185-928c-c2937f136d37 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:12.610848 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5effd-0d69-4185-928c-c2937f136d37 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:12.612192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 571/1147] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:07:12.617265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56f7d0-d2bb-4683-bd0c-90515b26a6e8 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:12.617671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56f7d0-d2bb-4683-bd0c-90515b26a6e8 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:12.617822 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56f7d0-d2bb-4683-bd0c-90515b26a6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:12.636039 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-fd56f7d0-d2bb-4683-bd0c-90515b26a6e8 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:07:12.637262 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-fd56f7d0-d2bb-4683-bd0c-90515b26a6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:07:12.701799 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 577/1148] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:07:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:07:12.970689 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5effd-0d69-4185-928c-c2937f136d37 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:13.054412 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:13.069800 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5effd-0d69-4185-928c-c2937f136d37 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:13.103709 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca919b3-6260-4299-8e2f-c2b6dfb81769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:13.104326 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca919b3-6260-4299-8e2f-c2b6dfb81769 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:13.104604 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca919b3-6260-4299-8e2f-c2b6dfb81769 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:13.104875 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca919b3-6260-4299-8e2f-c2b6dfb81769 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:13.114594 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca919b3-6260-4299-8e2f-c2b6dfb81769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:07:13.119192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-0ca919b3-6260-4299-8e2f-c2b6dfb81769 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:07:13.119192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:07:13.119192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:07:13.119192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:07:13.119192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:07:13.119192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:07:13.119192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:07:13.119192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:07:13.119192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:07:13.119192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:07:13.119192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:07:13.119192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:07:13.119192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:07:13.119192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:07:13.119192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:07:13.119192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:07:13.120306 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:07:13.120306 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:07:13.120306 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:07:13.120306 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:07:13.120306 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:07:13.120306 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:07:13.120306 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:07:13.120306 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:07:13.120306 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:07:13.120306 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:07:13.120306 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:07:13.120306 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:07:13.120306 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:07:13.120306 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:07:13.120306 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:07:13.120306 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:07:13.121268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:07:13.121268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:07:13.121268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:07:13.121268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:07:13.121268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:07:13.121268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:07:13.121268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:07:13.121268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:07:13.121268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:07:13.121268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:07:13.121268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:07:13.121268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:07:13.121268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 572/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:07:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:07:13.126184 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56f7d0-d2bb-4683-bd0c-90515b26a6e8 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:13.159307 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:13.222819 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56f7d0-d2bb-4683-bd0c-90515b26a6e8 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:13.255324 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469e539-9fb8-4b69-8c6f-2fbbe7661010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:13.255931 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469e539-9fb8-4b69-8c6f-2fbbe7661010 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:13.256210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469e539-9fb8-4b69-8c6f-2fbbe7661010 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:13.256484 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469e539-9fb8-4b69-8c6f-2fbbe7661010 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:13.257179 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469e539-9fb8-4b69-8c6f-2fbbe7661010 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:07:13.257484 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469e539-9fb8-4b69-8c6f-2fbbe7661010 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:13.258848 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469e539-9fb8-4b69-8c6f-2fbbe7661010 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:13.267270 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 578/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:07:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:07:13.273058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca919b3-6260-4299-8e2f-c2b6dfb81769 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:13.370559 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca919b3-6260-4299-8e2f-c2b6dfb81769 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:13.403128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dfd0b1-5285-481c-935f-759f2fd1d01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:13.404291 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfd0b1-5285-481c-935f-759f2fd1d01b None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:13.404575 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfd0b1-5285-481c-935f-759f2fd1d01b None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:13.404849 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfd0b1-5285-481c-935f-759f2fd1d01b None admin] PATH_INFO: `/v3/users/0e9b22c1731642debfd7c8802a1f8712` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:13.405999 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dfd0b1-5285-481c-935f-759f2fd1d01b None admin] RBAC: Authorizing `identity:get_user(user_id=0e9b22c1731642debfd7c8802a1f8712)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:13.407426 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dfd0b1-5285-481c-935f-759f2fd1d01b None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:13.408960 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 573/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:07:13 2022] GET /identity/v3/users/0e9b22c1731642debfd7c8802a1f8712 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:07:13.414515 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469e539-9fb8-4b69-8c6f-2fbbe7661010 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:13.506682 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:13.512298 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469e539-9fb8-4b69-8c6f-2fbbe7661010 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:13.544972 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd6b5a-2f77-4495-b310-114483a23642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:13.545637 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd6b5a-2f77-4495-b310-114483a23642 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:13.546041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd6b5a-2f77-4495-b310-114483a23642 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:13.546648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd6b5a-2f77-4495-b310-114483a23642 None admin] PATH_INFO: `/v3/projects/e586a0d88eab47d49e0642cad6b617ac` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:13.547778 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd6b5a-2f77-4495-b310-114483a23642 None admin] RBAC: Authorizing `identity:get_project(project_id=e586a0d88eab47d49e0642cad6b617ac)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:13.549250 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd6b5a-2f77-4495-b310-114483a23642 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:13.551152 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 579/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:07:13 2022] GET /identity/v3/projects/e586a0d88eab47d49e0642cad6b617ac => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:07:13.556980 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dfd0b1-5285-481c-935f-759f2fd1d01b None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:13.572737 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:13.655219 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dfd0b1-5285-481c-935f-759f2fd1d01b None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:13.688001 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce1be4-0ff8-4612-8ae5-7f377c70e676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:13.688645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce1be4-0ff8-4612-8ae5-7f377c70e676 None admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:13.688927 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce1be4-0ff8-4612-8ae5-7f377c70e676 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:13.689233 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce1be4-0ff8-4612-8ae5-7f377c70e676 None admin] PATH_INFO: `/v3/projects/e586a0d88eab47d49e0642cad6b617ac/users/0e9b22c1731642debfd7c8802a1f8712/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:13.691091 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce1be4-0ff8-4612-8ae5-7f377c70e676 None admin] RBAC: Authorizing `identity:create_grant(project_id=e586a0d88eab47d49e0642cad6b617ac, user_id=0e9b22c1731642debfd7c8802a1f8712, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:13.692509 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce1be4-0ff8-4612-8ae5-7f377c70e676 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:13.768261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 574/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 23 04:07:13 2022] PUT /identity/v3/projects/e586a0d88eab47d49e0642cad6b617ac/users/0e9b22c1731642debfd7c8802a1f8712/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:07:15.622867 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828ad70-1d25-482d-aa9a-040acf448599 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:15.623414 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828ad70-1d25-482d-aa9a-040acf448599 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:15.623414 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828ad70-1d25-482d-aa9a-040acf448599 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:15.624852 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 580/1154] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:07:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:07:15.629973 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a90acb-6230-497c-8069-e74570f9e779 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:15.630390 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a90acb-6230-497c-8069-e74570f9e779 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:15.630523 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a90acb-6230-497c-8069-e74570f9e779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:15.648128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-25a90acb-6230-497c-8069-e74570f9e779 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:07:15.649343 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-25a90acb-6230-497c-8069-e74570f9e779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:07:15.713947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 575/1155] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:07:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:07:15.982134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7828ad70-1d25-482d-aa9a-040acf448599 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:16.082141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7828ad70-1d25-482d-aa9a-040acf448599 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:16.115424 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a9f00-5d36-49bf-92b2-8fc7ace76800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:16.116049 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a9f00-5d36-49bf-92b2-8fc7ace76800 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:16.116332 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a9f00-5d36-49bf-92b2-8fc7ace76800 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:16.116605 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a9f00-5d36-49bf-92b2-8fc7ace76800 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:16.127019 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a9f00-5d36-49bf-92b2-8fc7ace76800 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:07:16.131657 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-084a9f00-5d36-49bf-92b2-8fc7ace76800 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:07:16.131657 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:07:16.131657 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:07:16.131657 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:07:16.131657 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:07:16.131657 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:07:16.131657 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:07:16.131657 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:07:16.131657 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:07:16.131657 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:07:16.131657 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:07:16.131657 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:07:16.131657 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:07:16.131657 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:07:16.131657 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:07:16.131657 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:07:16.132748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:07:16.132748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:07:16.132748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:07:16.132748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:07:16.132748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:07:16.132748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:07:16.132748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:07:16.132748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:07:16.132748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:07:16.132748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:07:16.132748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:07:16.132748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:07:16.132748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:07:16.132748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:07:16.132748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:07:16.132748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:07:16.133840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:07:16.133840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:07:16.133840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:07:16.133840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:07:16.133840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:07:16.133840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:07:16.133840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:07:16.133840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:07:16.133840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:07:16.133840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:07:16.133840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:07:16.133840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:07:16.133840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 581/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:07:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:07:16.139173 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a90acb-6230-497c-8069-e74570f9e779 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:16.142223 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:16.237425 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a90acb-6230-497c-8069-e74570f9e779 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:16.269980 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa718815-f1f9-4895-a287-65f095c5213b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:16.270585 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa718815-f1f9-4895-a287-65f095c5213b None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:16.270868 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa718815-f1f9-4895-a287-65f095c5213b None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:16.271142 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa718815-f1f9-4895-a287-65f095c5213b None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:16.271806 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa718815-f1f9-4895-a287-65f095c5213b None admin] RBAC: Adding query filter params (name=admin) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:07:16.272110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa718815-f1f9-4895-a287-65f095c5213b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:16.273495 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa718815-f1f9-4895-a287-65f095c5213b None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:16.281851 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 576/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:07:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:07:16.287577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a9f00-5d36-49bf-92b2-8fc7ace76800 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:16.313346 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:16.385838 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a9f00-5d36-49bf-92b2-8fc7ace76800 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:16.419444 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e3032-16aa-4f1b-867d-78e0f7441b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:16.420071 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e3032-16aa-4f1b-867d-78e0f7441b46 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:16.420352 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e3032-16aa-4f1b-867d-78e0f7441b46 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:16.420624 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e3032-16aa-4f1b-867d-78e0f7441b46 None admin] PATH_INFO: `/v3/users/0e9b22c1731642debfd7c8802a1f8712` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:16.421751 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e3032-16aa-4f1b-867d-78e0f7441b46 None admin] RBAC: Authorizing `identity:get_user(user_id=0e9b22c1731642debfd7c8802a1f8712)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:16.423186 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e3032-16aa-4f1b-867d-78e0f7441b46 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:16.424752 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 582/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:07:16 2022] GET /identity/v3/users/0e9b22c1731642debfd7c8802a1f8712 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:07:16.430752 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa718815-f1f9-4895-a287-65f095c5213b None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:16.493819 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:16.528395 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa718815-f1f9-4895-a287-65f095c5213b None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:16.566900 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c5616-3e52-4488-86bc-22120eb98de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:16.567491 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c5616-3e52-4488-86bc-22120eb98de5 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:16.567772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c5616-3e52-4488-86bc-22120eb98de5 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:16.568045 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c5616-3e52-4488-86bc-22120eb98de5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:16.632425 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c5616-3e52-4488-86bc-22120eb98de5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:16.633898 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c5616-3e52-4488-86bc-22120eb98de5 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:16.694554 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:16.728280 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 577/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:07:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 04:07:16.734222 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e3032-16aa-4f1b-867d-78e0f7441b46 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:16.824404 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:16.832808 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e3032-16aa-4f1b-867d-78e0f7441b46 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:16.864826 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a4c81-0499-4cc1-be3e-8ad93c0b5a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:16.865475 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a4c81-0499-4cc1-be3e-8ad93c0b5a2c None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:16.865760 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a4c81-0499-4cc1-be3e-8ad93c0b5a2c None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:16.866035 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a4c81-0499-4cc1-be3e-8ad93c0b5a2c None admin] PATH_INFO: `/v3/projects/e586a0d88eab47d49e0642cad6b617ac` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:16.867141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a4c81-0499-4cc1-be3e-8ad93c0b5a2c None admin] RBAC: Authorizing `identity:get_project(project_id=e586a0d88eab47d49e0642cad6b617ac)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:16.868572 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a4c81-0499-4cc1-be3e-8ad93c0b5a2c None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:16.870215 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 583/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:07:16 2022] GET /identity/v3/projects/e586a0d88eab47d49e0642cad6b617ac => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:07:16.877017 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c5616-3e52-4488-86bc-22120eb98de5 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:16.973162 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c5616-3e52-4488-86bc-22120eb98de5 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:17.006757 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7d498-585d-4816-b7c1-e8dc7bdf5041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:17.007363 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7d498-585d-4816-b7c1-e8dc7bdf5041 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:17.007647 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7d498-585d-4816-b7c1-e8dc7bdf5041 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:17.007922 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7d498-585d-4816-b7c1-e8dc7bdf5041 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:17.008650 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7d498-585d-4816-b7c1-e8dc7bdf5041 None admin] RBAC: Adding query filter params (role.id=255d9e4004c54505a7cda1b8af74e5f1, scope.project.id=e586a0d88eab47d49e0642cad6b617ac, user.id=0e9b22c1731642debfd7c8802a1f8712) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:07:17.008960 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7d498-585d-4816-b7c1-e8dc7bdf5041 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:17.010418 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7d498-585d-4816-b7c1-e8dc7bdf5041 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:17.016053 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 578/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:07:16 2022] GET /identity/v3/role_assignments?user.id=0e9b22c1731642debfd7c8802a1f8712&scope.project.id=e586a0d88eab47d49e0642cad6b617ac&role.id=255d9e4004c54505a7cda1b8af74e5f1 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:07:18.912938 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f48a3c-4b5e-44bf-8c0d-f29218b6cb79 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:18.913517 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f48a3c-4b5e-44bf-8c0d-f29218b6cb79 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:18.913517 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f48a3c-4b5e-44bf-8c0d-f29218b6cb79 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:18.914890 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 584/1162] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:07:18.920181 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d33d3d-46e7-4da5-9990-3203dd8d0072 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:18.920606 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d33d3d-46e7-4da5-9990-3203dd8d0072 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:18.920760 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d33d3d-46e7-4da5-9990-3203dd8d0072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:18.939150 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-16d33d3d-46e7-4da5-9990-3203dd8d0072 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:07:18.940341 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-16d33d3d-46e7-4da5-9990-3203dd8d0072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:07:18.964015 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:19.004939 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 579/1163] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:07:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:07:19.269367 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f48a3c-4b5e-44bf-8c0d-f29218b6cb79 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:19.368833 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f48a3c-4b5e-44bf-8c0d-f29218b6cb79 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:19.401259 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a752a-29d4-4215-a94a-5f64803ae832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:19.401856 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a752a-29d4-4215-a94a-5f64803ae832 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:19.402136 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a752a-29d4-4215-a94a-5f64803ae832 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:19.402409 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a752a-29d4-4215-a94a-5f64803ae832 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:19.429368 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:19.468701 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a752a-29d4-4215-a94a-5f64803ae832 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:19.470167 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a752a-29d4-4215-a94a-5f64803ae832 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:19.564239 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 585/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:07:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 04:07:19.569980 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d33d3d-46e7-4da5-9990-3203dd8d0072 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:19.666637 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d33d3d-46e7-4da5-9990-3203dd8d0072 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:19.700104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaef144-e9c6-40be-90a4-814dab0c5865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:19.700725 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaef144-e9c6-40be-90a4-814dab0c5865 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:19.701009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaef144-e9c6-40be-90a4-814dab0c5865 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:19.701305 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaef144-e9c6-40be-90a4-814dab0c5865 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:19.707754 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaef144-e9c6-40be-90a4-814dab0c5865 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:19.709213 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaef144-e9c6-40be-90a4-814dab0c5865 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:19.720151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-dbaef144-e9c6-40be-90a4-814dab0c5865 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 23 04:07:19.720151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:07:19.720151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 23 04:07:19.720151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 23 04:07:19.720151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:07:19.720151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:07:19.720151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:07:19.720151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:07:19.720151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 23 04:07:19.720151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:07:19.720151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 04:07:19.720151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:07:19.720151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:07:19.720151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:07:19.720151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:07:19.720151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:07:19.720151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:07:19.721433 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:07:19.721433 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:07:19.721433 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:07:19.721433 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:07:19.721433 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:07:19.721433 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:07:19.721433 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:07:19.721433 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:07:19.721433 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:07:19.721433 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:07:19.721433 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:07:19.721433 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:07:19.721433 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:07:19.721433 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:07:19.721433 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:07:19.721433 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:07:19.722530 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:07:19.722530 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:07:19.722530 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:07:19.722530 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:07:19.722530 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:07:19.722530 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:07:19.722530 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:07:19.722530 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:07:19.722530 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:07:19.722530 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:07:19.722530 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 23 04:07:19.722530 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:07:19.722530 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 23 04:07:19.722530 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:07:19.725236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 580/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Aug 23 04:07:19 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:07:19.727062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a752a-29d4-4215-a94a-5f64803ae832 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:19.783813 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:19.825313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a752a-29d4-4215-a94a-5f64803ae832 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:19.857327 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8916809-b75d-4b7c-a4ea-4c574d10d406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:19.857916 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8916809-b75d-4b7c-a4ea-4c574d10d406 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:19.858193 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8916809-b75d-4b7c-a4ea-4c574d10d406 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:19.858459 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8916809-b75d-4b7c-a4ea-4c574d10d406 None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:19.859087 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8916809-b75d-4b7c-a4ea-4c574d10d406 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:07:19.859383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8916809-b75d-4b7c-a4ea-4c574d10d406 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:19.860717 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8916809-b75d-4b7c-a4ea-4c574d10d406 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:19.867508 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 586/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Aug 23 04:07:19 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:07:21.722436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acbaf5-ca05-4465-a520-4b60dd1a6a3e None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:21.722972 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acbaf5-ca05-4465-a520-4b60dd1a6a3e None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:21.722972 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acbaf5-ca05-4465-a520-4b60dd1a6a3e None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:21.724309 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 581/1167] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:07:21.729572 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93fb5d-17fe-4ba6-9042-8ed54548a6c6 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:21.729946 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93fb5d-17fe-4ba6-9042-8ed54548a6c6 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:21.730124 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93fb5d-17fe-4ba6-9042-8ed54548a6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:21.748093 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-ca93fb5d-17fe-4ba6-9042-8ed54548a6c6 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:07:21.749292 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-ca93fb5d-17fe-4ba6-9042-8ed54548a6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:07:21.814489 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 587/1168] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:07:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:07:22.077399 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acbaf5-ca05-4465-a520-4b60dd1a6a3e None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:22.099389 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:22.176643 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acbaf5-ca05-4465-a520-4b60dd1a6a3e None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:22.210008 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e55c7-3aad-4a3f-9652-4758f7e2b480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:22.210598 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e55c7-3aad-4a3f-9652-4758f7e2b480 None admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:22.210878 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e55c7-3aad-4a3f-9652-4758f7e2b480 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:22.211157 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e55c7-3aad-4a3f-9652-4758f7e2b480 None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:22.211806 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e55c7-3aad-4a3f-9652-4758f7e2b480 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:22.213195 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e55c7-3aad-4a3f-9652-4758f7e2b480 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:22.315479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 582/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Tue Aug 23 04:07:22 2022] POST /identity/v3/domains => generated 267 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:07:24.214979 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ccfe4-5da5-40b6-941e-0cd5e7da669d None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:24.215474 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ccfe4-5da5-40b6-941e-0cd5e7da669d None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:24.215474 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ccfe4-5da5-40b6-941e-0cd5e7da669d None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:24.216773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 588/1170] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:07:24.222124 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdd341-ad94-47bc-bfea-8af041ace35d None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:24.222498 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdd341-ad94-47bc-bfea-8af041ace35d None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:24.222670 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdd341-ad94-47bc-bfea-8af041ace35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:24.240280 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-74fdd341-ad94-47bc-bfea-8af041ace35d None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:07:24.241493 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-74fdd341-ad94-47bc-bfea-8af041ace35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:07:24.306660 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 583/1171] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:07:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:07:24.571573 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ccfe4-5da5-40b6-941e-0cd5e7da669d None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:24.627164 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:24.671540 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ccfe4-5da5-40b6-941e-0cd5e7da669d None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:24.704129 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc3058-3513-4fbb-994d-5486c4fa9548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:24.704762 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc3058-3513-4fbb-994d-5486c4fa9548 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:24.705046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc3058-3513-4fbb-994d-5486c4fa9548 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:24.705348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc3058-3513-4fbb-994d-5486c4fa9548 None admin] PATH_INFO: `/v3/domains/3487abe73266434da131a4a533d01102` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:24.715876 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc3058-3513-4fbb-994d-5486c4fa9548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3487abe73266434da131a4a533d01102)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:24.717343 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc3058-3513-4fbb-994d-5486c4fa9548 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:24.718920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 589/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Tue Aug 23 04:07:24 2022] GET /identity/v3/domains/3487abe73266434da131a4a533d01102 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:07:24.724694 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdd341-ad94-47bc-bfea-8af041ace35d None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:24.736619 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:24.820236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdd341-ad94-47bc-bfea-8af041ace35d None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:24.852822 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a7c83-7844-4840-a43c-291432741b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:24.853391 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a7c83-7844-4840-a43c-291432741b1e None admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:24.853675 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a7c83-7844-4840-a43c-291432741b1e None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:24.853951 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a7c83-7844-4840-a43c-291432741b1e None admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:24.854602 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a7c83-7844-4840-a43c-291432741b1e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:24.856617 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a7c83-7844-4840-a43c-291432741b1e None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:24.939281 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 584/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 23 04:07:24 2022] POST /identity/v3/projects => generated 361 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:07:26.842120 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b62207-8583-4f8a-a67f-bea7e3f61d33 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:26.842679 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b62207-8583-4f8a-a67f-bea7e3f61d33 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:26.842679 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b62207-8583-4f8a-a67f-bea7e3f61d33 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:26.844011 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 590/1174] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:07:26.849270 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf1c35-a58c-42a4-8507-6e49514dfe2b None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:26.849690 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf1c35-a58c-42a4-8507-6e49514dfe2b None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:26.849834 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf1c35-a58c-42a4-8507-6e49514dfe2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:26.868224 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-88bf1c35-a58c-42a4-8507-6e49514dfe2b None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:07:26.869434 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-88bf1c35-a58c-42a4-8507-6e49514dfe2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:07:26.925499 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:26.935472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 585/1175] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:07:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:07:27.207442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b62207-8583-4f8a-a67f-bea7e3f61d33 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:27.306533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b62207-8583-4f8a-a67f-bea7e3f61d33 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:27.319531 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:27.338842 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798d1c9-27ea-4ecc-9a5e-5f74440fa761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:27.340055 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798d1c9-27ea-4ecc-9a5e-5f74440fa761 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:27.340338 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798d1c9-27ea-4ecc-9a5e-5f74440fa761 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:27.340611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798d1c9-27ea-4ecc-9a5e-5f74440fa761 None admin] PATH_INFO: `/v3/domains/3487abe73266434da131a4a533d01102` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:27.341737 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6798d1c9-27ea-4ecc-9a5e-5f74440fa761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3487abe73266434da131a4a533d01102)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:27.343231 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6798d1c9-27ea-4ecc-9a5e-5f74440fa761 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:27.345046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 591/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Tue Aug 23 04:07:27 2022] GET /identity/v3/domains/3487abe73266434da131a4a533d01102 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:07:27.350658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf1c35-a58c-42a4-8507-6e49514dfe2b None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:27.444952 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf1c35-a58c-42a4-8507-6e49514dfe2b None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:27.478227 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c5e28-4d80-4803-b1d6-f004384b3a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:27.478765 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c5e28-4d80-4803-b1d6-f004384b3a37 None admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:27.479048 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c5e28-4d80-4803-b1d6-f004384b3a37 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:27.479322 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c5e28-4d80-4803-b1d6-f004384b3a37 None admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:27.479996 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c5e28-4d80-4803-b1d6-f004384b3a37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:27.481442 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c5e28-4d80-4803-b1d6-f004384b3a37 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:27.572360 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 586/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 23 04:07:27 2022] POST /identity/v3/users => generated 311 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:07:29.485793 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296f57a-05c5-41cb-ac2f-8fb79805ea41 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:29.486310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296f57a-05c5-41cb-ac2f-8fb79805ea41 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:29.486422 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296f57a-05c5-41cb-ac2f-8fb79805ea41 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:29.487701 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 592/1178] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:07:29.492823 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110c09e-bc45-4480-9408-2f76b59cbbc9 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:29.493243 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110c09e-bc45-4480-9408-2f76b59cbbc9 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:29.493419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110c09e-bc45-4480-9408-2f76b59cbbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:29.511012 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-1110c09e-bc45-4480-9408-2f76b59cbbc9 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:07:29.512707 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-1110c09e-bc45-4480-9408-2f76b59cbbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:07:29.554935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:29.577668 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 587/1179] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:07:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:07:29.843944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296f57a-05c5-41cb-ac2f-8fb79805ea41 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:29.943260 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296f57a-05c5-41cb-ac2f-8fb79805ea41 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:29.976625 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225c3d0-1828-4c0f-9331-7ff5d098f734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:29.977294 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225c3d0-1828-4c0f-9331-7ff5d098f734 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:29.977578 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225c3d0-1828-4c0f-9331-7ff5d098f734 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:29.977853 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225c3d0-1828-4c0f-9331-7ff5d098f734 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:29.988176 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225c3d0-1828-4c0f-9331-7ff5d098f734 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:07:29.992790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-b225c3d0-1828-4c0f-9331-7ff5d098f734 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:07:29.992790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:07:29.992790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:07:29.992790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:07:29.992790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:07:29.992790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:07:29.992790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:07:29.992790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:07:29.992790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:07:29.992790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:07:29.992790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:07:29.992790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:07:29.992790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:07:29.992790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:07:29.992790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:07:29.992790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:07:29.993945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:07:29.993945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:07:29.993945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:07:29.993945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:07:29.993945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:07:29.993945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:07:29.993945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:07:29.993945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:07:29.993945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:07:29.993945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:07:29.993945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:07:29.993945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:07:29.993945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:07:29.993945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:07:29.993945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:07:29.993945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:07:29.995072 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:07:29.995072 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:07:29.995072 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:07:29.995072 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:07:29.995072 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:07:29.995072 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:07:29.995072 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:07:29.995072 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:07:29.995072 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:07:29.995072 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:07:29.995072 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:07:29.995072 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:07:29.995072 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 593/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:07:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:07:30.000356 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110c09e-bc45-4480-9408-2f76b59cbbc9 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:30.095983 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110c09e-bc45-4480-9408-2f76b59cbbc9 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:30.129077 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2282857-9015-4ccb-b6f0-b0ff18a81829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:30.129700 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2282857-9015-4ccb-b6f0-b0ff18a81829 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:30.129981 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2282857-9015-4ccb-b6f0-b0ff18a81829 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:30.130256 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2282857-9015-4ccb-b6f0-b0ff18a81829 None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:30.130919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2282857-9015-4ccb-b6f0-b0ff18a81829 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:07:30.131223 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2282857-9015-4ccb-b6f0-b0ff18a81829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:30.132580 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2282857-9015-4ccb-b6f0-b0ff18a81829 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:30.140883 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 588/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:07:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:07:30.146417 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225c3d0-1828-4c0f-9331-7ff5d098f734 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:30.188033 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:30.242790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225c3d0-1828-4c0f-9331-7ff5d098f734 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:30.275482 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df8f2d-c5e5-4b48-b042-474a124336ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:30.276099 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df8f2d-c5e5-4b48-b042-474a124336ba None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:30.276381 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df8f2d-c5e5-4b48-b042-474a124336ba None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:30.276655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df8f2d-c5e5-4b48-b042-474a124336ba None admin] PATH_INFO: `/v3/users/06b6d5a59857464b844ab3c01e09c71c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:30.290133 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df8f2d-c5e5-4b48-b042-474a124336ba None admin] RBAC: Authorizing `identity:get_user(user_id=06b6d5a59857464b844ab3c01e09c71c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:30.291561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df8f2d-c5e5-4b48-b042-474a124336ba None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:30.293705 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 594/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:07:30 2022] GET /identity/v3/users/06b6d5a59857464b844ab3c01e09c71c => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:07:30.299698 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2282857-9015-4ccb-b6f0-b0ff18a81829 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:30.340357 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:30.396644 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2282857-9015-4ccb-b6f0-b0ff18a81829 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:30.429052 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee1a3c-650c-4f51-97ed-6177c364bae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:30.429682 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee1a3c-650c-4f51-97ed-6177c364bae4 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:30.429964 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee1a3c-650c-4f51-97ed-6177c364bae4 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:30.430235 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee1a3c-650c-4f51-97ed-6177c364bae4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:30.494214 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee1a3c-650c-4f51-97ed-6177c364bae4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:30.495648 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee1a3c-650c-4f51-97ed-6177c364bae4 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:30.533802 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:30.590234 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 589/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:07:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 04:07:30.596016 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df8f2d-c5e5-4b48-b042-474a124336ba None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:30.690225 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:30.692932 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df8f2d-c5e5-4b48-b042-474a124336ba None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:30.725658 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7f711-a4bf-4417-b0b4-74008491e02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:30.726278 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7f711-a4bf-4417-b0b4-74008491e02a None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:30.726555 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7f711-a4bf-4417-b0b4-74008491e02a None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:30.726824 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7f711-a4bf-4417-b0b4-74008491e02a None admin] PATH_INFO: `/v3/projects/ccd6b38768624233a087717cee468cae` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:30.727920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7f711-a4bf-4417-b0b4-74008491e02a None admin] RBAC: Authorizing `identity:get_project(project_id=ccd6b38768624233a087717cee468cae)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:30.729365 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7f711-a4bf-4417-b0b4-74008491e02a None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:30.731597 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 595/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:07:30 2022] GET /identity/v3/projects/ccd6b38768624233a087717cee468cae => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:07:30.737661 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee1a3c-650c-4f51-97ed-6177c364bae4 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:30.832481 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee1a3c-650c-4f51-97ed-6177c364bae4 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:30.865637 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11d160-9837-4c2d-b74b-0a314b664382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:30.866234 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11d160-9837-4c2d-b74b-0a314b664382 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:30.866514 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11d160-9837-4c2d-b74b-0a314b664382 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:30.866789 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11d160-9837-4c2d-b74b-0a314b664382 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:30.867511 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f11d160-9837-4c2d-b74b-0a314b664382 None admin] RBAC: Adding query filter params (role.id=255d9e4004c54505a7cda1b8af74e5f1, scope.project.id=ccd6b38768624233a087717cee468cae, user.id=06b6d5a59857464b844ab3c01e09c71c) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:07:30.867820 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f11d160-9837-4c2d-b74b-0a314b664382 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:30.869260 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f11d160-9837-4c2d-b74b-0a314b664382 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:30.874392 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 590/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:07:30 2022] GET /identity/v3/role_assignments?user.id=06b6d5a59857464b844ab3c01e09c71c&scope.project.id=ccd6b38768624233a087717cee468cae&role.id=255d9e4004c54505a7cda1b8af74e5f1 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:07:32.719733 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54335ce-1167-439c-88a0-d6e351de7acd None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:32.720263 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54335ce-1167-439c-88a0-d6e351de7acd None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:32.720385 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54335ce-1167-439c-88a0-d6e351de7acd None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:32.722000 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 596/1186] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:07:32.727247 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84715cc9-e047-4ba0-aa2c-de4ba25d2f3c None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:32.727659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84715cc9-e047-4ba0-aa2c-de4ba25d2f3c None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:32.727802 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84715cc9-e047-4ba0-aa2c-de4ba25d2f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:32.736382 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:32.747794 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-84715cc9-e047-4ba0-aa2c-de4ba25d2f3c None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:07:32.748967 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-84715cc9-e047-4ba0-aa2c-de4ba25d2f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:07:32.818312 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 591/1187] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:07:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:07:33.092484 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54335ce-1167-439c-88a0-d6e351de7acd None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:33.190680 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54335ce-1167-439c-88a0-d6e351de7acd None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:33.223551 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e0dc1-662e-4cd0-8570-85a1b37786ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:33.224169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e0dc1-662e-4cd0-8570-85a1b37786ab None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:33.224447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e0dc1-662e-4cd0-8570-85a1b37786ab None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:33.224721 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e0dc1-662e-4cd0-8570-85a1b37786ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:33.235061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e0dc1-662e-4cd0-8570-85a1b37786ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:07:33.239708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-745e0dc1-662e-4cd0-8570-85a1b37786ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:07:33.239708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:07:33.239708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:07:33.239708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:07:33.239708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:07:33.239708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:07:33.239708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:07:33.239708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:07:33.239708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:07:33.239708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:07:33.239708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:07:33.239708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:07:33.239708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:07:33.239708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:07:33.239708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:07:33.239708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:07:33.240827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:07:33.240827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:07:33.240827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:07:33.240827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:07:33.240827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:07:33.240827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:07:33.240827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:07:33.240827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:07:33.240827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:07:33.240827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:07:33.240827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:07:33.240827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:07:33.240827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:07:33.240827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:07:33.240827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:07:33.240827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:07:33.242062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:07:33.242062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:07:33.242062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:07:33.242062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:07:33.242062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:07:33.242062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:07:33.242062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:07:33.242062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:07:33.242062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:07:33.242062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:07:33.242062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:07:33.242062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:07:33.242062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 597/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:07:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:07:33.246626 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84715cc9-e047-4ba0-aa2c-de4ba25d2f3c None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:33.342004 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84715cc9-e047-4ba0-aa2c-de4ba25d2f3c None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:33.374281 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573865d-6c84-495d-b6b8-247e66a40794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:33.374828 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573865d-6c84-495d-b6b8-247e66a40794 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:33.375110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573865d-6c84-495d-b6b8-247e66a40794 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:33.375389 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573865d-6c84-495d-b6b8-247e66a40794 None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:33.376055 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573865d-6c84-495d-b6b8-247e66a40794 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:07:33.376362 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573865d-6c84-495d-b6b8-247e66a40794 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:33.377749 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573865d-6c84-495d-b6b8-247e66a40794 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:33.379065 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:33.385946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 592/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:07:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:07:33.392065 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e0dc1-662e-4cd0-8570-85a1b37786ab None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:33.421111 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:33.490406 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e0dc1-662e-4cd0-8570-85a1b37786ab None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:33.523023 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce38677-938d-4191-98e6-57594bca36f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:33.523635 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce38677-938d-4191-98e6-57594bca36f9 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:33.523914 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce38677-938d-4191-98e6-57594bca36f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:33.524183 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce38677-938d-4191-98e6-57594bca36f9 None admin] PATH_INFO: `/v3/users/06b6d5a59857464b844ab3c01e09c71c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:33.525311 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce38677-938d-4191-98e6-57594bca36f9 None admin] RBAC: Authorizing `identity:get_user(user_id=06b6d5a59857464b844ab3c01e09c71c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:33.526724 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce38677-938d-4191-98e6-57594bca36f9 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:33.528990 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 598/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:07:33 2022] GET /identity/v3/users/06b6d5a59857464b844ab3c01e09c71c => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:07:33.534620 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573865d-6c84-495d-b6b8-247e66a40794 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:33.632203 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573865d-6c84-495d-b6b8-247e66a40794 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:33.664652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9c3b1-15f2-41f5-8977-8f5ca2d97f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:33.665293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9c3b1-15f2-41f5-8977-8f5ca2d97f21 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:33.665575 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9c3b1-15f2-41f5-8977-8f5ca2d97f21 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:33.665847 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9c3b1-15f2-41f5-8977-8f5ca2d97f21 None admin] PATH_INFO: `/v3/projects/ccd6b38768624233a087717cee468cae` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:33.666950 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9c3b1-15f2-41f5-8977-8f5ca2d97f21 None admin] RBAC: Authorizing `identity:get_project(project_id=ccd6b38768624233a087717cee468cae)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:33.668392 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9c3b1-15f2-41f5-8977-8f5ca2d97f21 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:33.669988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 593/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:07:33 2022] GET /identity/v3/projects/ccd6b38768624233a087717cee468cae => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:07:33.675845 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce38677-938d-4191-98e6-57594bca36f9 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:33.770409 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:33.779095 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce38677-938d-4191-98e6-57594bca36f9 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:33.813434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa3914-42c5-440f-a87e-a13c9e144041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:33.814084 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa3914-42c5-440f-a87e-a13c9e144041 None admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:33.814364 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa3914-42c5-440f-a87e-a13c9e144041 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:33.814635 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa3914-42c5-440f-a87e-a13c9e144041 None admin] PATH_INFO: `/v3/projects/ccd6b38768624233a087717cee468cae/users/06b6d5a59857464b844ab3c01e09c71c/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:33.816494 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa3914-42c5-440f-a87e-a13c9e144041 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd6b38768624233a087717cee468cae, user_id=06b6d5a59857464b844ab3c01e09c71c, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:33.818056 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa3914-42c5-440f-a87e-a13c9e144041 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:33.879754 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 599/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 23 04:07:33 2022] PUT /identity/v3/projects/ccd6b38768624233a087717cee468cae/users/06b6d5a59857464b844ab3c01e09c71c/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:07:35.735067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c52c58-cb51-4dd2-aa17-6b91ab8faa11 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:35.735635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c52c58-cb51-4dd2-aa17-6b91ab8faa11 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:35.735635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c52c58-cb51-4dd2-aa17-6b91ab8faa11 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:35.736936 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 594/1193] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:07:35.742089 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b618e5-ff62-42f4-9b93-05a41c637f40 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:35.742524 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b618e5-ff62-42f4-9b93-05a41c637f40 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:35.742634 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b618e5-ff62-42f4-9b93-05a41c637f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:35.760223 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-56b618e5-ff62-42f4-9b93-05a41c637f40 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:07:35.761943 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-56b618e5-ff62-42f4-9b93-05a41c637f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:07:35.826469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 600/1194] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:07:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:07:36.094945 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c52c58-cb51-4dd2-aa17-6b91ab8faa11 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:36.156271 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:36.193324 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c52c58-cb51-4dd2-aa17-6b91ab8faa11 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:36.226060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd8bef-8a46-46be-9244-19bb6b1b5353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:36.226677 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd8bef-8a46-46be-9244-19bb6b1b5353 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:36.226958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd8bef-8a46-46be-9244-19bb6b1b5353 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:36.227232 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd8bef-8a46-46be-9244-19bb6b1b5353 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:36.237489 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd8bef-8a46-46be-9244-19bb6b1b5353 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:07:36.242057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-eafd8bef-8a46-46be-9244-19bb6b1b5353 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:07:36.242057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:07:36.242057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:07:36.242057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:07:36.242057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:07:36.242057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:07:36.242057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:07:36.242057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:07:36.242057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:07:36.242057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:07:36.242057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:07:36.242057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:07:36.242057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:07:36.242057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:07:36.242057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:07:36.242057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:07:36.243278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:07:36.243278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:07:36.243278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:07:36.243278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:07:36.243278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:07:36.243278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:07:36.243278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:07:36.243278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:07:36.243278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:07:36.243278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:07:36.243278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:07:36.243278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:07:36.243278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:07:36.243278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:07:36.243278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:07:36.243278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:07:36.244428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:07:36.244428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:07:36.244428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:07:36.244428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:07:36.244428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:07:36.244428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:07:36.244428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:07:36.244428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:07:36.244428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:07:36.244428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:07:36.244428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:07:36.244428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:07:36.244428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 595/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:07:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:07:36.249631 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b618e5-ff62-42f4-9b93-05a41c637f40 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:36.332513 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:36.346964 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b618e5-ff62-42f4-9b93-05a41c637f40 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:36.380447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25408038-bab7-4c27-91fd-5893dbdadbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:36.381042 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25408038-bab7-4c27-91fd-5893dbdadbe5 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:36.381356 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25408038-bab7-4c27-91fd-5893dbdadbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:36.381629 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25408038-bab7-4c27-91fd-5893dbdadbe5 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:36.382292 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25408038-bab7-4c27-91fd-5893dbdadbe5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:07:36.382594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25408038-bab7-4c27-91fd-5893dbdadbe5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:36.383951 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25408038-bab7-4c27-91fd-5893dbdadbe5 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:36.392061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 601/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:07:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:07:36.397728 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd8bef-8a46-46be-9244-19bb6b1b5353 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:36.495047 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd8bef-8a46-46be-9244-19bb6b1b5353 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:36.517459 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:36.527508 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e52023-cbcb-4704-b6e7-1bd02f8e6ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:36.528126 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e52023-cbcb-4704-b6e7-1bd02f8e6ded None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:36.528406 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e52023-cbcb-4704-b6e7-1bd02f8e6ded None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:36.528679 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e52023-cbcb-4704-b6e7-1bd02f8e6ded None admin] PATH_INFO: `/v3/users/06b6d5a59857464b844ab3c01e09c71c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:36.529921 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e52023-cbcb-4704-b6e7-1bd02f8e6ded None admin] RBAC: Authorizing `identity:get_user(user_id=06b6d5a59857464b844ab3c01e09c71c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:36.531340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e52023-cbcb-4704-b6e7-1bd02f8e6ded None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:36.532918 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 596/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 23 04:07:36 2022] GET /identity/v3/users/06b6d5a59857464b844ab3c01e09c71c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:07:36.538676 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25408038-bab7-4c27-91fd-5893dbdadbe5 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:36.636455 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25408038-bab7-4c27-91fd-5893dbdadbe5 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:36.669344 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fab3a7-1a9c-4cf6-94e1-f1f6c9e6452c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:36.669936 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fab3a7-1a9c-4cf6-94e1-f1f6c9e6452c None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:36.670215 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fab3a7-1a9c-4cf6-94e1-f1f6c9e6452c None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:36.670488 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fab3a7-1a9c-4cf6-94e1-f1f6c9e6452c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:36.687595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:36.736221 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fab3a7-1a9c-4cf6-94e1-f1f6c9e6452c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:36.737699 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fab3a7-1a9c-4cf6-94e1-f1f6c9e6452c None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:36.831678 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 602/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:07:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 04:07:36.837461 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e52023-cbcb-4704-b6e7-1bd02f8e6ded None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:36.935245 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e52023-cbcb-4704-b6e7-1bd02f8e6ded None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:36.968080 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2a4ac-1413-45ce-b4df-157dbcbfc50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:36.968714 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2a4ac-1413-45ce-b4df-157dbcbfc50f None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:36.968996 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2a4ac-1413-45ce-b4df-157dbcbfc50f None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:36.969294 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2a4ac-1413-45ce-b4df-157dbcbfc50f None admin] PATH_INFO: `/v3/projects/ccd6b38768624233a087717cee468cae` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:36.970401 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2a4ac-1413-45ce-b4df-157dbcbfc50f None admin] RBAC: Authorizing `identity:get_project(project_id=ccd6b38768624233a087717cee468cae)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:36.971825 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2a4ac-1413-45ce-b4df-157dbcbfc50f None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:36.973470 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 597/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 23 04:07:36 2022] GET /identity/v3/projects/ccd6b38768624233a087717cee468cae => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:07:36.979486 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fab3a7-1a9c-4cf6-94e1-f1f6c9e6452c None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:07:37.027429 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:37.075461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fab3a7-1a9c-4cf6-94e1-f1f6c9e6452c None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:07:37.107982 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1a4b6-dd84-4627-85dd-0f767b668d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:07:37.108574 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1a4b6-dd84-4627-85dd-0f767b668d41 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:07:37.108852 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1a4b6-dd84-4627-85dd-0f767b668d41 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:07:37.109145 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1a4b6-dd84-4627-85dd-0f767b668d41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:07:37.109870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a1a4b6-dd84-4627-85dd-0f767b668d41 None admin] RBAC: Adding query filter params (role.id=255d9e4004c54505a7cda1b8af74e5f1, scope.project.id=ccd6b38768624233a087717cee468cae, user.id=06b6d5a59857464b844ab3c01e09c71c) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:07:37.110175 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a1a4b6-dd84-4627-85dd-0f767b668d41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:07:37.111581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a1a4b6-dd84-4627-85dd-0f767b668d41 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:07:37.117114 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 603/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:07:36 2022] GET /identity/v3/role_assignments?user.id=06b6d5a59857464b844ab3c01e09c71c&scope.project.id=ccd6b38768624233a087717cee468cae&role.id=255d9e4004c54505a7cda1b8af74e5f1 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:07:46.963825 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=70 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:07:47.114605 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=44 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:08:48.469502 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f879b-a941-44b2-9e69-35883fdb10c4 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:48.470087 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f879b-a941-44b2-9e69-35883fdb10c4 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:48.470087 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f879b-a941-44b2-9e69-35883fdb10c4 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:48.471400 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 598/1201] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:08:48.477079 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d073e5a-af0b-44a4-8ad2-e6f96adceb70 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:48.477565 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d073e5a-af0b-44a4-8ad2-e6f96adceb70 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:48.477665 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d073e5a-af0b-44a4-8ad2-e6f96adceb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:48.496171 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-5d073e5a-af0b-44a4-8ad2-e6f96adceb70 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:08:48.497404 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-5d073e5a-af0b-44a4-8ad2-e6f96adceb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:08:48.562496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 604/1202] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:08:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:08:48.830479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f879b-a941-44b2-9e69-35883fdb10c4 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:08:48.932317 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f879b-a941-44b2-9e69-35883fdb10c4 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:08:48.968390 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837ae3e-d089-4a1f-84f2-7057b88b3d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:08:48.969017 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837ae3e-d089-4a1f-84f2-7057b88b3d91 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:48.969327 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837ae3e-d089-4a1f-84f2-7057b88b3d91 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:48.969601 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837ae3e-d089-4a1f-84f2-7057b88b3d91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:48.980735 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837ae3e-d089-4a1f-84f2-7057b88b3d91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:08:48.982261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837ae3e-d089-4a1f-84f2-7057b88b3d91 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:08:48.996177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-0837ae3e-d089-4a1f-84f2-7057b88b3d91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:08:48.996177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:08:48.996177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:08:48.996177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:08:48.996177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:08:48.996177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:08:48.996177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:08:48.996177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:08:48.996177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:08:48.996177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:08:48.996177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:08:48.996177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:08:48.996177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:08:48.996177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:08:48.996177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:08:48.996177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:08:48.997420 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:08:48.997420 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:08:48.997420 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:08:48.997420 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:08:48.997420 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:08:48.997420 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:08:48.997420 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:08:48.997420 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:08:48.997420 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:08:48.997420 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:08:48.997420 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:08:48.997420 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:08:48.997420 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:08:48.997420 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:08:48.997420 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:08:48.997420 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:08:48.997420 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:08:48.998652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:08:48.998652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:08:48.998652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:08:48.998652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 599/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:08:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:08:49.003430 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d073e5a-af0b-44a4-8ad2-e6f96adceb70 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:08:49.100938 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d073e5a-af0b-44a4-8ad2-e6f96adceb70 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:08:49.128904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:08:49.135048 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956db56-ea22-4195-80fd-0e2f86bee4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:08:49.138165 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956db56-ea22-4195-80fd-0e2f86bee4a4 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:49.138165 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956db56-ea22-4195-80fd-0e2f86bee4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:49.138165 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956db56-ea22-4195-80fd-0e2f86bee4a4 None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:49.138165 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956db56-ea22-4195-80fd-0e2f86bee4a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:08:49.138165 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956db56-ea22-4195-80fd-0e2f86bee4a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:08:49.138690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956db56-ea22-4195-80fd-0e2f86bee4a4 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:08:49.149861 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 605/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:08:49.155916 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837ae3e-d089-4a1f-84f2-7057b88b3d91 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:08:49.209313 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:08:49.253431 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837ae3e-d089-4a1f-84f2-7057b88b3d91 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:08:49.288223 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701acc2f-1bf8-457f-9b9a-2aa36bdf0bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:08:49.288886 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701acc2f-1bf8-457f-9b9a-2aa36bdf0bbc None admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:49.289240 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701acc2f-1bf8-457f-9b9a-2aa36bdf0bbc None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:49.289566 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701acc2f-1bf8-457f-9b9a-2aa36bdf0bbc None admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:49.290245 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701acc2f-1bf8-457f-9b9a-2aa36bdf0bbc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:08:49.291796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701acc2f-1bf8-457f-9b9a-2aa36bdf0bbc None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:08:49.378424 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 600/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 23 04:08:49 2022] POST /identity/v3/users => generated 251 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:08:51.289429 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752da49-f3bc-434e-8216-df11e43c8312 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:51.289998 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752da49-f3bc-434e-8216-df11e43c8312 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:51.289998 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752da49-f3bc-434e-8216-df11e43c8312 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:51.291308 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 606/1206] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:08:51.296750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45756f3-4123-4909-b472-4defc5abb5ee None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:51.303158 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45756f3-4123-4909-b472-4defc5abb5ee None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:51.303158 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45756f3-4123-4909-b472-4defc5abb5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:51.315827 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-c45756f3-4123-4909-b472-4defc5abb5ee None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:08:51.317011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c45756f3-4123-4909-b472-4defc5abb5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:08:51.383258 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 601/1207] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:08:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:08:51.651033 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752da49-f3bc-434e-8216-df11e43c8312 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:08:51.750480 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752da49-f3bc-434e-8216-df11e43c8312 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:08:51.783732 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c566c74-5f7d-4855-83c1-111a1dbbc238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:08:51.784364 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c566c74-5f7d-4855-83c1-111a1dbbc238 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:51.784646 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c566c74-5f7d-4855-83c1-111a1dbbc238 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:51.784920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c566c74-5f7d-4855-83c1-111a1dbbc238 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:51.795630 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c566c74-5f7d-4855-83c1-111a1dbbc238 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:08:51.800272 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-1c566c74-5f7d-4855-83c1-111a1dbbc238 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:08:51.800272 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:08:51.800272 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:08:51.800272 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:08:51.800272 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:08:51.800272 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:08:51.800272 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:08:51.800272 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:08:51.800272 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:08:51.800272 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:08:51.800272 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:08:51.800272 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:08:51.800272 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:08:51.800272 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:08:51.800272 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:08:51.800272 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:08:51.801926 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:08:51.801926 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:08:51.801926 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:08:51.801926 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:08:51.801926 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:08:51.801926 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:08:51.801926 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:08:51.801926 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:08:51.801926 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:08:51.801926 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:08:51.801926 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:08:51.801926 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:08:51.801926 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:08:51.801926 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:08:51.801926 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:08:51.801926 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:08:51.803018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:08:51.803018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:08:51.803018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:08:51.803018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:08:51.803018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:08:51.803018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:08:51.803018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:08:51.803018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:08:51.803018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:08:51.803018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:08:51.803018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:08:51.803018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:08:51.803018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 607/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 23 04:08:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:08:51.807939 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45756f3-4123-4909-b472-4defc5abb5ee None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:08:51.846355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:08:51.904850 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45756f3-4123-4909-b472-4defc5abb5ee None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:08:51.938086 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c3e5d-ce96-4bc5-9acf-e9878dccda46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:08:51.938688 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c3e5d-ce96-4bc5-9acf-e9878dccda46 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:51.938967 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c3e5d-ce96-4bc5-9acf-e9878dccda46 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:51.939240 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c3e5d-ce96-4bc5-9acf-e9878dccda46 None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:51.939906 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c3e5d-ce96-4bc5-9acf-e9878dccda46 None admin] RBAC: Adding query filter params (name=service) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:08:51.940212 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c3e5d-ce96-4bc5-9acf-e9878dccda46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:08:51.941598 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c3e5d-ce96-4bc5-9acf-e9878dccda46 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:08:51.949992 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 602/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 23 04:08:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:08:51.955776 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c566c74-5f7d-4855-83c1-111a1dbbc238 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:08:52.006023 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:08:52.055369 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c566c74-5f7d-4855-83c1-111a1dbbc238 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:08:52.087710 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74428f45-305a-4d2d-a4ec-ce4c468d4db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:08:52.088339 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74428f45-305a-4d2d-a4ec-ce4c468d4db0 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:52.088618 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74428f45-305a-4d2d-a4ec-ce4c468d4db0 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:52.088890 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74428f45-305a-4d2d-a4ec-ce4c468d4db0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:52.099893 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74428f45-305a-4d2d-a4ec-ce4c468d4db0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:08:52.101393 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74428f45-305a-4d2d-a4ec-ce4c468d4db0 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:08:52.115923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-74428f45-305a-4d2d-a4ec-ce4c468d4db0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:08:52.115923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:08:52.115923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:08:52.115923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:08:52.115923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:08:52.115923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:08:52.115923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:08:52.115923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:08:52.115923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:08:52.115923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:08:52.115923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:08:52.115923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:08:52.115923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:08:52.115923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:08:52.115923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:08:52.115923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:08:52.117041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:08:52.117041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:08:52.117041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:08:52.117041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:08:52.117041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:08:52.117041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:08:52.117041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:08:52.117041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:08:52.117041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:08:52.117041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:08:52.117041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:08:52.117041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:08:52.117041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:08:52.117041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:08:52.117041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:08:52.117041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:08:52.117041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:08:52.118192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:08:52.118192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:08:52.118192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:08:52.118192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 608/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:08:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:08:52.123007 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c3e5d-ce96-4bc5-9acf-e9878dccda46 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:08:52.219071 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:08:52.221900 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c3e5d-ce96-4bc5-9acf-e9878dccda46 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:08:52.256232 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe35e5-91dd-40ac-af5e-cf209da10097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:08:52.256922 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe35e5-91dd-40ac-af5e-cf209da10097 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:52.257235 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe35e5-91dd-40ac-af5e-cf209da10097 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:52.262448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe35e5-91dd-40ac-af5e-cf209da10097 None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:52.262448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe35e5-91dd-40ac-af5e-cf209da10097 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:08:52.262448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe35e5-91dd-40ac-af5e-cf209da10097 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:08:52.262448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe35e5-91dd-40ac-af5e-cf209da10097 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:08:52.271392 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 603/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:08:52.277203 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74428f45-305a-4d2d-a4ec-ce4c468d4db0 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:08:52.377015 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74428f45-305a-4d2d-a4ec-ce4c468d4db0 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:08:52.378587 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:08:52.410509 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6feeca-17ad-4d91-a996-7bd3f93281a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:08:52.411707 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6feeca-17ad-4d91-a996-7bd3f93281a8 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:52.411989 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6feeca-17ad-4d91-a996-7bd3f93281a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:52.412264 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6feeca-17ad-4d91-a996-7bd3f93281a8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:52.419550 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6feeca-17ad-4d91-a996-7bd3f93281a8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:08:52.421264 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6feeca-17ad-4d91-a996-7bd3f93281a8 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:08:52.432290 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-ff6feeca-17ad-4d91-a996-7bd3f93281a8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 04:08:52.432290 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:08:52.432290 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:08:52.432290 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:08:52.432290 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:08:52.432290 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:08:52.432290 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:08:52.432290 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:08:52.432290 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:08:52.432290 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:08:52.432290 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:08:52.432290 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:08:52.432290 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:08:52.432290 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:08:52.432290 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:08:52.432290 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:08:52.433501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:08:52.433501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:08:52.433501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:08:52.433501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:08:52.433501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:08:52.433501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:08:52.433501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:08:52.433501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:08:52.433501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:08:52.433501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:08:52.433501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:08:52.433501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:08:52.433501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:08:52.433501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:08:52.433501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:08:52.433501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:08:52.433501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:08:52.433501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:08:52.434686 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:08:52.434686 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:08:52.434686 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:08:52.434686 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:08:52.434686 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:08:52.434686 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:08:52.434686 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:08:52.434686 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:08:52.434686 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 04:08:52.434686 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:08:52.434686 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 609/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:08:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:08:52.439342 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe35e5-91dd-40ac-af5e-cf209da10097 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:08:52.534745 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe35e5-91dd-40ac-af5e-cf209da10097 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:08:52.567568 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a36226-7c6b-4bdf-ab0f-fe20a6535ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:08:52.568161 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a36226-7c6b-4bdf-ab0f-fe20a6535ab9 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:52.568439 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a36226-7c6b-4bdf-ab0f-fe20a6535ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:52.568709 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a36226-7c6b-4bdf-ab0f-fe20a6535ab9 None admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:52.569451 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a36226-7c6b-4bdf-ab0f-fe20a6535ab9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:08:52.569753 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a36226-7c6b-4bdf-ab0f-fe20a6535ab9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:08:52.571167 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a36226-7c6b-4bdf-ab0f-fe20a6535ab9 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:08:52.588088 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 604/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Aug 23 04:08:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:08:52.593955 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6feeca-17ad-4d91-a996-7bd3f93281a8 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:08:52.700501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6feeca-17ad-4d91-a996-7bd3f93281a8 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:08:52.735005 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33dd89-6420-483f-933f-3c6c91f5a5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:08:52.735614 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33dd89-6420-483f-933f-3c6c91f5a5be None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:52.735890 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33dd89-6420-483f-933f-3c6c91f5a5be None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:52.736161 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33dd89-6420-483f-933f-3c6c91f5a5be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:52.765966 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:08:52.802579 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33dd89-6420-483f-933f-3c6c91f5a5be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:08:52.803959 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33dd89-6420-483f-933f-3c6c91f5a5be None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:08:52.900497 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 610/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:08:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 04:08:52.906622 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a36226-7c6b-4bdf-ab0f-fe20a6535ab9 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:08:52.925192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:08:53.003807 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a36226-7c6b-4bdf-ab0f-fe20a6535ab9 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:08:53.038447 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14b9a7-f55b-45f8-836e-a8a35a6a45b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:08:53.042148 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14b9a7-f55b-45f8-836e-a8a35a6a45b6 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:53.042148 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14b9a7-f55b-45f8-836e-a8a35a6a45b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:53.042148 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14b9a7-f55b-45f8-836e-a8a35a6a45b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:53.049925 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14b9a7-f55b-45f8-836e-a8a35a6a45b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:08:53.051392 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14b9a7-f55b-45f8-836e-a8a35a6a45b6 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:08:53.072876 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-7b14b9a7-f55b-45f8-836e-a8a35a6a45b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:08:53.072876 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:08:53.072876 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:08:53.072876 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:08:53.072876 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:08:53.072876 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:08:53.072876 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:08:53.072876 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:08:53.072876 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:08:53.072876 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:08:53.072876 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:08:53.072876 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:08:53.072876 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:08:53.072876 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:08:53.072876 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:08:53.072876 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:08:53.074066 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:08:53.074066 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:08:53.074066 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:08:53.074066 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:08:53.074066 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:08:53.074066 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:08:53.074066 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:08:53.074066 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:08:53.074066 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:08:53.074066 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:08:53.074066 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:08:53.074066 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:08:53.074066 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:08:53.074066 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:08:53.074066 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:08:53.074066 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:08:53.074066 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:08:53.075138 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:08:53.075138 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:08:53.075138 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:08:53.075138 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 605/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:08:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:08:53.075376 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33dd89-6420-483f-933f-3c6c91f5a5be None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:08:53.132339 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:08:53.168742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33dd89-6420-483f-933f-3c6c91f5a5be None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:08:53.202881 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b272a-6c3f-4d02-ab72-24692e788099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:08:53.203492 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b272a-6c3f-4d02-ab72-24692e788099 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:53.203773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b272a-6c3f-4d02-ab72-24692e788099 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:53.204045 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b272a-6c3f-4d02-ab72-24692e788099 None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:53.204721 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b272a-6c3f-4d02-ab72-24692e788099 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:08:53.205028 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b272a-6c3f-4d02-ab72-24692e788099 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:08:53.206451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b272a-6c3f-4d02-ab72-24692e788099 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:08:53.217333 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 611/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:08:53.222995 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14b9a7-f55b-45f8-836e-a8a35a6a45b6 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:08:53.293701 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:08:53.324402 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14b9a7-f55b-45f8-836e-a8a35a6a45b6 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:08:53.355820 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317ab50-ef08-4fbf-9193-e82c52b6c6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:08:53.356439 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317ab50-ef08-4fbf-9193-e82c52b6c6f4 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:53.356718 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317ab50-ef08-4fbf-9193-e82c52b6c6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:53.356987 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317ab50-ef08-4fbf-9193-e82c52b6c6f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:53.363519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317ab50-ef08-4fbf-9193-e82c52b6c6f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:08:53.365469 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317ab50-ef08-4fbf-9193-e82c52b6c6f4 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:08:53.376293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-7317ab50-ef08-4fbf-9193-e82c52b6c6f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:08:53.376293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:08:53.376293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:08:53.376293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:08:53.376293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:08:53.376293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:08:53.376293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:08:53.376293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:08:53.376293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:08:53.376293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:08:53.376293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:08:53.376293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:08:53.376293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:08:53.376293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:08:53.376293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:08:53.377428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:08:53.377428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:08:53.377428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:08:53.377428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:08:53.377428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:08:53.377428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:08:53.377428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:08:53.377428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:08:53.377428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:08:53.377428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:08:53.377428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:08:53.377428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:08:53.377428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:08:53.377428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:08:53.377428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:08:53.377428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:08:53.377428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:08:53.378582 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:08:53.378582 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:08:53.378582 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:08:53.378582 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:08:53.378582 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:08:53.378582 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:08:53.378582 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:08:53.378582 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:08:53.378582 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 606/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:08:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:08:53.383971 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b272a-6c3f-4d02-ab72-24692e788099 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:08:53.483500 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b272a-6c3f-4d02-ab72-24692e788099 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:08:53.505557 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:08:53.516791 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf1871-1f6d-4695-8287-2e023ca4ed96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:08:53.517444 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf1871-1f6d-4695-8287-2e023ca4ed96 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:53.517726 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf1871-1f6d-4695-8287-2e023ca4ed96 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:53.518002 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf1871-1f6d-4695-8287-2e023ca4ed96 None admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:53.518716 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf1871-1f6d-4695-8287-2e023ca4ed96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:08:53.519012 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf1871-1f6d-4695-8287-2e023ca4ed96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:08:53.520488 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf1871-1f6d-4695-8287-2e023ca4ed96 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:08:53.532259 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 612/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:08:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:08:53.538875 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317ab50-ef08-4fbf-9193-e82c52b6c6f4 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:08:53.637578 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317ab50-ef08-4fbf-9193-e82c52b6c6f4 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:08:53.665452 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:08:53.671314 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7b8e4-ab95-4141-aee9-ec215a0c8a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:08:53.671915 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7b8e4-ab95-4141-aee9-ec215a0c8a7f None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:53.672200 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7b8e4-ab95-4141-aee9-ec215a0c8a7f None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:53.672477 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7b8e4-ab95-4141-aee9-ec215a0c8a7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:53.673237 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f7b8e4-ab95-4141-aee9-ec215a0c8a7f None admin] RBAC: Adding query filter params (role.id=e7c20cdfa0b64f71a716edf832519cbb, scope.project.id=a7ada12a1e3a42949c00f483efd522ba, user.id=34794124b7234aeb98a15f0c2ae06a0c) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:08:53.673571 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f7b8e4-ab95-4141-aee9-ec215a0c8a7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:08:53.675012 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f7b8e4-ab95-4141-aee9-ec215a0c8a7f None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:08:53.680865 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 607/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:08:53 2022] GET /identity/v3/role_assignments?user.id=34794124b7234aeb98a15f0c2ae06a0c&scope.project.id=a7ada12a1e3a42949c00f483efd522ba&role.id=e7c20cdfa0b64f71a716edf832519cbb => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:08:55.527894 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200ebdc-4a95-4832-850f-0a84dd9387fb None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:55.528420 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200ebdc-4a95-4832-850f-0a84dd9387fb None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:55.528534 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200ebdc-4a95-4832-850f-0a84dd9387fb None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:55.529841 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 613/1220] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:08:55.535054 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08497930-e7cd-43c2-b06e-e31684c0db44 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:55.536027 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08497930-e7cd-43c2-b06e-e31684c0db44 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:55.536203 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08497930-e7cd-43c2-b06e-e31684c0db44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:55.554649 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-08497930-e7cd-43c2-b06e-e31684c0db44 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:08:55.555871 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-08497930-e7cd-43c2-b06e-e31684c0db44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:08:55.620518 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 608/1221] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:08:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 04:08:55.887893 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200ebdc-4a95-4832-850f-0a84dd9387fb None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:08:56.009356 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200ebdc-4a95-4832-850f-0a84dd9387fb None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:08:56.025317 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d887e5-b2d9-48da-839d-63892da0d551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:08:56.025956 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d887e5-b2d9-48da-839d-63892da0d551 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:56.026242 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d887e5-b2d9-48da-839d-63892da0d551 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:56.026621 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d887e5-b2d9-48da-839d-63892da0d551 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:56.036679 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d887e5-b2d9-48da-839d-63892da0d551 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:08:56.041358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-38d887e5-b2d9-48da-839d-63892da0d551 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:08:56.041358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:08:56.041358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:08:56.041358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:08:56.041358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:08:56.041358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:08:56.041358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:08:56.041358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:08:56.041358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:08:56.041358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:08:56.041358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:08:56.041358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:08:56.041358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:08:56.041358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:08:56.041358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:08:56.041358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:08:56.050062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:08:56.050062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:08:56.050062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:08:56.050062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:08:56.050062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:08:56.050062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:08:56.050062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:08:56.050062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:08:56.050062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:08:56.050062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:08:56.050062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:08:56.050062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:08:56.050062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:08:56.050062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:08:56.050062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:08:56.050062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:08:56.051134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:08:56.051134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:08:56.051134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:08:56.051134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:08:56.051134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:08:56.051134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:08:56.051134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:08:56.051134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:08:56.051134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:08:56.051134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:08:56.051134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:08:56.051134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:08:56.051134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 614/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 23 04:08:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:08:56.052111 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08497930-e7cd-43c2-b06e-e31684c0db44 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:08:56.151168 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08497930-e7cd-43c2-b06e-e31684c0db44 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:08:56.174346 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:08:56.184898 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11b4c4-9a33-43ef-abfe-b956b6127963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:08:56.185527 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11b4c4-9a33-43ef-abfe-b956b6127963 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:56.185808 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11b4c4-9a33-43ef-abfe-b956b6127963 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:56.186078 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11b4c4-9a33-43ef-abfe-b956b6127963 None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:56.186738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11b4c4-9a33-43ef-abfe-b956b6127963 None admin] RBAC: Adding query filter params (name=service) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:08:56.187037 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11b4c4-9a33-43ef-abfe-b956b6127963 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:08:56.188398 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11b4c4-9a33-43ef-abfe-b956b6127963 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:08:56.196570 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 609/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 23 04:08:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:08:56.202327 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d887e5-b2d9-48da-839d-63892da0d551 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:08:56.245246 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:08:56.299548 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d887e5-b2d9-48da-839d-63892da0d551 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:08:56.333931 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fe0ed-a1e2-4030-9ea8-2c6999aae1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:08:56.334557 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fe0ed-a1e2-4030-9ea8-2c6999aae1bc None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:56.334874 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fe0ed-a1e2-4030-9ea8-2c6999aae1bc None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:56.335145 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fe0ed-a1e2-4030-9ea8-2c6999aae1bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:56.344781 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fe0ed-a1e2-4030-9ea8-2c6999aae1bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:08:56.346240 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fe0ed-a1e2-4030-9ea8-2c6999aae1bc None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:08:56.360258 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-495fe0ed-a1e2-4030-9ea8-2c6999aae1bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:08:56.360258 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:08:56.360258 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:08:56.360258 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:08:56.360258 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:08:56.360258 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:08:56.360258 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:08:56.360258 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:08:56.360258 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:08:56.360258 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:08:56.360258 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:08:56.360258 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:08:56.360258 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:08:56.360258 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:08:56.360258 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:08:56.360258 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:08:56.361478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:08:56.361478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:08:56.361478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:08:56.361478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:08:56.361478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:08:56.361478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:08:56.361478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:08:56.361478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:08:56.361478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:08:56.361478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:08:56.361478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:08:56.361478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:08:56.361478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:08:56.361478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:08:56.361478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:08:56.361478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:08:56.361478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:08:56.362626 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:08:56.362626 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:08:56.362626 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:08:56.362626 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 615/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:08:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:08:56.368005 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11b4c4-9a33-43ef-abfe-b956b6127963 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:08:56.468963 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11b4c4-9a33-43ef-abfe-b956b6127963 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:08:56.502824 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0221a737-6490-4e21-bc99-174193700231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:08:56.506168 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221a737-6490-4e21-bc99-174193700231 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:56.506168 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221a737-6490-4e21-bc99-174193700231 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:56.506168 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221a737-6490-4e21-bc99-174193700231 None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:56.506168 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0221a737-6490-4e21-bc99-174193700231 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:08:56.506168 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0221a737-6490-4e21-bc99-174193700231 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:08:56.506687 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0221a737-6490-4e21-bc99-174193700231 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:08:56.518015 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 610/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:08:56.523996 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fe0ed-a1e2-4030-9ea8-2c6999aae1bc None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:08:56.617592 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:08:56.624406 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fe0ed-a1e2-4030-9ea8-2c6999aae1bc None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:08:56.656541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5689ad-8a6d-4f68-930f-cf26ad951567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:08:56.657189 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5689ad-8a6d-4f68-930f-cf26ad951567 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:56.657468 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5689ad-8a6d-4f68-930f-cf26ad951567 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:56.657736 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5689ad-8a6d-4f68-930f-cf26ad951567 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:56.665671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5689ad-8a6d-4f68-930f-cf26ad951567 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:08:56.667110 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5689ad-8a6d-4f68-930f-cf26ad951567 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:08:56.678726 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-eb5689ad-8a6d-4f68-930f-cf26ad951567 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 04:08:56.678726 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:08:56.678726 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:08:56.678726 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:08:56.678726 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:08:56.678726 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:08:56.678726 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:08:56.678726 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:08:56.678726 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:08:56.678726 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:08:56.678726 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:08:56.678726 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:08:56.678726 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:08:56.678726 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:08:56.678726 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:08:56.678726 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:08:56.679984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:08:56.679984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:08:56.679984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:08:56.679984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:08:56.679984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:08:56.679984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:08:56.679984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:08:56.679984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:08:56.679984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:08:56.679984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:08:56.679984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:08:56.679984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:08:56.679984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:08:56.679984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:08:56.679984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:08:56.679984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:08:56.679984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:08:56.679984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:08:56.681044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:08:56.681044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:08:56.681044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:08:56.681044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:08:56.681044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:08:56.681044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:08:56.681044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:08:56.681044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:08:56.681044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 04:08:56.681044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:08:56.681044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 616/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:08:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:08:56.685881 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0221a737-6490-4e21-bc99-174193700231 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:08:56.732511 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:08:56.785036 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0221a737-6490-4e21-bc99-174193700231 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:08:56.818942 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5fa47-3030-4f63-bacb-a6dacbb5901d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:08:56.819544 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5fa47-3030-4f63-bacb-a6dacbb5901d None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:56.819823 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5fa47-3030-4f63-bacb-a6dacbb5901d None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:56.820095 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5fa47-3030-4f63-bacb-a6dacbb5901d None admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:56.820813 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef5fa47-3030-4f63-bacb-a6dacbb5901d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:08:56.821143 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef5fa47-3030-4f63-bacb-a6dacbb5901d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:08:56.822601 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef5fa47-3030-4f63-bacb-a6dacbb5901d None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:08:56.839621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 611/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Aug 23 04:08:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:08:56.845799 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5689ad-8a6d-4f68-930f-cf26ad951567 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:08:56.943902 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5689ad-8a6d-4f68-930f-cf26ad951567 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:08:56.979121 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1cc0c-6f49-43f3-ad99-76efb32d9391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:08:56.979751 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1cc0c-6f49-43f3-ad99-76efb32d9391 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:56.980029 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1cc0c-6f49-43f3-ad99-76efb32d9391 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:56.980300 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1cc0c-6f49-43f3-ad99-76efb32d9391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:56.991945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e1cc0c-6f49-43f3-ad99-76efb32d9391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:08:56.992311 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e1cc0c-6f49-43f3-ad99-76efb32d9391 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:08:57.005912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-38e1cc0c-6f49-43f3-ad99-76efb32d9391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:08:57.005912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:08:57.005912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:08:57.005912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:08:57.005912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:08:57.005912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:08:57.005912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:08:57.005912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:08:57.005912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:08:57.005912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:08:57.005912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:08:57.005912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:08:57.005912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:08:57.005912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:08:57.005912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:08:57.005912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:08:57.007018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:08:57.007018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:08:57.007018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:08:57.007018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:08:57.007018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:08:57.007018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:08:57.007018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:08:57.007018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:08:57.007018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:08:57.007018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:08:57.007018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:08:57.007018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:08:57.007018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:08:57.007018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:08:57.007018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:08:57.007018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:08:57.007018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:08:57.008320 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:08:57.008320 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:08:57.008320 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:08:57.008320 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 617/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:08:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:08:57.013005 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5fa47-3030-4f63-bacb-a6dacbb5901d None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:08:57.111628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5fa47-3030-4f63-bacb-a6dacbb5901d None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:08:57.113988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:08:57.144092 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06f0f9-35b5-42c0-8557-0b981f24e21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:08:57.144694 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06f0f9-35b5-42c0-8557-0b981f24e21c None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:57.145526 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06f0f9-35b5-42c0-8557-0b981f24e21c None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:57.145802 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06f0f9-35b5-42c0-8557-0b981f24e21c None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:57.146436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06f0f9-35b5-42c0-8557-0b981f24e21c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:08:57.146741 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06f0f9-35b5-42c0-8557-0b981f24e21c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:08:57.148139 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06f0f9-35b5-42c0-8557-0b981f24e21c None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:08:57.159337 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 612/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:08:57.165421 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1cc0c-6f49-43f3-ad99-76efb32d9391 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:08:57.174835 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:08:57.263495 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1cc0c-6f49-43f3-ad99-76efb32d9391 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:08:57.296587 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74941464-b81d-405d-adc6-cef2145abbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:08:57.297239 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74941464-b81d-405d-adc6-cef2145abbb7 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:57.297522 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74941464-b81d-405d-adc6-cef2145abbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:57.297795 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74941464-b81d-405d-adc6-cef2145abbb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:57.304322 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74941464-b81d-405d-adc6-cef2145abbb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:08:57.305800 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74941464-b81d-405d-adc6-cef2145abbb7 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:08:57.317230 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-74941464-b81d-405d-adc6-cef2145abbb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:08:57.317230 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:08:57.317230 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:08:57.317230 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:08:57.317230 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:08:57.317230 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:08:57.317230 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:08:57.317230 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:08:57.317230 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:08:57.317230 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:08:57.317230 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:08:57.317230 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:08:57.317230 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:08:57.317230 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:08:57.317230 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:08:57.318299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:08:57.318299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:08:57.318299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:08:57.318299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:08:57.318299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:08:57.318299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:08:57.318299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:08:57.318299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:08:57.318299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:08:57.318299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:08:57.318299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:08:57.318299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:08:57.318299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:08:57.318299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:08:57.318299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:08:57.318299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:08:57.318299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:08:57.319305 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:08:57.319305 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:08:57.319305 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:08:57.319305 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:08:57.319305 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:08:57.319305 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:08:57.319305 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:08:57.319305 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:08:57.319305 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 618/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:08:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:08:57.326219 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06f0f9-35b5-42c0-8557-0b981f24e21c None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:08:57.424201 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06f0f9-35b5-42c0-8557-0b981f24e21c None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:08:57.458351 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c17501-1cbe-4ae8-bc70-bf4b168dbbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:08:57.458959 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c17501-1cbe-4ae8-bc70-bf4b168dbbb4 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:57.459235 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c17501-1cbe-4ae8-bc70-bf4b168dbbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:57.459505 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c17501-1cbe-4ae8-bc70-bf4b168dbbb4 None admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:57.460190 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c17501-1cbe-4ae8-bc70-bf4b168dbbb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:08:57.460495 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c17501-1cbe-4ae8-bc70-bf4b168dbbb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:08:57.461961 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c17501-1cbe-4ae8-bc70-bf4b168dbbb4 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:08:57.473629 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 613/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:08:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:08:57.479784 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74941464-b81d-405d-adc6-cef2145abbb7 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:08:57.545318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:08:57.580152 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74941464-b81d-405d-adc6-cef2145abbb7 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:08:57.614095 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652890e2-e7fc-4653-aff3-49034eda2250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:08:57.614834 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652890e2-e7fc-4653-aff3-49034eda2250 None admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:57.615064 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652890e2-e7fc-4653-aff3-49034eda2250 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:57.615358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652890e2-e7fc-4653-aff3-49034eda2250 None admin] PATH_INFO: `/v3/projects/a7ada12a1e3a42949c00f483efd522ba/users/34794124b7234aeb98a15f0c2ae06a0c/roles/e7c20cdfa0b64f71a716edf832519cbb` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:57.630099 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652890e2-e7fc-4653-aff3-49034eda2250 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7ada12a1e3a42949c00f483efd522ba, user_id=34794124b7234aeb98a15f0c2ae06a0c, role_id=e7c20cdfa0b64f71a716edf832519cbb)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:08:57.631540 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652890e2-e7fc-4653-aff3-49034eda2250 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:08:57.742593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 619/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 23 04:08:57 2022] PUT /identity/v3/projects/a7ada12a1e3a42949c00f483efd522ba/users/34794124b7234aeb98a15f0c2ae06a0c/roles/e7c20cdfa0b64f71a716edf832519cbb => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:08:59.631223 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22952c23-cd61-4191-a0e0-9b113c52f10b None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:59.631794 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22952c23-cd61-4191-a0e0-9b113c52f10b None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:59.631794 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22952c23-cd61-4191-a0e0-9b113c52f10b None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:59.633170 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 614/1233] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:08:59.638318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abce21-74de-487e-b669-f5a42556f649 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:08:59.638705 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abce21-74de-487e-b669-f5a42556f649 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:08:59.638866 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abce21-74de-487e-b669-f5a42556f649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:08:59.656565 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-04abce21-74de-487e-b669-f5a42556f649 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:08:59.657781 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-04abce21-74de-487e-b669-f5a42556f649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:08:59.723013 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 620/1234] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:08:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:08:59.997899 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22952c23-cd61-4191-a0e0-9b113c52f10b None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:00.023646 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:00.098053 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22952c23-cd61-4191-a0e0-9b113c52f10b None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:00.133439 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af675f-5737-41ed-b9f2-4d83499b900d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:00.134069 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af675f-5737-41ed-b9f2-4d83499b900d None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:00.134352 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af675f-5737-41ed-b9f2-4d83499b900d None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:00.134627 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af675f-5737-41ed-b9f2-4d83499b900d None admin] PATH_INFO: `/v3/roles/service` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:00.144957 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af675f-5737-41ed-b9f2-4d83499b900d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:09:00.150162 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-22af675f-5737-41ed-b9f2-4d83499b900d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:09:00.150162 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:09:00.150162 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:09:00.150162 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:09:00.150162 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:09:00.150162 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:09:00.150162 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:09:00.150162 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:09:00.150162 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:09:00.150162 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:09:00.150162 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:09:00.150162 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:09:00.150162 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:09:00.150162 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:09:00.150162 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:09:00.150162 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:09:00.151291 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:09:00.151291 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:09:00.151291 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:09:00.151291 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:09:00.151291 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:09:00.151291 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:09:00.151291 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:09:00.151291 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:09:00.151291 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:09:00.151291 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:09:00.151291 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:09:00.151291 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:09:00.151291 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:09:00.151291 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:09:00.151291 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:09:00.151291 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:09:00.152571 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:09:00.152571 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:09:00.152571 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:09:00.152571 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:09:00.152571 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:09:00.152571 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:09:00.152571 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:09:00.152571 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:09:00.152571 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:09:00.152571 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:09:00.152571 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 04:09:00.152571 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:09:00.152571 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 615/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 23 04:08:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:09:00.157383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abce21-74de-487e-b669-f5a42556f649 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:00.202962 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:00.255986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abce21-74de-487e-b669-f5a42556f649 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:00.289128 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b01f18-a6aa-46e3-8ded-2e3527e6c125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:00.289741 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b01f18-a6aa-46e3-8ded-2e3527e6c125 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:00.290026 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b01f18-a6aa-46e3-8ded-2e3527e6c125 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:00.290303 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b01f18-a6aa-46e3-8ded-2e3527e6c125 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:00.290998 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b01f18-a6aa-46e3-8ded-2e3527e6c125 None admin] RBAC: Adding query filter params (name=service) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:09:00.291313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b01f18-a6aa-46e3-8ded-2e3527e6c125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:00.292714 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b01f18-a6aa-46e3-8ded-2e3527e6c125 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:00.301620 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 621/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 23 04:09:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:09:00.307300 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af675f-5737-41ed-b9f2-4d83499b900d None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:00.392681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:00.408414 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af675f-5737-41ed-b9f2-4d83499b900d None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:00.444627 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46d4ae-cf49-4748-9830-dfa82cc3e3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:00.445282 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46d4ae-cf49-4748-9830-dfa82cc3e3e4 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:00.445568 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46d4ae-cf49-4748-9830-dfa82cc3e3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:00.445844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46d4ae-cf49-4748-9830-dfa82cc3e3e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:00.456030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46d4ae-cf49-4748-9830-dfa82cc3e3e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:00.459885 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46d4ae-cf49-4748-9830-dfa82cc3e3e4 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:00.471772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-7d46d4ae-cf49-4748-9830-dfa82cc3e3e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:09:00.471772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:09:00.471772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:09:00.471772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:09:00.471772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:09:00.471772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:09:00.471772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:09:00.471772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:09:00.471772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:09:00.471772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:09:00.471772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:09:00.471772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:09:00.471772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:09:00.471772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:09:00.471772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:09:00.471772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:09:00.472935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:09:00.472935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:09:00.472935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:09:00.472935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:09:00.472935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:09:00.472935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:09:00.472935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:09:00.472935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:09:00.472935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:09:00.472935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:09:00.472935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:09:00.472935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:09:00.472935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:09:00.472935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:09:00.472935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:09:00.472935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:09:00.472935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:09:00.474064 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:09:00.474064 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:09:00.474064 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:09:00.474064 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 616/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:09:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:09:00.478926 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b01f18-a6aa-46e3-8ded-2e3527e6c125 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:00.578236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b01f18-a6aa-46e3-8ded-2e3527e6c125 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:00.587324 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:00.611507 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49e1f1-b1af-4257-a2ae-836f6392ba10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:00.612121 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49e1f1-b1af-4257-a2ae-836f6392ba10 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:00.612405 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49e1f1-b1af-4257-a2ae-836f6392ba10 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:00.612682 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49e1f1-b1af-4257-a2ae-836f6392ba10 None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:00.613352 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49e1f1-b1af-4257-a2ae-836f6392ba10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:09:00.613664 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49e1f1-b1af-4257-a2ae-836f6392ba10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:00.615563 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49e1f1-b1af-4257-a2ae-836f6392ba10 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:00.627394 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 622/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:09:00.633583 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46d4ae-cf49-4748-9830-dfa82cc3e3e4 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:00.732202 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46d4ae-cf49-4748-9830-dfa82cc3e3e4 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:00.767110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fe8c2-b8d8-4ef9-bad4-065ed74f142d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:00.767792 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fe8c2-b8d8-4ef9-bad4-065ed74f142d None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:00.768104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fe8c2-b8d8-4ef9-bad4-065ed74f142d None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:00.768404 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fe8c2-b8d8-4ef9-bad4-065ed74f142d None admin] PATH_INFO: `/v3/users/placement` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:00.771219 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:00.776269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5fe8c2-b8d8-4ef9-bad4-065ed74f142d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:00.777759 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5fe8c2-b8d8-4ef9-bad4-065ed74f142d None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:00.788800 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-4e5fe8c2-b8d8-4ef9-bad4-065ed74f142d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 04:09:00.788800 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:09:00.788800 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:09:00.788800 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:09:00.788800 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:09:00.788800 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:09:00.788800 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:09:00.788800 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:09:00.788800 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:09:00.788800 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:09:00.788800 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:09:00.788800 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:09:00.788800 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:09:00.788800 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:09:00.788800 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:09:00.788800 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:09:00.789946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:09:00.789946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:09:00.789946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:09:00.789946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:09:00.789946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:09:00.789946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:09:00.789946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:09:00.789946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:09:00.789946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:09:00.789946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:09:00.789946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:09:00.789946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:09:00.789946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:09:00.789946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:09:00.789946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:09:00.789946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:09:00.789946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:09:00.789946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:09:00.791332 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:09:00.791332 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:09:00.791332 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:09:00.791332 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:09:00.791332 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:09:00.791332 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:09:00.791332 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:09:00.791332 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:09:00.791332 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 04:09:00.791332 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:09:00.791332 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 617/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:09:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:09:00.796084 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49e1f1-b1af-4257-a2ae-836f6392ba10 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:00.895256 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49e1f1-b1af-4257-a2ae-836f6392ba10 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:00.929391 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ecc7e-09a5-4af9-860e-093b186e5550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:00.930004 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ecc7e-09a5-4af9-860e-093b186e5550 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:00.930288 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ecc7e-09a5-4af9-860e-093b186e5550 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:00.930558 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ecc7e-09a5-4af9-860e-093b186e5550 None admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:00.931323 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ecc7e-09a5-4af9-860e-093b186e5550 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:09:00.931603 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ecc7e-09a5-4af9-860e-093b186e5550 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:00.933039 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ecc7e-09a5-4af9-860e-093b186e5550 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:00.950812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 623/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Aug 23 04:09:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:09:00.956637 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fe8c2-b8d8-4ef9-bad4-065ed74f142d None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:01.060948 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fe8c2-b8d8-4ef9-bad4-065ed74f142d None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:01.094666 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6495314-4164-481f-ae99-6d35b80969a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:01.095276 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6495314-4164-481f-ae99-6d35b80969a8 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:01.095563 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6495314-4164-481f-ae99-6d35b80969a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:01.095840 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6495314-4164-481f-ae99-6d35b80969a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:01.157632 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:01.164567 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6495314-4164-481f-ae99-6d35b80969a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:01.166101 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6495314-4164-481f-ae99-6d35b80969a8 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:01.262522 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 618/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:09:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 04:09:01.268371 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ecc7e-09a5-4af9-860e-093b186e5550 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:01.296391 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:01.368306 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ecc7e-09a5-4af9-860e-093b186e5550 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:01.401352 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d49d7-660c-4582-9e25-a9ddb4ca98e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:01.401992 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d49d7-660c-4582-9e25-a9ddb4ca98e4 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:01.402275 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d49d7-660c-4582-9e25-a9ddb4ca98e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:01.402553 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d49d7-660c-4582-9e25-a9ddb4ca98e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:01.412843 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d49d7-660c-4582-9e25-a9ddb4ca98e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:01.414278 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d49d7-660c-4582-9e25-a9ddb4ca98e4 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:01.428645 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-ce0d49d7-660c-4582-9e25-a9ddb4ca98e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:09:01.428645 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:09:01.428645 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:09:01.428645 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:09:01.428645 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:09:01.428645 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:09:01.428645 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:09:01.428645 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:09:01.428645 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:09:01.428645 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:09:01.428645 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:09:01.428645 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:09:01.428645 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:09:01.428645 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:09:01.428645 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:09:01.428645 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:09:01.429812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:09:01.429812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:09:01.429812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:09:01.429812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:09:01.429812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:09:01.429812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:09:01.429812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:09:01.429812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:09:01.429812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:09:01.429812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:09:01.429812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:09:01.429812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:09:01.429812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:09:01.429812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:09:01.429812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:09:01.429812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:09:01.429812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:09:01.435426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:09:01.435426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:09:01.435426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:09:01.435426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 624/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:09:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:09:01.435729 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6495314-4164-481f-ae99-6d35b80969a8 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:01.528342 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:01.533910 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6495314-4164-481f-ae99-6d35b80969a8 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:01.567706 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952f80d-4f01-41f2-9037-2f1c7ffbf7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:01.568340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952f80d-4f01-41f2-9037-2f1c7ffbf7da None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:01.568680 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952f80d-4f01-41f2-9037-2f1c7ffbf7da None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:01.568953 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952f80d-4f01-41f2-9037-2f1c7ffbf7da None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:01.569624 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952f80d-4f01-41f2-9037-2f1c7ffbf7da None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:09:01.569928 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952f80d-4f01-41f2-9037-2f1c7ffbf7da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:01.571339 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952f80d-4f01-41f2-9037-2f1c7ffbf7da None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:01.582167 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 619/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:09:01.588381 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d49d7-660c-4582-9e25-a9ddb4ca98e4 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:01.666955 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:01.688236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d49d7-660c-4582-9e25-a9ddb4ca98e4 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:01.722614 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba478c5-43df-459a-8861-ef0d862c635e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:01.723245 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba478c5-43df-459a-8861-ef0d862c635e None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:01.723523 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba478c5-43df-459a-8861-ef0d862c635e None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:01.723791 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba478c5-43df-459a-8861-ef0d862c635e None admin] PATH_INFO: `/v3/projects/service` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:01.730371 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba478c5-43df-459a-8861-ef0d862c635e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:01.731884 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba478c5-43df-459a-8861-ef0d862c635e None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:01.742729 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-7ba478c5-43df-459a-8861-ef0d862c635e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:09:01.742729 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:09:01.742729 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:09:01.742729 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:09:01.742729 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:09:01.742729 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:09:01.742729 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:09:01.742729 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:09:01.742729 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:09:01.742729 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:09:01.742729 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:09:01.742729 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:09:01.742729 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:09:01.742729 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:09:01.742729 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:09:01.744233 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:09:01.744233 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:09:01.744233 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:09:01.744233 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:09:01.744233 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:09:01.744233 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:09:01.744233 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:09:01.744233 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:09:01.744233 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:09:01.744233 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:09:01.744233 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:09:01.744233 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:09:01.744233 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:09:01.744233 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:09:01.744233 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:09:01.744233 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:09:01.744233 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:09:01.745544 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:09:01.745544 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:09:01.745544 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:09:01.745544 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:09:01.745544 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:09:01.745544 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:09:01.745544 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:09:01.745544 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:09:01.745544 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 625/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:09:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:09:01.749793 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952f80d-4f01-41f2-9037-2f1c7ffbf7da None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:01.848536 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952f80d-4f01-41f2-9037-2f1c7ffbf7da None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:01.881668 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d66576-81ad-4721-8a1f-ac8fe3865f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:01.882284 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d66576-81ad-4721-8a1f-ac8fe3865f6b None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:01.882567 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d66576-81ad-4721-8a1f-ac8fe3865f6b None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:01.882842 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d66576-81ad-4721-8a1f-ac8fe3865f6b None admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:01.883532 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d66576-81ad-4721-8a1f-ac8fe3865f6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:09:01.883842 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d66576-81ad-4721-8a1f-ac8fe3865f6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:01.885387 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d66576-81ad-4721-8a1f-ac8fe3865f6b None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:01.897870 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 620/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:09:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:09:01.904127 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba478c5-43df-459a-8861-ef0d862c635e None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:02.004375 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba478c5-43df-459a-8861-ef0d862c635e None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:02.038405 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658224d-d20e-4575-b900-05bbcb74e615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:02.039014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658224d-d20e-4575-b900-05bbcb74e615 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:02.039300 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658224d-d20e-4575-b900-05bbcb74e615 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:02.039632 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658224d-d20e-4575-b900-05bbcb74e615 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:02.040434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658224d-d20e-4575-b900-05bbcb74e615 None admin] RBAC: Adding query filter params (role.id=e7c20cdfa0b64f71a716edf832519cbb, scope.project.id=a7ada12a1e3a42949c00f483efd522ba, user.id=34794124b7234aeb98a15f0c2ae06a0c) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:09:02.040747 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658224d-d20e-4575-b900-05bbcb74e615 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:02.042198 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658224d-d20e-4575-b900-05bbcb74e615 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:02.048148 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 626/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:09:01 2022] GET /identity/v3/role_assignments?user.id=34794124b7234aeb98a15f0c2ae06a0c&scope.project.id=a7ada12a1e3a42949c00f483efd522ba&role.id=e7c20cdfa0b64f71a716edf832519cbb => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:09:03.951744 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b058073-84f7-42de-9b5c-c409813729b8 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:03.952287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b058073-84f7-42de-9b5c-c409813729b8 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:03.952384 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b058073-84f7-42de-9b5c-c409813729b8 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:03.953734 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 621/1247] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:09:03.959348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635841d-1f9b-4620-b9ca-6885ef20b8f3 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:03.959348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635841d-1f9b-4620-b9ca-6885ef20b8f3 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:03.959829 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635841d-1f9b-4620-b9ca-6885ef20b8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:03.966526 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:03.978620 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-5635841d-1f9b-4620-b9ca-6885ef20b8f3 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:09:03.979816 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-5635841d-1f9b-4620-b9ca-6885ef20b8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:09:04.045117 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 627/1248] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:09:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:09:04.309804 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b058073-84f7-42de-9b5c-c409813729b8 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:04.328295 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:04.408456 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b058073-84f7-42de-9b5c-c409813729b8 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:04.443159 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99d1fb-5e5e-4bcb-84b6-65d9114d9a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:04.443790 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99d1fb-5e5e-4bcb-84b6-65d9114d9a98 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:04.444069 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99d1fb-5e5e-4bcb-84b6-65d9114d9a98 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:04.444926 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99d1fb-5e5e-4bcb-84b6-65d9114d9a98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:04.455414 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99d1fb-5e5e-4bcb-84b6-65d9114d9a98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:09:04.461187 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-7f99d1fb-5e5e-4bcb-84b6-65d9114d9a98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:09:04.461187 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:09:04.461187 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:09:04.461187 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:09:04.461187 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:09:04.461187 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:09:04.461187 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:09:04.461187 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:09:04.461187 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:09:04.461187 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:09:04.461187 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:09:04.461187 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:09:04.461187 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:09:04.461187 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:09:04.461187 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:09:04.461187 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:09:04.462422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:09:04.462422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:09:04.462422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:09:04.462422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:09:04.462422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:09:04.462422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:09:04.462422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:09:04.462422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:09:04.462422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:09:04.462422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:09:04.462422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:09:04.462422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:09:04.462422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:09:04.462422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:09:04.462422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:09:04.462422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:09:04.463627 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:09:04.463627 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:09:04.463627 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:09:04.463627 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:09:04.463627 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:09:04.463627 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:09:04.463627 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:09:04.463627 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:09:04.463627 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:09:04.463627 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:09:04.463627 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:09:04.463627 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:09:04.463627 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 622/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:09:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:09:04.470597 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635841d-1f9b-4620-b9ca-6885ef20b8f3 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:04.570172 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635841d-1f9b-4620-b9ca-6885ef20b8f3 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:04.599058 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:04.603742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37256f37-84dc-4b60-8890-54d7f38ab981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:04.604353 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37256f37-84dc-4b60-8890-54d7f38ab981 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:04.604637 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37256f37-84dc-4b60-8890-54d7f38ab981 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:04.604911 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37256f37-84dc-4b60-8890-54d7f38ab981 None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:04.605691 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37256f37-84dc-4b60-8890-54d7f38ab981 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:09:04.606006 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37256f37-84dc-4b60-8890-54d7f38ab981 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:04.607437 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37256f37-84dc-4b60-8890-54d7f38ab981 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:04.616143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 628/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:09:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:09:04.622433 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99d1fb-5e5e-4bcb-84b6-65d9114d9a98 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:04.703346 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:04.725461 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99d1fb-5e5e-4bcb-84b6-65d9114d9a98 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:04.759270 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2417ca-84c2-4729-9fa8-016726ca3bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:04.759902 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2417ca-84c2-4729-9fa8-016726ca3bc9 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:04.760210 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2417ca-84c2-4729-9fa8-016726ca3bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:04.760491 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2417ca-84c2-4729-9fa8-016726ca3bc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:04.770921 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2417ca-84c2-4729-9fa8-016726ca3bc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:04.772452 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2417ca-84c2-4729-9fa8-016726ca3bc9 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:04.787231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-1c2417ca-84c2-4729-9fa8-016726ca3bc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:09:04.787231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:09:04.787231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:09:04.787231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:09:04.787231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:09:04.787231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:09:04.787231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:09:04.787231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:09:04.787231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:09:04.787231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:09:04.787231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:09:04.787231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:09:04.787231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:09:04.787231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:09:04.787231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:09:04.787231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:09:04.788947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:09:04.788947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:09:04.788947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:09:04.788947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:09:04.788947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:09:04.788947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:09:04.788947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:09:04.788947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:09:04.788947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:09:04.788947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:09:04.788947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:09:04.788947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:09:04.788947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:09:04.788947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:09:04.788947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:09:04.788947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:09:04.788947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:09:04.790821 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:09:04.790821 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:09:04.790821 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:09:04.790821 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 623/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:09:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 04:09:04.794991 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37256f37-84dc-4b60-8890-54d7f38ab981 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:04.895451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37256f37-84dc-4b60-8890-54d7f38ab981 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:04.929452 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae0f99-2096-44d9-a57d-600012e14dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:04.930091 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae0f99-2096-44d9-a57d-600012e14dd6 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:04.930376 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae0f99-2096-44d9-a57d-600012e14dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:04.930653 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae0f99-2096-44d9-a57d-600012e14dd6 None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:04.931303 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae0f99-2096-44d9-a57d-600012e14dd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:09:04.931611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae0f99-2096-44d9-a57d-600012e14dd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:04.932977 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae0f99-2096-44d9-a57d-600012e14dd6 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:04.944493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 629/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:09:04.950407 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2417ca-84c2-4729-9fa8-016726ca3bc9 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:05.055954 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2417ca-84c2-4729-9fa8-016726ca3bc9 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:05.081353 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:05.089315 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369eff94-b9ec-4171-bd04-3dfdbc63fa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:05.089936 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369eff94-b9ec-4171-bd04-3dfdbc63fa00 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:05.090217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369eff94-b9ec-4171-bd04-3dfdbc63fa00 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:05.090489 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369eff94-b9ec-4171-bd04-3dfdbc63fa00 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:05.097747 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369eff94-b9ec-4171-bd04-3dfdbc63fa00 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:05.104805 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369eff94-b9ec-4171-bd04-3dfdbc63fa00 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:05.110778 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-369eff94-b9ec-4171-bd04-3dfdbc63fa00 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 04:09:05.110778 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:09:05.110778 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:09:05.110778 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:09:05.110778 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:09:05.110778 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:09:05.110778 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:09:05.110778 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:09:05.110778 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:09:05.110778 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:09:05.110778 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:09:05.110778 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:09:05.110778 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:09:05.110778 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:09:05.110778 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:09:05.110778 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:09:05.111919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:09:05.111919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:09:05.111919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:09:05.111919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:09:05.111919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:09:05.111919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:09:05.111919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:09:05.111919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:09:05.111919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:09:05.111919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:09:05.111919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:09:05.111919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:09:05.111919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:09:05.111919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:09:05.111919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:09:05.111919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:09:05.111919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:09:05.111919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:09:05.113225 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:09:05.113225 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:09:05.113225 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:09:05.113225 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:09:05.113225 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:09:05.113225 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:09:05.113225 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:09:05.113225 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:09:05.113225 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 04:09:05.113225 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:09:05.113225 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 624/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:09:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:09:05.118045 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae0f99-2096-44d9-a57d-600012e14dd6 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:05.173261 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:05.216461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae0f99-2096-44d9-a57d-600012e14dd6 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:05.252019 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdbe24-163d-4251-bb9a-3b17c37baed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:05.252630 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdbe24-163d-4251-bb9a-3b17c37baed8 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:05.252911 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdbe24-163d-4251-bb9a-3b17c37baed8 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:05.253213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdbe24-163d-4251-bb9a-3b17c37baed8 None admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:05.253947 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdbe24-163d-4251-bb9a-3b17c37baed8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:09:05.254249 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdbe24-163d-4251-bb9a-3b17c37baed8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:05.255690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdbe24-163d-4251-bb9a-3b17c37baed8 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:05.272170 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 630/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Aug 23 04:09:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:09:05.278597 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369eff94-b9ec-4171-bd04-3dfdbc63fa00 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:05.378535 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369eff94-b9ec-4171-bd04-3dfdbc63fa00 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:05.410868 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90731782-6751-4ff3-8eae-16d216f70ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:05.411467 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90731782-6751-4ff3-8eae-16d216f70ff1 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:05.411747 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90731782-6751-4ff3-8eae-16d216f70ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:05.412020 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90731782-6751-4ff3-8eae-16d216f70ff1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:05.465995 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:05.477584 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90731782-6751-4ff3-8eae-16d216f70ff1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:05.479018 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90731782-6751-4ff3-8eae-16d216f70ff1 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:05.574923 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 625/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:09:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 04:09:05.580838 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdbe24-163d-4251-bb9a-3b17c37baed8 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:05.680054 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdbe24-163d-4251-bb9a-3b17c37baed8 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:05.692650 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:05.713816 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1f7f9-1ee9-4d0a-a82b-64659d005d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:05.714442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1f7f9-1ee9-4d0a-a82b-64659d005d3e None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:05.714720 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1f7f9-1ee9-4d0a-a82b-64659d005d3e None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:05.714990 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1f7f9-1ee9-4d0a-a82b-64659d005d3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:05.724741 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1f7f9-1ee9-4d0a-a82b-64659d005d3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:05.726157 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1f7f9-1ee9-4d0a-a82b-64659d005d3e None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:05.740148 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-45f1f7f9-1ee9-4d0a-a82b-64659d005d3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:09:05.740148 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:09:05.740148 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:09:05.740148 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:09:05.740148 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:09:05.740148 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:09:05.740148 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:09:05.740148 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:09:05.740148 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:09:05.740148 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:09:05.740148 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:09:05.740148 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:09:05.740148 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:09:05.740148 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:09:05.740148 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:09:05.740148 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:09:05.741382 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:09:05.741382 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:09:05.741382 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:09:05.741382 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:09:05.741382 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:09:05.741382 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:09:05.741382 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:09:05.741382 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:09:05.741382 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:09:05.741382 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:09:05.741382 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:09:05.741382 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:09:05.741382 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:09:05.741382 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:09:05.741382 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:09:05.741382 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:09:05.741382 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:09:05.742399 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:09:05.742399 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:09:05.742399 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:09:05.742399 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 631/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:09:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:09:05.747214 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90731782-6751-4ff3-8eae-16d216f70ff1 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:05.834369 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:05.845957 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90731782-6751-4ff3-8eae-16d216f70ff1 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:05.879227 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ff02a-d3c6-4a78-99df-11ef59fc5ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:05.886343 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ff02a-d3c6-4a78-99df-11ef59fc5ff2 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:05.886343 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ff02a-d3c6-4a78-99df-11ef59fc5ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:05.886343 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ff02a-d3c6-4a78-99df-11ef59fc5ff2 None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:05.886343 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ff02a-d3c6-4a78-99df-11ef59fc5ff2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:09:05.886343 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ff02a-d3c6-4a78-99df-11ef59fc5ff2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:05.886343 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ff02a-d3c6-4a78-99df-11ef59fc5ff2 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:05.895049 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 626/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:09:05.900928 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1f7f9-1ee9-4d0a-a82b-64659d005d3e None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:06.001241 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1f7f9-1ee9-4d0a-a82b-64659d005d3e None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:06.034234 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8362777-3739-419d-a9f2-74d430b736e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:06.034860 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8362777-3739-419d-a9f2-74d430b736e4 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:06.035142 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8362777-3739-419d-a9f2-74d430b736e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:06.035413 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8362777-3739-419d-a9f2-74d430b736e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:06.042013 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8362777-3739-419d-a9f2-74d430b736e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:06.043604 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8362777-3739-419d-a9f2-74d430b736e4 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:06.055366 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-c8362777-3739-419d-a9f2-74d430b736e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:09:06.055366 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:09:06.055366 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:09:06.055366 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:09:06.055366 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:09:06.055366 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:09:06.055366 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:09:06.055366 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:09:06.055366 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:09:06.055366 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:09:06.055366 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:09:06.055366 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:09:06.055366 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:09:06.055366 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:09:06.055366 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:09:06.056561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:09:06.056561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:09:06.056561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:09:06.056561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:09:06.056561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:09:06.056561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:09:06.056561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:09:06.056561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:09:06.056561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:09:06.056561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:09:06.056561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:09:06.056561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:09:06.056561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:09:06.056561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:09:06.056561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:09:06.056561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:09:06.056561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:09:06.061181 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:09:06.061181 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:09:06.061181 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:09:06.061181 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:09:06.061181 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:09:06.061181 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:09:06.061181 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:09:06.061181 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:09:06.061181 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 632/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:09:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:09:06.062366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ff02a-d3c6-4a78-99df-11ef59fc5ff2 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:06.163091 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ff02a-d3c6-4a78-99df-11ef59fc5ff2 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:06.197635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4376ea5-4ef8-4499-9419-fd8a89096433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:06.198241 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4376ea5-4ef8-4499-9419-fd8a89096433 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:06.198521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4376ea5-4ef8-4499-9419-fd8a89096433 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:06.198796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4376ea5-4ef8-4499-9419-fd8a89096433 None admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:06.199483 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4376ea5-4ef8-4499-9419-fd8a89096433 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:09:06.199788 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4376ea5-4ef8-4499-9419-fd8a89096433 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:06.201244 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4376ea5-4ef8-4499-9419-fd8a89096433 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:06.213697 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 627/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:09:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:09:06.219906 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8362777-3739-419d-a9f2-74d430b736e4 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:06.247509 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:06.320350 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8362777-3739-419d-a9f2-74d430b736e4 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:06.354744 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e71d0-2ead-4523-9269-1d581e618b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:06.355383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e71d0-2ead-4523-9269-1d581e618b3e None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:06.355665 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e71d0-2ead-4523-9269-1d581e618b3e None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:06.355941 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e71d0-2ead-4523-9269-1d581e618b3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:06.356673 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e71d0-2ead-4523-9269-1d581e618b3e None admin] RBAC: Adding query filter params (role.id=255d9e4004c54505a7cda1b8af74e5f1, scope.project.id=a7ada12a1e3a42949c00f483efd522ba, user.id=34794124b7234aeb98a15f0c2ae06a0c) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:09:06.356985 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e71d0-2ead-4523-9269-1d581e618b3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:06.358465 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e71d0-2ead-4523-9269-1d581e618b3e None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:06.363872 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 633/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:09:06 2022] GET /identity/v3/role_assignments?user.id=34794124b7234aeb98a15f0c2ae06a0c&scope.project.id=a7ada12a1e3a42949c00f483efd522ba&role.id=255d9e4004c54505a7cda1b8af74e5f1 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:09:08.243943 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630435b-9e61-40a8-843a-ff96eb13d506 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:08.244503 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630435b-9e61-40a8-843a-ff96eb13d506 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:08.244613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630435b-9e61-40a8-843a-ff96eb13d506 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:08.245901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 628/1261] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:09:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:09:08.251126 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dcaf8-43f8-4d59-93f1-7f755201b91c None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:08.251560 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dcaf8-43f8-4d59-93f1-7f755201b91c None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:08.251685 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dcaf8-43f8-4d59-93f1-7f755201b91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:08.270206 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-da6dcaf8-43f8-4d59-93f1-7f755201b91c None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:09:08.274764 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-da6dcaf8-43f8-4d59-93f1-7f755201b91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:09:08.336557 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 634/1262] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:09:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:09:08.604646 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630435b-9e61-40a8-843a-ff96eb13d506 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:08.615519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:08.704986 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630435b-9e61-40a8-843a-ff96eb13d506 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:08.738405 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b344762-e527-45b5-ae9d-b5d3d095fb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:08.739026 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b344762-e527-45b5-ae9d-b5d3d095fb40 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:08.739308 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b344762-e527-45b5-ae9d-b5d3d095fb40 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:08.739581 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b344762-e527-45b5-ae9d-b5d3d095fb40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:08.750461 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b344762-e527-45b5-ae9d-b5d3d095fb40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:09:08.755166 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-7b344762-e527-45b5-ae9d-b5d3d095fb40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:09:08.755166 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:09:08.755166 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:09:08.755166 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:09:08.755166 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:09:08.755166 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:09:08.755166 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:09:08.755166 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:09:08.755166 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:09:08.755166 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:09:08.755166 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:09:08.755166 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:09:08.755166 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:09:08.755166 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:09:08.755166 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:09:08.755166 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:09:08.756287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:09:08.756287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:09:08.756287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:09:08.756287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:09:08.756287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:09:08.756287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:09:08.756287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:09:08.756287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:09:08.756287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:09:08.756287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:09:08.756287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:09:08.756287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:09:08.756287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:09:08.756287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:09:08.756287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:09:08.756287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:09:08.757381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:09:08.757381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:09:08.757381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:09:08.757381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:09:08.757381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:09:08.757381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:09:08.757381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:09:08.757381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:09:08.757381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:09:08.757381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:09:08.757381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:09:08.757381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:09:08.757381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 629/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:09:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:09:08.762325 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6dcaf8-43f8-4d59-93f1-7f755201b91c None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:08.780236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:08.870155 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6dcaf8-43f8-4d59-93f1-7f755201b91c None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:08.905981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f4d2b-0d3a-4fab-8b35-d44cfb184acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:08.906603 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f4d2b-0d3a-4fab-8b35-d44cfb184acd None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:08.906890 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f4d2b-0d3a-4fab-8b35-d44cfb184acd None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:08.907166 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f4d2b-0d3a-4fab-8b35-d44cfb184acd None admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:08.908015 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f4d2b-0d3a-4fab-8b35-d44cfb184acd None admin] RBAC: Adding query filter params (name=admin) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:09:08.908323 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f4d2b-0d3a-4fab-8b35-d44cfb184acd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:08.909831 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f4d2b-0d3a-4fab-8b35-d44cfb184acd None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:08.919178 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 635/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:09:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:09:08.925278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b344762-e527-45b5-ae9d-b5d3d095fb40 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:08.995228 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:09.030331 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b344762-e527-45b5-ae9d-b5d3d095fb40 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:09.070102 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab40e8-ece3-4f86-9c3f-c73bd0916876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:09.070745 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab40e8-ece3-4f86-9c3f-c73bd0916876 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:09.071029 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab40e8-ece3-4f86-9c3f-c73bd0916876 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:09.071329 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab40e8-ece3-4f86-9c3f-c73bd0916876 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:09.082098 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab40e8-ece3-4f86-9c3f-c73bd0916876 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:09.083569 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab40e8-ece3-4f86-9c3f-c73bd0916876 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:09.098472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-a2ab40e8-ece3-4f86-9c3f-c73bd0916876 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:09:09.098472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:09:09.098472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:09:09.098472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:09:09.098472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:09:09.098472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:09:09.098472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:09:09.098472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:09:09.098472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:09:09.098472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:09:09.098472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:09:09.098472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:09:09.098472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:09:09.098472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:09:09.098472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:09:09.098472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:09:09.102011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:09:09.102011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:09:09.102011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:09:09.102011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:09:09.102011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:09:09.102011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:09:09.102011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:09:09.102011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:09:09.102011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:09:09.102011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:09:09.102011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:09:09.102011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:09:09.102011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:09:09.102011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:09:09.102011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:09:09.102011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:09:09.102011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:09:09.103154 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:09:09.103154 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:09:09.103154 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:09:09.103154 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 630/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:09:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:09:09.106198 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f4d2b-0d3a-4fab-8b35-d44cfb184acd None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:09.186501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:09.205315 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f4d2b-0d3a-4fab-8b35-d44cfb184acd None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:09.237921 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62fa5f-be45-4d05-9bb0-e5e5edcd0640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:09.238586 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62fa5f-be45-4d05-9bb0-e5e5edcd0640 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:09.238863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62fa5f-be45-4d05-9bb0-e5e5edcd0640 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:09.239133 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62fa5f-be45-4d05-9bb0-e5e5edcd0640 None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:09.239771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62fa5f-be45-4d05-9bb0-e5e5edcd0640 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:09:09.240073 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62fa5f-be45-4d05-9bb0-e5e5edcd0640 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:09.241465 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62fa5f-be45-4d05-9bb0-e5e5edcd0640 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:09.252841 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 636/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:09:09.259146 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab40e8-ece3-4f86-9c3f-c73bd0916876 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:09.358964 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab40e8-ece3-4f86-9c3f-c73bd0916876 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:09.378090 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:09.392302 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e0c19-9d71-4944-804d-48dd46196686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:09.393837 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e0c19-9d71-4944-804d-48dd46196686 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:09.393837 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e0c19-9d71-4944-804d-48dd46196686 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:09.393837 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e0c19-9d71-4944-804d-48dd46196686 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:09.401563 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e0c19-9d71-4944-804d-48dd46196686 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:09.403004 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e0c19-9d71-4944-804d-48dd46196686 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:09.414219 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-4d6e0c19-9d71-4944-804d-48dd46196686 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 04:09:09.414219 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:09:09.414219 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:09:09.414219 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:09:09.414219 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:09:09.414219 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:09:09.414219 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:09:09.414219 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:09:09.414219 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:09:09.414219 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:09:09.414219 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:09:09.414219 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:09:09.414219 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:09:09.414219 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:09:09.414219 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:09:09.414219 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:09:09.417683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:09:09.417683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:09:09.417683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:09:09.417683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:09:09.417683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:09:09.417683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:09:09.417683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:09:09.417683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:09:09.417683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:09:09.417683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:09:09.417683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:09:09.417683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:09:09.417683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:09:09.417683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:09:09.417683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:09:09.417683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:09:09.417683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:09:09.417683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:09:09.418900 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:09:09.418900 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:09:09.418900 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:09:09.418900 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:09:09.418900 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:09:09.418900 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:09:09.418900 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:09:09.418900 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:09:09.418900 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 04:09:09.418900 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:09:09.418900 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 631/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:09:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:09:09.421335 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62fa5f-be45-4d05-9bb0-e5e5edcd0640 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:09.519866 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62fa5f-be45-4d05-9bb0-e5e5edcd0640 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:09.554793 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775f57b-0669-4269-a62c-409fb1f3983e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:09.555393 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775f57b-0669-4269-a62c-409fb1f3983e None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:09.555670 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775f57b-0669-4269-a62c-409fb1f3983e None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:09.555934 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775f57b-0669-4269-a62c-409fb1f3983e None admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:09.556653 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775f57b-0669-4269-a62c-409fb1f3983e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:09:09.556954 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775f57b-0669-4269-a62c-409fb1f3983e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:09.558403 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775f57b-0669-4269-a62c-409fb1f3983e None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:09.567192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:09.576207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 637/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Aug 23 04:09:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:09:09.582095 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e0c19-9d71-4944-804d-48dd46196686 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:09.682810 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e0c19-9d71-4944-804d-48dd46196686 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:09.716087 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8e63c-9e8a-4bc6-86ed-9735d8de7b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:09.716718 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8e63c-9e8a-4bc6-86ed-9735d8de7b0a None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:09.716997 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8e63c-9e8a-4bc6-86ed-9735d8de7b0a None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:09.717306 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8e63c-9e8a-4bc6-86ed-9735d8de7b0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:09.728118 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8e63c-9e8a-4bc6-86ed-9735d8de7b0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:09.729694 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8e63c-9e8a-4bc6-86ed-9735d8de7b0a None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:09.744217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-b5c8e63c-9e8a-4bc6-86ed-9735d8de7b0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:09:09.744217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:09:09.744217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:09:09.744217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:09:09.744217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:09:09.744217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:09:09.744217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:09:09.744217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:09:09.744217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:09:09.744217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:09:09.744217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:09:09.744217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:09:09.744217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:09:09.744217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:09:09.744217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:09:09.744217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:09:09.753378 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:09:09.753378 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:09:09.753378 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:09:09.753378 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:09:09.753378 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:09:09.753378 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:09:09.753378 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:09:09.753378 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:09:09.753378 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:09:09.753378 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:09:09.753378 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:09:09.753378 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:09:09.753378 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:09:09.753378 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:09:09.753378 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:09:09.753378 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:09:09.753378 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:09:09.754479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:09:09.754479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:09:09.754479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:09:09.754479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 632/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:09:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:09:09.754721 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775f57b-0669-4269-a62c-409fb1f3983e None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:09.853506 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775f57b-0669-4269-a62c-409fb1f3983e None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:09.887613 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1502b-a7e6-4404-b585-aa5d4cc2a6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:09.888216 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1502b-a7e6-4404-b585-aa5d4cc2a6b7 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:09.894420 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1502b-a7e6-4404-b585-aa5d4cc2a6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:09.894420 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1502b-a7e6-4404-b585-aa5d4cc2a6b7 None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:09.894420 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1502b-a7e6-4404-b585-aa5d4cc2a6b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:09:09.894420 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1502b-a7e6-4404-b585-aa5d4cc2a6b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:09.894420 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1502b-a7e6-4404-b585-aa5d4cc2a6b7 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:09.902129 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 638/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:09:09.907942 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8e63c-9e8a-4bc6-86ed-9735d8de7b0a None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:09.941135 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:10.008861 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8e63c-9e8a-4bc6-86ed-9735d8de7b0a None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:10.041607 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3ee42-9de6-4a21-995d-8f6c1737ee3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:10.042235 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3ee42-9de6-4a21-995d-8f6c1737ee3c None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:10.042516 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3ee42-9de6-4a21-995d-8f6c1737ee3c None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:10.042790 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3ee42-9de6-4a21-995d-8f6c1737ee3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:10.049602 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3ee42-9de6-4a21-995d-8f6c1737ee3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:10.051977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3ee42-9de6-4a21-995d-8f6c1737ee3c None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:10.062568 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-fae3ee42-9de6-4a21-995d-8f6c1737ee3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:09:10.062568 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:09:10.062568 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:09:10.062568 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:09:10.062568 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:09:10.062568 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:09:10.062568 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:09:10.062568 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:09:10.062568 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:09:10.062568 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:09:10.062568 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:09:10.062568 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:09:10.062568 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:09:10.062568 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:09:10.062568 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:09:10.063551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:09:10.063551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:09:10.063551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:09:10.063551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:09:10.063551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:09:10.063551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:09:10.063551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:09:10.063551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:09:10.063551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:09:10.063551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:09:10.063551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:09:10.063551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:09:10.063551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:09:10.063551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:09:10.063551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:09:10.063551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:09:10.063551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:09:10.064798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:09:10.064798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:09:10.064798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:09:10.064798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:09:10.064798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:09:10.064798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:09:10.064798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:09:10.064798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:09:10.064798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 633/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:09:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:09:10.069588 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1502b-a7e6-4404-b585-aa5d4cc2a6b7 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:10.126929 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:10.167002 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1502b-a7e6-4404-b585-aa5d4cc2a6b7 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:10.200596 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6cf0d-3dee-4bb0-95fe-74104f46d570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:10.201238 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6cf0d-3dee-4bb0-95fe-74104f46d570 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:10.201521 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6cf0d-3dee-4bb0-95fe-74104f46d570 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:10.201793 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6cf0d-3dee-4bb0-95fe-74104f46d570 None admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:10.202489 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd6cf0d-3dee-4bb0-95fe-74104f46d570 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:09:10.202798 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd6cf0d-3dee-4bb0-95fe-74104f46d570 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:10.204231 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd6cf0d-3dee-4bb0-95fe-74104f46d570 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:10.216230 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 639/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:09:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:09:10.222632 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3ee42-9de6-4a21-995d-8f6c1737ee3c None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:10.314668 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:10.323050 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3ee42-9de6-4a21-995d-8f6c1737ee3c None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:10.356859 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de739b8-2979-4d9f-90b3-4e46afb35fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:10.357541 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de739b8-2979-4d9f-90b3-4e46afb35fe1 None admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:10.357824 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de739b8-2979-4d9f-90b3-4e46afb35fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:10.358094 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de739b8-2979-4d9f-90b3-4e46afb35fe1 None admin] PATH_INFO: `/v3/projects/a7ada12a1e3a42949c00f483efd522ba/users/34794124b7234aeb98a15f0c2ae06a0c/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:10.359997 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de739b8-2979-4d9f-90b3-4e46afb35fe1 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7ada12a1e3a42949c00f483efd522ba, user_id=34794124b7234aeb98a15f0c2ae06a0c, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:10.361447 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de739b8-2979-4d9f-90b3-4e46afb35fe1 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:10.516445 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 634/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 23 04:09:10 2022] PUT /identity/v3/projects/a7ada12a1e3a42949c00f483efd522ba/users/34794124b7234aeb98a15f0c2ae06a0c/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:09:12.404595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2b3bc-24a6-482c-a6cf-52380f4b2251 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:12.405135 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2b3bc-24a6-482c-a6cf-52380f4b2251 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:12.405250 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2b3bc-24a6-482c-a6cf-52380f4b2251 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:12.406824 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 640/1274] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:09:12.412686 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bae9a1-2e1f-42ba-97eb-a638f326ba05 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:12.413191 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bae9a1-2e1f-42ba-97eb-a638f326ba05 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:12.413326 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bae9a1-2e1f-42ba-97eb-a638f326ba05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:12.431345 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-03bae9a1-2e1f-42ba-97eb-a638f326ba05 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:09:12.433543 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-03bae9a1-2e1f-42ba-97eb-a638f326ba05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:09:12.498966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 635/1275] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:09:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:09:12.766870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2b3bc-24a6-482c-a6cf-52380f4b2251 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:12.866467 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2b3bc-24a6-482c-a6cf-52380f4b2251 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:12.889585 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:12.900693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea3b4d-4ab2-4578-966d-e1f2c05c560d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:12.901341 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea3b4d-4ab2-4578-966d-e1f2c05c560d None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:12.901620 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea3b4d-4ab2-4578-966d-e1f2c05c560d None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:12.901893 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea3b4d-4ab2-4578-966d-e1f2c05c560d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:12.911663 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea3b4d-4ab2-4578-966d-e1f2c05c560d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 04:09:12.916871 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-8eea3b4d-4ab2-4578-966d-e1f2c05c560d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:09:12.916871 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:09:12.916871 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:09:12.916871 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:09:12.916871 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:09:12.916871 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:09:12.916871 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:09:12.916871 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:09:12.916871 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:09:12.916871 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:09:12.916871 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:09:12.916871 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:09:12.916871 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 04:09:12.916871 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 04:09:12.916871 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 04:09:12.916871 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 04:09:12.918044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 04:09:12.918044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 04:09:12.918044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 04:09:12.918044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 04:09:12.918044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:09:12.918044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:09:12.918044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:09:12.918044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:09:12.918044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:09:12.918044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:09:12.918044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:09:12.918044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:09:12.918044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:09:12.918044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:09:12.918044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:09:12.918044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:09:12.918941 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:09:12.918941 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:09:12.918941 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:09:12.918941 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:09:12.918941 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 04:09:12.918941 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 04:09:12.918941 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 04:09:12.918941 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 04:09:12.918941 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 04:09:12.918941 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 04:09:12.918941 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 04:09:12.918941 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:09:12.918941 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 641/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 23 04:09:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:09:12.924330 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bae9a1-2e1f-42ba-97eb-a638f326ba05 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:13.004594 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:13.022160 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bae9a1-2e1f-42ba-97eb-a638f326ba05 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:13.056359 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e74e07-f553-41b3-9638-99e99d5c5394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:13.056964 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e74e07-f553-41b3-9638-99e99d5c5394 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:13.057277 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e74e07-f553-41b3-9638-99e99d5c5394 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:13.057553 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e74e07-f553-41b3-9638-99e99d5c5394 None admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:13.058222 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e74e07-f553-41b3-9638-99e99d5c5394 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:09:13.058524 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e74e07-f553-41b3-9638-99e99d5c5394 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:13.059881 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e74e07-f553-41b3-9638-99e99d5c5394 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:13.067791 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 636/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 23 04:09:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:09:13.073538 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea3b4d-4ab2-4578-966d-e1f2c05c560d None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:13.171796 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea3b4d-4ab2-4578-966d-e1f2c05c560d None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:13.204849 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe8181-b3c0-4fb8-a677-bb609dbf4c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:13.205494 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe8181-b3c0-4fb8-a677-bb609dbf4c4b None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:13.205777 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe8181-b3c0-4fb8-a677-bb609dbf4c4b None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:13.206046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe8181-b3c0-4fb8-a677-bb609dbf4c4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:13.215701 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe8181-b3c0-4fb8-a677-bb609dbf4c4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:13.217148 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe8181-b3c0-4fb8-a677-bb609dbf4c4b None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:13.231528 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-37fe8181-b3c0-4fb8-a677-bb609dbf4c4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:09:13.231528 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:09:13.231528 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:09:13.231528 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:09:13.231528 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:09:13.231528 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:09:13.231528 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:09:13.231528 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:09:13.231528 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:09:13.231528 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:09:13.231528 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:09:13.231528 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:09:13.231528 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:09:13.231528 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:09:13.231528 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:09:13.231528 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:09:13.232699 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:09:13.232699 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:09:13.232699 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:09:13.232699 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:09:13.232699 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:09:13.232699 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:09:13.232699 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:09:13.232699 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:09:13.232699 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:09:13.232699 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:09:13.232699 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:09:13.232699 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:09:13.232699 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:09:13.232699 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:09:13.232699 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:09:13.232699 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:09:13.232699 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:09:13.233735 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:09:13.233735 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:09:13.233735 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:09:13.233735 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 642/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:09:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:09:13.238495 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e74e07-f553-41b3-9638-99e99d5c5394 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:13.338804 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e74e07-f553-41b3-9638-99e99d5c5394 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:13.372769 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe9a74-3e69-4cc9-a31e-d6f6f98e4d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:13.373409 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe9a74-3e69-4cc9-a31e-d6f6f98e4d5f None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:13.373696 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe9a74-3e69-4cc9-a31e-d6f6f98e4d5f None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:13.378809 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe9a74-3e69-4cc9-a31e-d6f6f98e4d5f None admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:13.378809 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe9a74-3e69-4cc9-a31e-d6f6f98e4d5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:09:13.378809 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe9a74-3e69-4cc9-a31e-d6f6f98e4d5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:13.378809 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe9a74-3e69-4cc9-a31e-d6f6f98e4d5f None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:13.387964 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 637/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:09:13.393804 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe8181-b3c0-4fb8-a677-bb609dbf4c4b None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:13.425049 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:13.493278 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe8181-b3c0-4fb8-a677-bb609dbf4c4b None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:13.526045 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa64fd-df08-4214-87e4-47fec7254298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:13.529114 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa64fd-df08-4214-87e4-47fec7254298 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:13.529114 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa64fd-df08-4214-87e4-47fec7254298 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:13.529114 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa64fd-df08-4214-87e4-47fec7254298 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:13.534832 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa64fd-df08-4214-87e4-47fec7254298 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:13.536472 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa64fd-df08-4214-87e4-47fec7254298 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:13.548761 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-19fa64fd-df08-4214-87e4-47fec7254298 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 04:09:13.548761 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:09:13.548761 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:09:13.548761 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:09:13.548761 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:09:13.548761 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:09:13.548761 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:09:13.548761 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:09:13.548761 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:09:13.548761 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:09:13.548761 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:09:13.548761 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:09:13.548761 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 04:09:13.548761 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 04:09:13.548761 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 04:09:13.548761 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 04:09:13.551638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:09:13.551638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:09:13.551638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 04:09:13.551638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:09:13.551638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 04:09:13.551638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 04:09:13.551638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:09:13.551638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:09:13.551638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:09:13.551638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:09:13.551638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:09:13.551638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:09:13.551638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:09:13.551638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:09:13.551638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:09:13.551638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:09:13.551638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:09:13.551638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:09:13.552718 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:09:13.552718 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:09:13.552718 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 04:09:13.552718 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 04:09:13.552718 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 04:09:13.552718 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 04:09:13.552718 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 04:09:13.552718 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 04:09:13.552718 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 04:09:13.552718 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:09:13.552718 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 643/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:09:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:09:13.556083 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe9a74-3e69-4cc9-a31e-d6f6f98e4d5f None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:13.559897 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:13.659339 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe9a74-3e69-4cc9-a31e-d6f6f98e4d5f None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:13.692663 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bd4eb-bd83-4a1b-a6c4-6be6256559b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:13.693985 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bd4eb-bd83-4a1b-a6c4-6be6256559b4 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:13.693985 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bd4eb-bd83-4a1b-a6c4-6be6256559b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:13.693985 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bd4eb-bd83-4a1b-a6c4-6be6256559b4 None admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:13.694684 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bd4eb-bd83-4a1b-a6c4-6be6256559b4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:09:13.694988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bd4eb-bd83-4a1b-a6c4-6be6256559b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:13.696921 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bd4eb-bd83-4a1b-a6c4-6be6256559b4 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:13.714111 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 638/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Aug 23 04:09:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:09:13.719837 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa64fd-df08-4214-87e4-47fec7254298 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:13.809040 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:13.818454 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa64fd-df08-4214-87e4-47fec7254298 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:13.851331 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c17f68-56a0-4ce1-8f26-156ae628850a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:13.851937 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c17f68-56a0-4ce1-8f26-156ae628850a None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:13.852238 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c17f68-56a0-4ce1-8f26-156ae628850a None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:13.852494 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c17f68-56a0-4ce1-8f26-156ae628850a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:13.919119 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c17f68-56a0-4ce1-8f26-156ae628850a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:13.920503 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c17f68-56a0-4ce1-8f26-156ae628850a None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:14.006575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:14.016992 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 644/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 23 04:09:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 04:09:14.022878 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bd4eb-bd83-4a1b-a6c4-6be6256559b4 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:14.085876 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:14.123511 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bd4eb-bd83-4a1b-a6c4-6be6256559b4 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:14.156768 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54439c3a-46e0-4f13-aba1-e7667933c322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:14.157440 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54439c3a-46e0-4f13-aba1-e7667933c322 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:14.157723 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54439c3a-46e0-4f13-aba1-e7667933c322 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:14.157994 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54439c3a-46e0-4f13-aba1-e7667933c322 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:14.168028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54439c3a-46e0-4f13-aba1-e7667933c322 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:14.169588 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54439c3a-46e0-4f13-aba1-e7667933c322 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:14.184435 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-54439c3a-46e0-4f13-aba1-e7667933c322 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:09:14.184435 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:09:14.184435 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:09:14.184435 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:09:14.184435 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:09:14.184435 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:09:14.184435 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:09:14.184435 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:09:14.184435 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:09:14.184435 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:09:14.184435 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:09:14.184435 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:09:14.184435 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 04:09:14.184435 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 04:09:14.184435 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 04:09:14.184435 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 04:09:14.186909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:09:14.186909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:09:14.186909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:09:14.186909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:09:14.186909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:09:14.186909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:09:14.186909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:09:14.186909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:09:14.186909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:09:14.186909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:09:14.186909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:09:14.186909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:09:14.186909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:09:14.186909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:09:14.186909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:09:14.186909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:09:14.186909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 04:09:14.188055 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 04:09:14.188055 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 04:09:14.188055 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:09:14.188055 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 639/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:09:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:09:14.191311 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c17f68-56a0-4ce1-8f26-156ae628850a None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:14.288649 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c17f68-56a0-4ce1-8f26-156ae628850a None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:14.322807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac36ef1-c886-4abb-8eb4-1af0e8a4e743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:14.323415 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac36ef1-c886-4abb-8eb4-1af0e8a4e743 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:14.323694 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac36ef1-c886-4abb-8eb4-1af0e8a4e743 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:14.323966 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac36ef1-c886-4abb-8eb4-1af0e8a4e743 None admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:14.324607 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac36ef1-c886-4abb-8eb4-1af0e8a4e743 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:09:14.324914 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac36ef1-c886-4abb-8eb4-1af0e8a4e743 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:14.326309 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac36ef1-c886-4abb-8eb4-1af0e8a4e743 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:14.337409 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 645/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 23 04:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:09:14.343519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54439c3a-46e0-4f13-aba1-e7667933c322 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:14.443975 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54439c3a-46e0-4f13-aba1-e7667933c322 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:14.457273 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:14.476444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3708ce-a1b3-43f6-b0f8-2c21757bb372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:14.477172 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3708ce-a1b3-43f6-b0f8-2c21757bb372 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:14.477456 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3708ce-a1b3-43f6-b0f8-2c21757bb372 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:14.477726 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3708ce-a1b3-43f6-b0f8-2c21757bb372 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:14.484624 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3708ce-a1b3-43f6-b0f8-2c21757bb372 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:14.486078 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3708ce-a1b3-43f6-b0f8-2c21757bb372 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:14.497413 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application [None req-fa3708ce-a1b3-43f6-b0f8-2c21757bb372 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:09:14.497413 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:09:14.497413 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:09:14.497413 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:09:14.497413 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:09:14.497413 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:09:14.497413 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:09:14.497413 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:09:14.497413 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:09:14.497413 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:09:14.497413 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:09:14.497413 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:09:14.497413 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 04:09:14.497413 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 04:09:14.497413 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 04:09:14.503366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 04:09:14.503366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:09:14.503366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:09:14.503366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:09:14.503366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:09:14.503366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:09:14.503366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:09:14.503366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:09:14.503366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application with Lock( Aug 23 04:09:14.503366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:09:14.503366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:09:14.503366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:09:14.503366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:09:14.503366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:09:14.503366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:09:14.503366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:09:14.503366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:09:14.504645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 04:09:14.504645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 04:09:14.504645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 04:09:14.504645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 04:09:14.504645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 04:09:14.504645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 04:09:14.504645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 04:09:14.504645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: ERROR keystone.server.flask.application Aug 23 04:09:14.504645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 640/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 23 04:09:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:09:14.506232 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac36ef1-c886-4abb-8eb4-1af0e8a4e743 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:14.554520 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:14.602251 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac36ef1-c886-4abb-8eb4-1af0e8a4e743 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:14.635686 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169fe62-ce2c-4624-be62-51001ed6fd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:14.636289 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169fe62-ce2c-4624-be62-51001ed6fd4a None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:14.636568 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169fe62-ce2c-4624-be62-51001ed6fd4a None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:14.636840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169fe62-ce2c-4624-be62-51001ed6fd4a None admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:14.637555 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169fe62-ce2c-4624-be62-51001ed6fd4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:09:14.637861 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169fe62-ce2c-4624-be62-51001ed6fd4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:14.639287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169fe62-ce2c-4624-be62-51001ed6fd4a None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:14.651570 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 646/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 23 04:09:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:09:14.657717 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3708ce-a1b3-43f6-b0f8-2c21757bb372 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:14.757299 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3708ce-a1b3-43f6-b0f8-2c21757bb372 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:14.789916 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9297d-c809-4a59-86f6-d95e11c27e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:14.790521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9297d-c809-4a59-86f6-d95e11c27e9e None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:14.790805 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9297d-c809-4a59-86f6-d95e11c27e9e None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:14.791702 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9297d-c809-4a59-86f6-d95e11c27e9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:14.792424 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9297d-c809-4a59-86f6-d95e11c27e9e None admin] RBAC: Adding query filter params (role.id=255d9e4004c54505a7cda1b8af74e5f1, scope.project.id=a7ada12a1e3a42949c00f483efd522ba, user.id=34794124b7234aeb98a15f0c2ae06a0c) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:09:14.792735 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9297d-c809-4a59-86f6-d95e11c27e9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:14.794216 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9297d-c809-4a59-86f6-d95e11c27e9e None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:14.800015 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 641/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 23 04:09:14 2022] GET /identity/v3/role_assignments?user.id=34794124b7234aeb98a15f0c2ae06a0c&scope.project.id=a7ada12a1e3a42949c00f483efd522ba&role.id=255d9e4004c54505a7cda1b8af74e5f1 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:09:16.729770 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72665c-22cd-4c50-b753-466a66cfff75 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:16.730340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72665c-22cd-4c50-b753-466a66cfff75 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:16.730340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72665c-22cd-4c50-b753-466a66cfff75 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:16.731648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 647/1288] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:09:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:09:16.737037 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74dc08-3c2c-48fd-9f28-ddbb2674f79b None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:16.737577 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74dc08-3c2c-48fd-9f28-ddbb2674f79b None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:16.737657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74dc08-3c2c-48fd-9f28-ddbb2674f79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:16.756094 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-6e74dc08-3c2c-48fd-9f28-ddbb2674f79b None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:09:16.757291 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-6e74dc08-3c2c-48fd-9f28-ddbb2674f79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:09:16.787375 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:16.824976 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 642/1289] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:09:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:09:17.093876 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72665c-22cd-4c50-b753-466a66cfff75 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:17.194031 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72665c-22cd-4c50-b753-466a66cfff75 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:17.204267 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:17.226386 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b30cf1-d3f9-4e3b-a914-6afad6ae016a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:17.231527 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b30cf1-d3f9-4e3b-a914-6afad6ae016a None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:17.231527 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b30cf1-d3f9-4e3b-a914-6afad6ae016a None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:17.231527 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b30cf1-d3f9-4e3b-a914-6afad6ae016a None admin] PATH_INFO: `/v3/services/placement` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:17.231527 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b30cf1-d3f9-4e3b-a914-6afad6ae016a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:17.231527 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b30cf1-d3f9-4e3b-a914-6afad6ae016a None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:17.238419 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-63b30cf1-d3f9-4e3b-a914-6afad6ae016a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 04:09:17.238419 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:09:17.238419 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 04:09:17.238419 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 04:09:17.238419 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 04:09:17.238419 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 04:09:17.238419 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 04:09:17.238419 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:09:17.238419 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 04:09:17.238419 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:09:17.238419 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 04:09:17.238419 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:09:17.238419 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:09:17.238419 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:09:17.238419 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:09:17.238419 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:09:17.238419 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:09:17.239736 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:09:17.239736 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:09:17.239736 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:09:17.239736 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:09:17.239736 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:09:17.239736 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:09:17.239736 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 04:09:17.239736 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 04:09:17.239736 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 04:09:17.239736 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 04:09:17.239736 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:09:17.239736 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:09:17.239736 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:09:17.239736 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:09:17.239736 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:09:17.239736 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:09:17.240827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:09:17.240827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:09:17.240827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:09:17.240827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:09:17.240827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:09:17.240827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:09:17.240827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:09:17.240827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:09:17.240827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:09:17.240827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:09:17.240827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 04:09:17.240827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:09:17.240827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 04:09:17.240827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:09:17.240827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 648/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Aug 23 04:09:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:09:17.248336 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74dc08-3c2c-48fd-9f28-ddbb2674f79b None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:17.346326 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74dc08-3c2c-48fd-9f28-ddbb2674f79b None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:17.380592 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c6ed6-50f8-47ec-962f-025ffb7cbe76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:17.381275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c6ed6-50f8-47ec-962f-025ffb7cbe76 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:17.381559 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c6ed6-50f8-47ec-962f-025ffb7cbe76 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:17.381833 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c6ed6-50f8-47ec-962f-025ffb7cbe76 None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:17.382463 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c6ed6-50f8-47ec-962f-025ffb7cbe76 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:09:17.382769 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c6ed6-50f8-47ec-962f-025ffb7cbe76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:17.384121 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c6ed6-50f8-47ec-962f-025ffb7cbe76 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:17.389351 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 643/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Tue Aug 23 04:09:17 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:09:17.395368 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b30cf1-d3f9-4e3b-a914-6afad6ae016a None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:17.495602 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b30cf1-d3f9-4e3b-a914-6afad6ae016a None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:17.528407 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15647196-12fc-430c-8024-af8ab4d80b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:17.529008 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15647196-12fc-430c-8024-af8ab4d80b6d None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:17.529313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15647196-12fc-430c-8024-af8ab4d80b6d None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:17.529587 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15647196-12fc-430c-8024-af8ab4d80b6d None admin] PATH_INFO: `/v3/services` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:17.530212 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15647196-12fc-430c-8024-af8ab4d80b6d None admin] RBAC: Adding query filter params (type=placement) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:09:17.530513 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15647196-12fc-430c-8024-af8ab4d80b6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:17.531898 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15647196-12fc-430c-8024-af8ab4d80b6d None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:17.537136 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 649/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Tue Aug 23 04:09:17 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:09:19.412808 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed12810-8946-4344-91ef-05366034ff51 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:19.413467 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed12810-8946-4344-91ef-05366034ff51 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:19.413467 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed12810-8946-4344-91ef-05366034ff51 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:19.414863 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 644/1293] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:09:19.420723 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50661090-cb56-440b-9651-29a0c6ae237c None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:19.421174 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50661090-cb56-440b-9651-29a0c6ae237c None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:19.424614 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50661090-cb56-440b-9651-29a0c6ae237c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:19.439327 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-50661090-cb56-440b-9651-29a0c6ae237c None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:09:19.440579 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-50661090-cb56-440b-9651-29a0c6ae237c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:09:19.469584 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:19.505786 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 650/1294] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:09:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:09:19.766995 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed12810-8946-4344-91ef-05366034ff51 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:19.798641 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:19.867953 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed12810-8946-4344-91ef-05366034ff51 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:19.901596 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231efcf-50ae-40f4-a04a-7190102972e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:19.902197 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231efcf-50ae-40f4-a04a-7190102972e4 None admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:19.902480 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231efcf-50ae-40f4-a04a-7190102972e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:19.902752 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231efcf-50ae-40f4-a04a-7190102972e4 None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:19.903401 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231efcf-50ae-40f4-a04a-7190102972e4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:19.904881 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231efcf-50ae-40f4-a04a-7190102972e4 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:19.996421 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 645/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 23 04:09:19 2022] POST /identity/v3/services => generated 246 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:09:21.893178 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e00b04-0f00-48c8-9f69-9ebc489b4d71 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:21.893750 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e00b04-0f00-48c8-9f69-9ebc489b4d71 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:21.893750 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e00b04-0f00-48c8-9f69-9ebc489b4d71 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:21.895110 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 651/1296] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:09:21.900302 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66d4dd-b49b-495c-97b0-9fbc57d45e97 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:21.900766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66d4dd-b49b-495c-97b0-9fbc57d45e97 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:21.900873 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66d4dd-b49b-495c-97b0-9fbc57d45e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:21.919157 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-8e66d4dd-b49b-495c-97b0-9fbc57d45e97 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:09:21.920335 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-8e66d4dd-b49b-495c-97b0-9fbc57d45e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:09:21.992519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 646/1297] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:09:21 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:09:22.255779 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e00b04-0f00-48c8-9f69-9ebc489b4d71 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:22.359105 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e00b04-0f00-48c8-9f69-9ebc489b4d71 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:22.393208 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90762f29-7094-497f-bcca-69c39b60b670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:22.393843 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90762f29-7094-497f-bcca-69c39b60b670 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:22.394126 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90762f29-7094-497f-bcca-69c39b60b670 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:22.394466 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90762f29-7094-497f-bcca-69c39b60b670 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:22.395059 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90762f29-7094-497f-bcca-69c39b60b670 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:22.396437 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90762f29-7094-497f-bcca-69c39b60b670 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:22.405783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-90762f29-7094-497f-bcca-69c39b60b670 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 04:09:22.405783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:09:22.405783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 04:09:22.405783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 04:09:22.405783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 04:09:22.405783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 04:09:22.405783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 04:09:22.405783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:09:22.405783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 04:09:22.405783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:09:22.405783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 04:09:22.405783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:09:22.405783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:09:22.405783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:09:22.405783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:09:22.405783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:09:22.405783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:09:22.412030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:09:22.412030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:09:22.412030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:09:22.412030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:09:22.412030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:09:22.412030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:09:22.412030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 04:09:22.412030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 04:09:22.412030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 04:09:22.412030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 04:09:22.412030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:09:22.412030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:09:22.412030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:09:22.412030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:09:22.412030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:09:22.412030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:09:22.412904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:09:22.412904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:09:22.412904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:09:22.412904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:09:22.412904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:09:22.412904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:09:22.412904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:09:22.412904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:09:22.412904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:09:22.412904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:09:22.412904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 04:09:22.412904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:09:22.412904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 04:09:22.412904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:09:22.412904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 652/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Aug 23 04:09:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:09:22.413768 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66d4dd-b49b-495c-97b0-9fbc57d45e97 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:22.432299 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:22.514030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66d4dd-b49b-495c-97b0-9fbc57d45e97 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:22.548742 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88730eb-5e33-4421-bd32-276c537d9bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:22.549473 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88730eb-5e33-4421-bd32-276c537d9bc5 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:22.549734 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88730eb-5e33-4421-bd32-276c537d9bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:22.550011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88730eb-5e33-4421-bd32-276c537d9bc5 None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:22.550646 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88730eb-5e33-4421-bd32-276c537d9bc5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:09:22.550953 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88730eb-5e33-4421-bd32-276c537d9bc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:22.552372 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88730eb-5e33-4421-bd32-276c537d9bc5 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:22.557492 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 647/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Tue Aug 23 04:09:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:09:22.563749 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90762f29-7094-497f-bcca-69c39b60b670 None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:22.594987 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:22.662690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90762f29-7094-497f-bcca-69c39b60b670 None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:22.695196 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad61a2-7c48-4cab-921d-57da4d37b3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:22.695794 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad61a2-7c48-4cab-921d-57da4d37b3e8 None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:22.696068 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad61a2-7c48-4cab-921d-57da4d37b3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:22.696337 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad61a2-7c48-4cab-921d-57da4d37b3e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:22.697036 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad61a2-7c48-4cab-921d-57da4d37b3e8 None admin] RBAC: Adding query filter params (interface=public, service_id=503582484e4f4af99d97254f1dd293aa, region_id=RegionOne) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:09:22.697372 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad61a2-7c48-4cab-921d-57da4d37b3e8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:22.698719 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad61a2-7c48-4cab-921d-57da4d37b3e8 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:22.704094 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 653/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Aug 23 04:09:22 2022] GET /identity/v3/endpoints?service_id=503582484e4f4af99d97254f1dd293aa&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:09:22.709895 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88730eb-5e33-4421-bd32-276c537d9bc5 None admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:22.789725 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:22.807092 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88730eb-5e33-4421-bd32-276c537d9bc5 None admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:22.841094 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2fafb-0754-4087-844d-ebf01d35e0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:22.841715 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2fafb-0754-4087-844d-ebf01d35e0a8 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:22.841996 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2fafb-0754-4087-844d-ebf01d35e0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:22.842266 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2fafb-0754-4087-844d-ebf01d35e0a8 None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:22.842865 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2fafb-0754-4087-844d-ebf01d35e0a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:22.844209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2fafb-0754-4087-844d-ebf01d35e0a8 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:22.850816 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 648/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Aug 23 04:09:22 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:09:24.729933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92655177-f978-436e-bf19-fd370382d258 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:24.731102 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92655177-f978-436e-bf19-fd370382d258 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:24.731102 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92655177-f978-436e-bf19-fd370382d258 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:24.732412 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 654/1302] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:09:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:09:24.737805 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7e84b-56fe-45df-9b04-5af5e7e78437 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:24.738195 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7e84b-56fe-45df-9b04-5af5e7e78437 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:24.738462 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7e84b-56fe-45df-9b04-5af5e7e78437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:24.756284 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-47f7e84b-56fe-45df-9b04-5af5e7e78437 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:09:24.757490 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-47f7e84b-56fe-45df-9b04-5af5e7e78437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:09:24.823617 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 649/1303] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:09:24 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 04:09:25.094089 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92655177-f978-436e-bf19-fd370382d258 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:25.188303 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:25.194788 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92655177-f978-436e-bf19-fd370382d258 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:25.228457 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faaf076-d672-483f-bee5-cfed1dd69dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:25.229114 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faaf076-d672-483f-bee5-cfed1dd69dab None admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:25.229399 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faaf076-d672-483f-bee5-cfed1dd69dab None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:25.229672 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faaf076-d672-483f-bee5-cfed1dd69dab None admin] PATH_INFO: `/v3/services/placement` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:25.230265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faaf076-d672-483f-bee5-cfed1dd69dab None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:25.231677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faaf076-d672-483f-bee5-cfed1dd69dab None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:25.240110 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application [None req-0faaf076-d672-483f-bee5-cfed1dd69dab None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 04:09:25.240110 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:09:25.240110 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 04:09:25.240110 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 04:09:25.240110 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 04:09:25.240110 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 04:09:25.240110 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 04:09:25.240110 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:09:25.240110 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 04:09:25.240110 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:09:25.240110 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 04:09:25.240110 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:09:25.240110 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 04:09:25.240110 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 04:09:25.240110 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 04:09:25.240110 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 04:09:25.240110 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 04:09:25.241182 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 04:09:25.241182 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 04:09:25.241182 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 04:09:25.241182 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 04:09:25.241182 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 04:09:25.241182 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 04:09:25.241182 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 04:09:25.241182 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 04:09:25.241182 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 04:09:25.241182 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 04:09:25.241182 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 04:09:25.241182 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 04:09:25.241182 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 04:09:25.241182 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 04:09:25.241182 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 04:09:25.241182 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 04:09:25.242176 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 04:09:25.242176 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application with Lock( Aug 23 04:09:25.242176 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 04:09:25.242176 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self._enter() Aug 23 04:09:25.242176 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 04:09:25.242176 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 04:09:25.242176 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 04:09:25.242176 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application return self.creator() Aug 23 04:09:25.242176 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 04:09:25.242176 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application created_value = creator( Aug 23 04:09:25.242176 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 04:09:25.242176 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 04:09:25.242176 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 04:09:25.242176 dv-cinder-854070-1-smb devstack@keystone.service[82355]: ERROR keystone.server.flask.application Aug 23 04:09:25.242176 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 655/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Aug 23 04:09:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 04:09:25.247809 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7e84b-56fe-45df-9b04-5af5e7e78437 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:25.322841 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:25.345156 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7e84b-56fe-45df-9b04-5af5e7e78437 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:25.378345 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0a040-8bd7-4f03-8dcc-0846f57a4846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:25.378943 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0a040-8bd7-4f03-8dcc-0846f57a4846 None admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:25.379220 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0a040-8bd7-4f03-8dcc-0846f57a4846 None admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:25.379517 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0a040-8bd7-4f03-8dcc-0846f57a4846 None admin] PATH_INFO: `/v3/services` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:25.380134 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0a040-8bd7-4f03-8dcc-0846f57a4846 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:09:25.380434 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0a040-8bd7-4f03-8dcc-0846f57a4846 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:25.381819 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0a040-8bd7-4f03-8dcc-0846f57a4846 None admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:25.387502 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 650/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Tue Aug 23 04:09:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:09:25.393391 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faaf076-d672-483f-bee5-cfed1dd69dab None admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:09:25.492350 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faaf076-d672-483f-bee5-cfed1dd69dab None admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:09:25.526561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bc769-19ba-4280-9a4e-8bf4aebfd912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:09:25.527212 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bc769-19ba-4280-9a4e-8bf4aebfd912 None admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:09:25.527498 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bc769-19ba-4280-9a4e-8bf4aebfd912 None admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:09:25.527776 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bc769-19ba-4280-9a4e-8bf4aebfd912 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:09:25.528443 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bc769-19ba-4280-9a4e-8bf4aebfd912 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:09:25.529859 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bc769-19ba-4280-9a4e-8bf4aebfd912 None admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:09:25.586261 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 656/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:09:25 2022] POST /identity/v3/endpoints => generated 331 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:09:35.383903 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=30 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:09:35.581774 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:15:41.562545 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf16dca-820e-4aa4-80d7-0cfb6f8162c2 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:15:41.563378 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf16dca-820e-4aa4-80d7-0cfb6f8162c2 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:15:41.563378 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf16dca-820e-4aa4-80d7-0cfb6f8162c2 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:15:41.569916 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d68cb2-fac0-446f-99dd-ad99f2e27c35 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:15:41.570362 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d68cb2-fac0-446f-99dd-ad99f2e27c35 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:15:41.570447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d68cb2-fac0-446f-99dd-ad99f2e27c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:15:41.575061 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 651/1307] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:15:41 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:15:41.652303 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-78d68cb2-fac0-446f-99dd-ad99f2e27c35 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:15:41.653920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-78d68cb2-fac0-446f-99dd-ad99f2e27c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:15:41.789150 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 657/1308] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:15:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:15:42.069576 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34ff9a-66e2-484c-80cd-55997a788bda None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:15:42.069875 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34ff9a-66e2-484c-80cd-55997a788bda None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:15:42.070332 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34ff9a-66e2-484c-80cd-55997a788bda None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:15:42.071918 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 652/1309] 10.222.0.42 () {54 vars in 965 bytes} [Tue Aug 23 04:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:15:42.078537 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72a8ab-38f1-4969-8c36-8a7f533a1da0 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:15:42.078830 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72a8ab-38f1-4969-8c36-8a7f533a1da0 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:15:42.079138 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72a8ab-38f1-4969-8c36-8a7f533a1da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:15:42.166541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-3c72a8ab-38f1-4969-8c36-8a7f533a1da0 None None] MFA Rules not processed for user `8304ca06f82742ef8ce74396884e90b4`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:15:42.167736 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-3c72a8ab-38f1-4969-8c36-8a7f533a1da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:15:42.191108 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:15:42.251605 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 658/1310] 10.222.0.42 () {58 vars in 1062 bytes} [Tue Aug 23 04:15:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:15:42.260493 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34ff9a-66e2-484c-80cd-55997a788bda None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:15:42.262361 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-ba34ff9a-66e2-484c-80cd-55997a788bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:15:42.388457 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34ff9a-66e2-484c-80cd-55997a788bda None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:15:42.474514 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d669702-01d4-467f-9a5a-ec8840b88444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:15:42.475149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d669702-01d4-467f-9a5a-ec8840b88444 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:15:42.475440 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d669702-01d4-467f-9a5a-ec8840b88444 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:15:42.475717 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d669702-01d4-467f-9a5a-ec8840b88444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:15:42.477477 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-7d669702-01d4-467f-9a5a-ec8840b88444 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:15:42.539533 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:15:42.598272 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d669702-01d4-467f-9a5a-ec8840b88444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:15:42.599708 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d669702-01d4-467f-9a5a-ec8840b88444 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:15:42.619978 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 653/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:15:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:15:44.797740 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd998d67-c6fd-4616-957b-8e49de064c95 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:15:44.798349 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd998d67-c6fd-4616-957b-8e49de064c95 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:15:44.798349 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd998d67-c6fd-4616-957b-8e49de064c95 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:15:44.799658 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 659/1312] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:15:44.805696 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980e7f4-d42e-443c-9a7e-be3f476fa788 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:15:44.806574 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980e7f4-d42e-443c-9a7e-be3f476fa788 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:15:44.806858 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980e7f4-d42e-443c-9a7e-be3f476fa788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:15:44.892881 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-6980e7f4-d42e-443c-9a7e-be3f476fa788 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:15:44.894347 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-6980e7f4-d42e-443c-9a7e-be3f476fa788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:15:45.003830 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 654/1313] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:15:45.338262 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d048419-4796-4b96-af96-1284c5618b56 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:15:45.338262 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d048419-4796-4b96-af96-1284c5618b56 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:15:45.338262 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d048419-4796-4b96-af96-1284c5618b56 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:15:45.338262 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 660/1314] 10.222.0.42 () {54 vars in 965 bytes} [Tue Aug 23 04:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:15:45.340579 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e067898-90f3-466f-a743-c0278a84e302 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:15:45.340873 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e067898-90f3-466f-a743-c0278a84e302 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:15:45.341192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e067898-90f3-466f-a743-c0278a84e302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:15:45.353249 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:15:45.420515 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-2e067898-90f3-466f-a743-c0278a84e302 None None] MFA Rules not processed for user `8304ca06f82742ef8ce74396884e90b4`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:15:45.421828 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-2e067898-90f3-466f-a743-c0278a84e302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:15:45.498059 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 655/1315] 10.222.0.42 () {58 vars in 1062 bytes} [Tue Aug 23 04:15:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:15:45.507015 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d048419-4796-4b96-af96-1284c5618b56 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:15:45.508547 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-1d048419-4796-4b96-af96-1284c5618b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:15:45.614786 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d048419-4796-4b96-af96-1284c5618b56 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:15:45.685505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:15:45.688338 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f80e9e-42a1-48cc-91a2-1aa73db54de6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:15:45.688950 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f80e9e-42a1-48cc-91a2-1aa73db54de6 service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:15:45.689264 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f80e9e-42a1-48cc-91a2-1aa73db54de6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:15:45.689538 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f80e9e-42a1-48cc-91a2-1aa73db54de6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:15:45.691147 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-f6f80e9e-42a1-48cc-91a2-1aa73db54de6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:15:45.799185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f80e9e-42a1-48cc-91a2-1aa73db54de6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:15:45.800638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f80e9e-42a1-48cc-91a2-1aa73db54de6 service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:15:45.818744 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 661/1316] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:15:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:15:48.457827 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d057ea-2f3d-4e29-a8ad-4a63c685f66c None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:15:48.458389 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d057ea-2f3d-4e29-a8ad-4a63c685f66c None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:15:48.458389 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d057ea-2f3d-4e29-a8ad-4a63c685f66c None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:15:48.459719 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 656/1317] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:15:48.465141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b4457-9c11-417c-927b-df26f2480bd8 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:15:48.465562 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b4457-9c11-417c-927b-df26f2480bd8 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:15:48.465699 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b4457-9c11-417c-927b-df26f2480bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:15:48.531942 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-166b4457-9c11-417c-927b-df26f2480bd8 None None] MFA Rules not processed for user `93456d60ff574c9a8ee4661d1bbe9633`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:15:48.533165 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-166b4457-9c11-417c-927b-df26f2480bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:15:48.583722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:15:48.627007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 662/1318] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:15:48 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:15:48.911184 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d057ea-2f3d-4e29-a8ad-4a63c685f66c None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:15:48.912744 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-81d057ea-2f3d-4e29-a8ad-4a63c685f66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:15:49.015288 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d057ea-2f3d-4e29-a8ad-4a63c685f66c None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:15:49.018151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:15:49.089296 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb8011-5dbf-4921-8e89-a75ce24b996c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:15:49.089908 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb8011-5dbf-4921-8e89-a75ce24b996c service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:15:49.090189 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb8011-5dbf-4921-8e89-a75ce24b996c service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:15:49.090459 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb8011-5dbf-4921-8e89-a75ce24b996c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:15:49.092579 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-ddcb8011-5dbf-4921-8e89-a75ce24b996c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:15:49.197810 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb8011-5dbf-4921-8e89-a75ce24b996c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:15:49.199163 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb8011-5dbf-4921-8e89-a75ce24b996c service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:15:49.217330 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 657/1319] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:15:48 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:15:51.916203 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca3db3-27da-4995-a506-12e61c9e53bb None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:15:51.916764 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca3db3-27da-4995-a506-12e61c9e53bb None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:15:51.916764 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca3db3-27da-4995-a506-12e61c9e53bb None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:15:51.918219 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 663/1320] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:15:51.923403 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd38ac-44e2-454e-8b5b-630eddd44328 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:15:51.923787 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd38ac-44e2-454e-8b5b-630eddd44328 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:15:51.923951 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd38ac-44e2-454e-8b5b-630eddd44328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:15:51.965540 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:15:51.990358 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-31cd38ac-44e2-454e-8b5b-630eddd44328 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:15:51.991568 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-31cd38ac-44e2-454e-8b5b-630eddd44328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:15:52.088658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 658/1321] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:15:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:15:52.370705 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca3db3-27da-4995-a506-12e61c9e53bb None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:15:52.372284 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-89ca3db3-27da-4995-a506-12e61c9e53bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:15:52.477505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca3db3-27da-4995-a506-12e61c9e53bb None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:15:52.551102 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23cd354-50ad-4268-872c-ca4dcb0b4d03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:15:52.551719 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cd354-50ad-4268-872c-ca4dcb0b4d03 service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:15:52.551998 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cd354-50ad-4268-872c-ca4dcb0b4d03 service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:15:52.552269 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cd354-50ad-4268-872c-ca4dcb0b4d03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:15:52.553915 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-e23cd354-50ad-4268-872c-ca4dcb0b4d03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:15:52.561777 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:15:52.660432 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23cd354-50ad-4268-872c-ca4dcb0b4d03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:15:52.661922 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23cd354-50ad-4268-872c-ca4dcb0b4d03 service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:15:52.680147 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 664/1322] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:15:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:15:55.576322 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522fbb5-5ec1-4ce0-83d0-d0548294f913 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:15:55.576890 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522fbb5-5ec1-4ce0-83d0-d0548294f913 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:15:55.577336 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522fbb5-5ec1-4ce0-83d0-d0548294f913 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:15:55.580018 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 659/1323] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:15:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:15:55.585197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bc722-bb85-4d02-a5d9-cd4d7e09a967 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:15:55.585622 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bc722-bb85-4d02-a5d9-cd4d7e09a967 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:15:55.585752 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bc722-bb85-4d02-a5d9-cd4d7e09a967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:15:55.651647 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-835bc722-bb85-4d02-a5d9-cd4d7e09a967 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:15:55.652842 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-835bc722-bb85-4d02-a5d9-cd4d7e09a967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:15:55.710690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:15:55.750897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 665/1324] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:15:56.034167 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522fbb5-5ec1-4ce0-83d0-d0548294f913 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:15:56.035774 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-f522fbb5-5ec1-4ce0-83d0-d0548294f913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:15:56.143116 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522fbb5-5ec1-4ce0-83d0-d0548294f913 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:15:56.155575 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:15:56.217872 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a8272-0632-4a49-bb03-2854076fc633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:15:56.218448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a8272-0632-4a49-bb03-2854076fc633 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:15:56.218699 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a8272-0632-4a49-bb03-2854076fc633 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:15:56.218970 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a8272-0632-4a49-bb03-2854076fc633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:15:56.220597 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-844a8272-0632-4a49-bb03-2854076fc633 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:15:56.331674 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a8272-0632-4a49-bb03-2854076fc633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:15:56.333046 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a8272-0632-4a49-bb03-2854076fc633 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:15:56.351157 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 660/1325] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:15:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:15:58.295319 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b78333-d088-478e-8cf8-136bc850b85c None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:15:58.295821 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b78333-d088-478e-8cf8-136bc850b85c None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:15:58.295821 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b78333-d088-478e-8cf8-136bc850b85c None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:15:58.297290 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 666/1326] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:15:58.302423 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f49468-5b79-4479-b4f0-b17c7edc04b5 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:15:58.302814 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f49468-5b79-4479-b4f0-b17c7edc04b5 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:15:58.303104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f49468-5b79-4479-b4f0-b17c7edc04b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:15:58.351672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:15:58.369511 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-81f49468-5b79-4479-b4f0-b17c7edc04b5 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:15:58.370732 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-81f49468-5b79-4479-b4f0-b17c7edc04b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:15:58.468547 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 661/1327] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:15:58.759099 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b78333-d088-478e-8cf8-136bc850b85c None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:15:58.760642 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-79b78333-d088-478e-8cf8-136bc850b85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:15:58.864510 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b78333-d088-478e-8cf8-136bc850b85c None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:15:58.947680 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfafe3b-0c18-4c85-8f64-4c9473f7aeb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:15:58.948291 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfafe3b-0c18-4c85-8f64-4c9473f7aeb6 service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:15:58.948574 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfafe3b-0c18-4c85-8f64-4c9473f7aeb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:15:58.948841 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfafe3b-0c18-4c85-8f64-4c9473f7aeb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:15:58.950530 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-cdfafe3b-0c18-4c85-8f64-4c9473f7aeb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:15:58.970259 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:15:59.062368 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfafe3b-0c18-4c85-8f64-4c9473f7aeb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:15:59.064061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfafe3b-0c18-4c85-8f64-4c9473f7aeb6 service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:15:59.082657 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 667/1328] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:15:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:16:01.051448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679c21c-be94-45bb-82bf-946db7ba1730 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:01.051974 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679c21c-be94-45bb-82bf-946db7ba1730 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:01.051974 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679c21c-be94-45bb-82bf-946db7ba1730 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:01.053343 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 662/1329] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:16:01.058858 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8a894-04af-4ce7-8e50-1580bce17b81 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:01.059351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8a894-04af-4ce7-8e50-1580bce17b81 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:01.059463 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8a894-04af-4ce7-8e50-1580bce17b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:01.127894 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-fae8a894-04af-4ce7-8e50-1580bce17b81 None None] MFA Rules not processed for user `93456d60ff574c9a8ee4661d1bbe9633`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:16:01.129153 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-fae8a894-04af-4ce7-8e50-1580bce17b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:01.197472 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:01.229205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 668/1330] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:16:01 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:16:01.522332 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679c21c-be94-45bb-82bf-946db7ba1730 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:16:01.523830 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-2679c21c-be94-45bb-82bf-946db7ba1730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:01.639814 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679c21c-be94-45bb-82bf-946db7ba1730 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:16:01.660096 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:01.714161 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb3c91-a59d-41ab-a47c-6f5c18deff64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:16:01.714800 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb3c91-a59d-41ab-a47c-6f5c18deff64 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:01.715082 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb3c91-a59d-41ab-a47c-6f5c18deff64 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:01.715353 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb3c91-a59d-41ab-a47c-6f5c18deff64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:01.717478 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-01eb3c91-a59d-41ab-a47c-6f5c18deff64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:01.826899 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb3c91-a59d-41ab-a47c-6f5c18deff64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:16:01.828284 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb3c91-a59d-41ab-a47c-6f5c18deff64 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:16:01.846807 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 663/1331] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:16:01 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:16:04.254274 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a88c2a-b951-45c3-a244-36048bc274b0 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:04.254783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a88c2a-b951-45c3-a244-36048bc274b0 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:04.254783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a88c2a-b951-45c3-a244-36048bc274b0 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:04.256096 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 669/1332] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:16:04.261320 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a11358-78f3-4572-b4c0-4d81ca068160 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:04.261745 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a11358-78f3-4572-b4c0-4d81ca068160 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:04.261885 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a11358-78f3-4572-b4c0-4d81ca068160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:04.326461 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:04.329247 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-c7a11358-78f3-4572-b4c0-4d81ca068160 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:16:04.330491 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c7a11358-78f3-4572-b4c0-4d81ca068160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:04.425949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 664/1333] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:16:04.705175 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a88c2a-b951-45c3-a244-36048bc274b0 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:16:04.706709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-11a88c2a-b951-45c3-a244-36048bc274b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:04.808196 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a88c2a-b951-45c3-a244-36048bc274b0 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:16:04.879003 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00122c-6a0c-4bb5-8096-bd30f39444ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:16:04.879601 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00122c-6a0c-4bb5-8096-bd30f39444ac service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:04.879879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00122c-6a0c-4bb5-8096-bd30f39444ac service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:04.880149 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00122c-6a0c-4bb5-8096-bd30f39444ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:04.881741 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-2b00122c-6a0c-4bb5-8096-bd30f39444ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:04.907709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:04.990909 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00122c-6a0c-4bb5-8096-bd30f39444ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:16:04.992353 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00122c-6a0c-4bb5-8096-bd30f39444ac service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:16:05.010414 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 670/1334] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:16:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:16:06.945533 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11f7fb-11e2-486b-8843-0c331d9b8b79 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:06.946066 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11f7fb-11e2-486b-8843-0c331d9b8b79 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:06.946066 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11f7fb-11e2-486b-8843-0c331d9b8b79 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:06.947478 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 665/1335] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:16:06.953472 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd150b1f-1725-42c6-950b-b0165d6b89be None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:06.953890 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd150b1f-1725-42c6-950b-b0165d6b89be None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:06.954677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd150b1f-1725-42c6-950b-b0165d6b89be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:07.019512 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-cd150b1f-1725-42c6-950b-b0165d6b89be None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:16:07.020714 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-cd150b1f-1725-42c6-950b-b0165d6b89be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:07.094767 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:07.116594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 671/1336] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:16:07.399675 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11f7fb-11e2-486b-8843-0c331d9b8b79 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:16:07.401248 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-5d11f7fb-11e2-486b-8843-0c331d9b8b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:07.504917 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11f7fb-11e2-486b-8843-0c331d9b8b79 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:16:07.532310 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:07.577491 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9746c2-7f67-4997-b0fe-1273105da6ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:16:07.578098 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9746c2-7f67-4997-b0fe-1273105da6ff service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:07.578383 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9746c2-7f67-4997-b0fe-1273105da6ff service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:07.578661 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9746c2-7f67-4997-b0fe-1273105da6ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:07.580285 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-4d9746c2-7f67-4997-b0fe-1273105da6ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:07.687100 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9746c2-7f67-4997-b0fe-1273105da6ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:16:07.688718 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9746c2-7f67-4997-b0fe-1273105da6ff service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:16:07.707005 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 666/1337] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:16:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:16:10.139454 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a6ad5-e69e-47c3-9748-2d2f4f2eeb85 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:10.140020 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a6ad5-e69e-47c3-9748-2d2f4f2eeb85 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:10.140020 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a6ad5-e69e-47c3-9748-2d2f4f2eeb85 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:10.141386 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 672/1338] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:16:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:16:10.146573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58387c9f-e84f-4103-85b4-fc183748e308 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:10.146962 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58387c9f-e84f-4103-85b4-fc183748e308 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:10.147128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58387c9f-e84f-4103-85b4-fc183748e308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:10.213245 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-58387c9f-e84f-4103-85b4-fc183748e308 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:16:10.214371 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-58387c9f-e84f-4103-85b4-fc183748e308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:10.222612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:10.308923 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 667/1339] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:16:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:16:10.594164 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a6ad5-e69e-47c3-9748-2d2f4f2eeb85 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:16:10.595730 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-951a6ad5-e69e-47c3-9748-2d2f4f2eeb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:10.703402 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a6ad5-e69e-47c3-9748-2d2f4f2eeb85 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:16:10.775540 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9affbd-a2c6-410f-9220-e6ace463e0f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:16:10.776144 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9affbd-a2c6-410f-9220-e6ace463e0f6 service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:10.776421 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9affbd-a2c6-410f-9220-e6ace463e0f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:10.776691 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9affbd-a2c6-410f-9220-e6ace463e0f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:10.778803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-6d9affbd-a2c6-410f-9220-e6ace463e0f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:10.813480 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:10.886247 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9affbd-a2c6-410f-9220-e6ace463e0f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:16:10.887689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9affbd-a2c6-410f-9220-e6ace463e0f6 service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:16:10.907978 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 673/1340] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:16:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:16:14.988111 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c48181-ff37-4b95-bd77-cb3e30add668 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:14.988631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c48181-ff37-4b95-bd77-cb3e30add668 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:14.988726 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c48181-ff37-4b95-bd77-cb3e30add668 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:14.990053 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 668/1341] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:16:14.995339 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af01f7-179c-4fe1-b0c2-098c40a26702 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:14.995802 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af01f7-179c-4fe1-b0c2-098c40a26702 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:14.995900 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af01f7-179c-4fe1-b0c2-098c40a26702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:15.062072 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-a0af01f7-179c-4fe1-b0c2-098c40a26702 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:16:15.063551 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-a0af01f7-179c-4fe1-b0c2-098c40a26702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:15.152824 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:15.164013 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 674/1342] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:16:15.454356 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c48181-ff37-4b95-bd77-cb3e30add668 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:16:15.455967 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-94c48181-ff37-4b95-bd77-cb3e30add668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:15.560160 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c48181-ff37-4b95-bd77-cb3e30add668 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:16:15.597664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:15.634072 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1a2a3-2b3b-4652-9eef-9e889d89e63e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:16:15.634689 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1a2a3-2b3b-4652-9eef-9e889d89e63e service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:15.634968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1a2a3-2b3b-4652-9eef-9e889d89e63e service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:15.635238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1a2a3-2b3b-4652-9eef-9e889d89e63e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:15.636846 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-f5e1a2a3-2b3b-4652-9eef-9e889d89e63e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:15.747684 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e1a2a3-2b3b-4652-9eef-9e889d89e63e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:16:15.749040 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e1a2a3-2b3b-4652-9eef-9e889d89e63e service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:16:15.767336 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 669/1343] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:16:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:16:18.688758 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6346d0-6873-4449-8efd-c15346a50276 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:18.689384 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6346d0-6873-4449-8efd-c15346a50276 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:18.689384 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6346d0-6873-4449-8efd-c15346a50276 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:18.690709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 675/1344] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:16:18.696052 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2829baf-1cc7-444d-b2e1-70299e44a16c None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:18.696468 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2829baf-1cc7-444d-b2e1-70299e44a16c None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:18.696606 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2829baf-1cc7-444d-b2e1-70299e44a16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:18.762934 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-d2829baf-1cc7-444d-b2e1-70299e44a16c None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:16:18.764018 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-d2829baf-1cc7-444d-b2e1-70299e44a16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:18.782609 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:18.863347 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 670/1345] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:16:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:16:19.144029 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6346d0-6873-4449-8efd-c15346a50276 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:16:19.145597 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-ae6346d0-6873-4449-8efd-c15346a50276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:19.254678 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6346d0-6873-4449-8efd-c15346a50276 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:16:19.331433 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a71594-c032-4e1c-a6e6-62fa5aef68dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:16:19.332056 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a71594-c032-4e1c-a6e6-62fa5aef68dc service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:19.332337 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a71594-c032-4e1c-a6e6-62fa5aef68dc service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:19.332831 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a71594-c032-4e1c-a6e6-62fa5aef68dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:19.334338 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-64a71594-c032-4e1c-a6e6-62fa5aef68dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:19.378995 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:19.453851 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a71594-c032-4e1c-a6e6-62fa5aef68dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:16:19.455336 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a71594-c032-4e1c-a6e6-62fa5aef68dc service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:16:19.475945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 676/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:16:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:16:23.600695 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39f2c4-3408-4ec6-ae05-2d1b416f81ca None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:23.601251 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39f2c4-3408-4ec6-ae05-2d1b416f81ca None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:23.601383 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39f2c4-3408-4ec6-ae05-2d1b416f81ca None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:23.602696 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 671/1347] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:16:23.608257 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e430ff6-4168-48fb-a943-d1efdd67d078 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:23.608702 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e430ff6-4168-48fb-a943-d1efdd67d078 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:23.608810 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e430ff6-4168-48fb-a943-d1efdd67d078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:23.678595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-8e430ff6-4168-48fb-a943-d1efdd67d078 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:16:23.679733 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-8e430ff6-4168-48fb-a943-d1efdd67d078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:23.782289 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:23.785032 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 677/1348] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:16:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:16:24.067895 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39f2c4-3408-4ec6-ae05-2d1b416f81ca None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:16:24.069511 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-5d39f2c4-3408-4ec6-ae05-2d1b416f81ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:24.186162 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39f2c4-3408-4ec6-ae05-2d1b416f81ca None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:16:24.235530 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:24.261005 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb85dc-ec40-47e0-993f-dee151fa3a44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:16:24.261643 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb85dc-ec40-47e0-993f-dee151fa3a44 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:24.261922 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb85dc-ec40-47e0-993f-dee151fa3a44 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:24.262192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb85dc-ec40-47e0-993f-dee151fa3a44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:24.263788 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-73fb85dc-ec40-47e0-993f-dee151fa3a44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:24.378982 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb85dc-ec40-47e0-993f-dee151fa3a44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:16:24.380401 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb85dc-ec40-47e0-993f-dee151fa3a44 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:16:24.398217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 672/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:16:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:16:29.277898 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252710c4-c35b-4f8c-ac18-8e72974413dd None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:29.278448 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252710c4-c35b-4f8c-ac18-8e72974413dd None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:29.278568 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252710c4-c35b-4f8c-ac18-8e72974413dd None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:29.279857 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 678/1350] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 23 04:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:16:29.285532 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3204f-eff2-4871-963c-068e4c56038a None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:29.285943 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3204f-eff2-4871-963c-068e4c56038a None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:29.286094 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3204f-eff2-4871-963c-068e4c56038a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:29.391982 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-0da3204f-eff2-4871-963c-068e4c56038a None None] MFA Rules not processed for user `34794124b7234aeb98a15f0c2ae06a0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:16:29.393219 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-0da3204f-eff2-4871-963c-068e4c56038a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:29.412865 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:29.548681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 673/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 23 04:16:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:16:33.673971 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3d9af-fb7b-4c6b-935e-47b4863d35d6 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:33.674507 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3d9af-fb7b-4c6b-935e-47b4863d35d6 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:33.674507 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3d9af-fb7b-4c6b-935e-47b4863d35d6 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:33.676163 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 679/1352] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 23 04:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:16:33.681841 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b74de-4c87-4ec6-8efe-ea0716e0edfe None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:33.682250 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b74de-4c87-4ec6-8efe-ea0716e0edfe None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:33.682381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b74de-4c87-4ec6-8efe-ea0716e0edfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:33.763229 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-b86b74de-4c87-4ec6-8efe-ea0716e0edfe None None] MFA Rules not processed for user `34794124b7234aeb98a15f0c2ae06a0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:16:33.764772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-b86b74de-4c87-4ec6-8efe-ea0716e0edfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:33.842518 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:33.879130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 674/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 23 04:16:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:16:35.193453 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a6fa8-f8d9-437d-b2e2-4c1b27496c7e None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:35.194017 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a6fa8-f8d9-437d-b2e2-4c1b27496c7e None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:35.194017 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a6fa8-f8d9-437d-b2e2-4c1b27496c7e None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:35.195345 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 680/1354] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 23 04:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:16:35.200381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89cfc4-a8f1-4b53-a889-0bf3071d01e3 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:35.200795 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89cfc4-a8f1-4b53-a889-0bf3071d01e3 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:35.201033 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89cfc4-a8f1-4b53-a889-0bf3071d01e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:35.276419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-6f89cfc4-a8f1-4b53-a889-0bf3071d01e3 None None] MFA Rules not processed for user `34794124b7234aeb98a15f0c2ae06a0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:16:35.277597 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-6f89cfc4-a8f1-4b53-a889-0bf3071d01e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:35.384761 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 675/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 23 04:16:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:16:38.835613 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f89c3c-6ea0-4daf-9b93-8270a8e21eab None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:38.836059 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f89c3c-6ea0-4daf-9b93-8270a8e21eab None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:38.836173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f89c3c-6ea0-4daf-9b93-8270a8e21eab None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:38.837518 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 681/1356] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:16:38.844119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83020923-03cc-4645-be9f-e05dfc5916e2 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:38.845112 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83020923-03cc-4645-be9f-e05dfc5916e2 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:38.845444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83020923-03cc-4645-be9f-e05dfc5916e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:38.887399 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:38.933550 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-83020923-03cc-4645-be9f-e05dfc5916e2 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:16:38.935080 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-83020923-03cc-4645-be9f-e05dfc5916e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:39.068816 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 676/1357] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:16:39.366049 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d132baa-8c2e-4115-9084-172fd6009064 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:39.366627 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d132baa-8c2e-4115-9084-172fd6009064 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:39.367154 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d132baa-8c2e-4115-9084-172fd6009064 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:39.368882 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 682/1358] 10.222.0.42 () {54 vars in 962 bytes} [Tue Aug 23 04:16:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:16:39.377424 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791dffa-a549-4d08-89c8-5d3bc60ea5c4 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:39.377868 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791dffa-a549-4d08-89c8-5d3bc60ea5c4 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:39.378156 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791dffa-a549-4d08-89c8-5d3bc60ea5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:39.460109 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-b791dffa-a549-4d08-89c8-5d3bc60ea5c4 None None] MFA Rules not processed for user `1e0236a0acac4b87be977878b5186551`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:16:39.461312 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-b791dffa-a549-4d08-89c8-5d3bc60ea5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:39.513876 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:39.583835 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 677/1359] 10.222.0.42 () {58 vars in 1059 bytes} [Tue Aug 23 04:16:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:16:39.592002 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d132baa-8c2e-4115-9084-172fd6009064 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:16:39.593762 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-3d132baa-8c2e-4115-9084-172fd6009064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:39.757194 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d132baa-8c2e-4115-9084-172fd6009064 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:16:39.836245 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:39.881131 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad58bc-7bfe-48f0-a371-bc62322b0845 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:16:39.882059 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad58bc-7bfe-48f0-a371-bc62322b0845 service nova] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:39.882343 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad58bc-7bfe-48f0-a371-bc62322b0845 service nova] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:39.882618 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad58bc-7bfe-48f0-a371-bc62322b0845 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:39.884264 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-59ad58bc-7bfe-48f0-a371-bc62322b0845 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:39.983435 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad58bc-7bfe-48f0-a371-bc62322b0845 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:16:39.985051 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad58bc-7bfe-48f0-a371-bc62322b0845 service nova] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:16:40.005134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 683/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:16:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:16:42.112102 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb87980-b570-4dfc-a5ce-b0bb0270c536 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:42.112650 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb87980-b570-4dfc-a5ce-b0bb0270c536 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:42.112650 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb87980-b570-4dfc-a5ce-b0bb0270c536 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:42.114036 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 678/1361] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:16:42.119805 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bba35c-1351-4e7a-b80f-e2fc4874ceca None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:42.120752 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bba35c-1351-4e7a-b80f-e2fc4874ceca None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:42.121033 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bba35c-1351-4e7a-b80f-e2fc4874ceca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:42.193351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-f6bba35c-1351-4e7a-b80f-e2fc4874ceca None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:16:42.194707 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-f6bba35c-1351-4e7a-b80f-e2fc4874ceca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:42.234494 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:42.297816 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 684/1362] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:16:42.600677 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb87980-b570-4dfc-a5ce-b0bb0270c536 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:16:42.600677 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-cdb87980-b570-4dfc-a5ce-b0bb0270c536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:42.769111 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb87980-b570-4dfc-a5ce-b0bb0270c536 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:16:42.778571 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:42.890817 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba1418-21b4-4da5-90c3-bc2b376b7024 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:16:42.891433 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba1418-21b4-4da5-90c3-bc2b376b7024 service nova] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:42.891900 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba1418-21b4-4da5-90c3-bc2b376b7024 service nova] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:42.892168 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba1418-21b4-4da5-90c3-bc2b376b7024 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:42.894006 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-62ba1418-21b4-4da5-90c3-bc2b376b7024 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:43.015226 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba1418-21b4-4da5-90c3-bc2b376b7024 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:16:43.017177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba1418-21b4-4da5-90c3-bc2b376b7024 service nova] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:16:43.038561 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 679/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:16:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:16:45.405926 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b93a7-8053-45f4-8f0a-7b6d68e044d6 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:45.406826 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b93a7-8053-45f4-8f0a-7b6d68e044d6 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:45.407108 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b93a7-8053-45f4-8f0a-7b6d68e044d6 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:45.408469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 685/1364] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:16:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:16:45.413793 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6ca65-90c5-4b23-ad6a-3906550f9ef6 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:45.414217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6ca65-90c5-4b23-ad6a-3906550f9ef6 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:45.414385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6ca65-90c5-4b23-ad6a-3906550f9ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:45.430649 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:45.484355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-6dc6ca65-90c5-4b23-ad6a-3906550f9ef6 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:16:45.485606 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-6dc6ca65-90c5-4b23-ad6a-3906550f9ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:45.609649 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 680/1365] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:16:45.888529 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804ad60-5953-4817-9755-d9b190b68751 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:45.888844 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804ad60-5953-4817-9755-d9b190b68751 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:45.889076 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804ad60-5953-4817-9755-d9b190b68751 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:45.890563 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 686/1366] 10.222.0.42 () {54 vars in 962 bytes} [Tue Aug 23 04:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:16:45.897287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e44cf0-d39d-47de-af17-5d6466c92938 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:45.897699 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e44cf0-d39d-47de-af17-5d6466c92938 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:45.898081 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e44cf0-d39d-47de-af17-5d6466c92938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:45.985540 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-61e44cf0-d39d-47de-af17-5d6466c92938 None None] MFA Rules not processed for user `1e0236a0acac4b87be977878b5186551`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:16:45.986932 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-61e44cf0-d39d-47de-af17-5d6466c92938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:46.024887 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:46.115157 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 681/1367] 10.222.0.42 () {58 vars in 1059 bytes} [Tue Aug 23 04:16:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:16:46.125848 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804ad60-5953-4817-9755-d9b190b68751 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:16:46.127304 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-a804ad60-5953-4817-9755-d9b190b68751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:46.285541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804ad60-5953-4817-9755-d9b190b68751 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:16:46.306797 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:46.411438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec8d1b-0727-405f-ae52-273a523befb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:16:46.412241 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec8d1b-0727-405f-ae52-273a523befb1 service nova] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:46.412627 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec8d1b-0727-405f-ae52-273a523befb1 service nova] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:46.413025 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec8d1b-0727-405f-ae52-273a523befb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:46.414939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-b6ec8d1b-0727-405f-ae52-273a523befb1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:46.508832 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec8d1b-0727-405f-ae52-273a523befb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:16:46.510801 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec8d1b-0727-405f-ae52-273a523befb1 service nova] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:16:46.530905 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 687/1368] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:16:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:16:47.006405 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4e1ed-dd2b-4d86-a0ea-6bc9c47afb79 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:47.007614 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4e1ed-dd2b-4d86-a0ea-6bc9c47afb79 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:47.007614 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4e1ed-dd2b-4d86-a0ea-6bc9c47afb79 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:47.008802 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 682/1369] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:16:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:16:47.065212 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c663a22-47f1-49ec-b5a4-bbd52a6875a8 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:47.065212 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c663a22-47f1-49ec-b5a4-bbd52a6875a8 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:47.065212 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c663a22-47f1-49ec-b5a4-bbd52a6875a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:47.065212 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:47.088021 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-9c663a22-47f1-49ec-b5a4-bbd52a6875a8 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:16:47.089316 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-9c663a22-47f1-49ec-b5a4-bbd52a6875a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:47.200763 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 688/1370] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:16:47.814327 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a0fbd-2b46-405b-ae08-97fa7e7799d1 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:47.814893 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a0fbd-2b46-405b-ae08-97fa7e7799d1 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:47.815332 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a0fbd-2b46-405b-ae08-97fa7e7799d1 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:47.816869 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 683/1371] 10.222.0.42 () {54 vars in 964 bytes} [Tue Aug 23 04:16:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:16:47.822224 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdcb68-bc0d-4d66-ab43-2a8ad96fe899 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:47.823027 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdcb68-bc0d-4d66-ab43-2a8ad96fe899 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:47.823469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdcb68-bc0d-4d66-ab43-2a8ad96fe899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:47.906005 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-fdfdcb68-bc0d-4d66-ab43-2a8ad96fe899 None None] MFA Rules not processed for user `a0b0ac2dd135450c9bfe918f98c19425`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:16:47.907308 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-fdfdcb68-bc0d-4d66-ab43-2a8ad96fe899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:47.960656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:47.985547 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 689/1372] 10.222.0.42 () {58 vars in 1061 bytes} [Tue Aug 23 04:16:47 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:16:47.992943 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a0fbd-2b46-405b-ae08-97fa7e7799d1 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:16:47.994489 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-e64a0fbd-2b46-405b-ae08-97fa7e7799d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:48.103325 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a0fbd-2b46-405b-ae08-97fa7e7799d1 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:16:48.147894 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:48.182871 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b77ba7-9372-4c8a-83c2-71155715b7fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:16:48.183508 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b77ba7-9372-4c8a-83c2-71155715b7fc service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:48.183787 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b77ba7-9372-4c8a-83c2-71155715b7fc service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:48.184059 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b77ba7-9372-4c8a-83c2-71155715b7fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:48.185687 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-26b77ba7-9372-4c8a-83c2-71155715b7fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:48.306783 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b77ba7-9372-4c8a-83c2-71155715b7fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:16:48.308555 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b77ba7-9372-4c8a-83c2-71155715b7fc service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:16:48.329363 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 684/1373] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:16:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:16:48.634154 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce735c30-7659-4b3b-b4a5-21a4d8b2e872 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:48.634442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce735c30-7659-4b3b-b4a5-21a4d8b2e872 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:48.634716 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce735c30-7659-4b3b-b4a5-21a4d8b2e872 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:48.636067 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 690/1374] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:16:48.641892 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf99ff7-5c57-41b8-be2f-96ca9cd07325 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:48.642204 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf99ff7-5c57-41b8-be2f-96ca9cd07325 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:48.642469 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf99ff7-5c57-41b8-be2f-96ca9cd07325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:48.708443 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-eaf99ff7-5c57-41b8-be2f-96ca9cd07325 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:16:48.709669 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-eaf99ff7-5c57-41b8-be2f-96ca9cd07325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:48.730419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:48.805536 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 685/1375] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:16:49.089507 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce735c30-7659-4b3b-b4a5-21a4d8b2e872 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:16:49.091028 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-ce735c30-7659-4b3b-b4a5-21a4d8b2e872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:49.242262 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce735c30-7659-4b3b-b4a5-21a4d8b2e872 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:16:49.294665 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:49.357722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d0463-a3e9-4e38-9108-1d409580491a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:16:49.358339 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d0463-a3e9-4e38-9108-1d409580491a service nova] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:49.358621 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d0463-a3e9-4e38-9108-1d409580491a service nova] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:49.358896 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d0463-a3e9-4e38-9108-1d409580491a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:49.360506 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-f85d0463-a3e9-4e38-9108-1d409580491a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:49.452415 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d0463-a3e9-4e38-9108-1d409580491a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:16:49.454047 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d0463-a3e9-4e38-9108-1d409580491a service nova] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:16:49.471798 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 691/1376] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:16:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:16:51.568091 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c6ad2-7a2d-4849-bfb4-cfdc256fc762 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:51.568582 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c6ad2-7a2d-4849-bfb4-cfdc256fc762 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:51.568582 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c6ad2-7a2d-4849-bfb4-cfdc256fc762 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:51.569939 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 686/1377] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:16:51.575945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab882bd-3a69-4535-86fe-1c2ee7faf49c None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:51.576381 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab882bd-3a69-4535-86fe-1c2ee7faf49c None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:51.576763 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab882bd-3a69-4535-86fe-1c2ee7faf49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:51.642794 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-5ab882bd-3a69-4535-86fe-1c2ee7faf49c None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:16:51.643998 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-5ab882bd-3a69-4535-86fe-1c2ee7faf49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:51.651167 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:51.741120 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 692/1378] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:16:52.043711 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c6ad2-7a2d-4849-bfb4-cfdc256fc762 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:16:52.047673 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-ad8c6ad2-7a2d-4849-bfb4-cfdc256fc762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:52.217717 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c6ad2-7a2d-4849-bfb4-cfdc256fc762 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:16:52.221813 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:52.345502 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba961e81-aaad-45df-9101-484378d1bd6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:16:52.346248 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba961e81-aaad-45df-9101-484378d1bd6d service nova] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:52.347430 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba961e81-aaad-45df-9101-484378d1bd6d service nova] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:52.347430 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba961e81-aaad-45df-9101-484378d1bd6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:52.348531 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-ba961e81-aaad-45df-9101-484378d1bd6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:52.451394 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba961e81-aaad-45df-9101-484378d1bd6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:16:52.453143 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba961e81-aaad-45df-9101-484378d1bd6d service nova] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:16:52.473763 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 687/1379] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:16:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:16:54.564780 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61170dc8-8e56-4535-8a41-702adce5963d None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:54.565359 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61170dc8-8e56-4535-8a41-702adce5963d None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:54.565359 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61170dc8-8e56-4535-8a41-702adce5963d None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:54.566973 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 693/1380] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:16:54.572208 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2a2aa-90e4-4c94-8f8d-401fc698d32f None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:54.572612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2a2aa-90e4-4c94-8f8d-401fc698d32f None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:54.572819 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2a2aa-90e4-4c94-8f8d-401fc698d32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:54.585167 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:54.643861 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-64c2a2aa-90e4-4c94-8f8d-401fc698d32f None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:16:54.645071 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-64c2a2aa-90e4-4c94-8f8d-401fc698d32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:54.749613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 688/1381] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:16:55.043808 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61170dc8-8e56-4535-8a41-702adce5963d None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:16:55.045357 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-61170dc8-8e56-4535-8a41-702adce5963d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:55.195182 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:55.207114 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61170dc8-8e56-4535-8a41-702adce5963d None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:16:55.329242 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684279ec-c288-4123-94de-7d47c9b3b365 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:16:55.329874 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684279ec-c288-4123-94de-7d47c9b3b365 service nova] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:55.330147 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684279ec-c288-4123-94de-7d47c9b3b365 service nova] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:55.330428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684279ec-c288-4123-94de-7d47c9b3b365 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:55.332019 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-684279ec-c288-4123-94de-7d47c9b3b365 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:55.430390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684279ec-c288-4123-94de-7d47c9b3b365 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:16:55.432651 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684279ec-c288-4123-94de-7d47c9b3b365 service nova] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:16:55.445318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:55.454561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 694/1382] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:16:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:16:57.530396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a9d22-992b-4fd3-bea0-4063fb22ae99 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:57.530949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a9d22-992b-4fd3-bea0-4063fb22ae99 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:57.530949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a9d22-992b-4fd3-bea0-4063fb22ae99 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:57.532593 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 689/1383] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:16:57.538345 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe83917-e597-483f-8532-38b70703488c None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:57.538933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe83917-e597-483f-8532-38b70703488c None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:57.538933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe83917-e597-483f-8532-38b70703488c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:57.607059 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-9fe83917-e597-483f-8532-38b70703488c None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:16:57.608302 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-9fe83917-e597-483f-8532-38b70703488c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:57.714296 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 695/1384] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:16:58.012685 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a9d22-992b-4fd3-bea0-4063fb22ae99 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:16:58.014345 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-378a9d22-992b-4fd3-bea0-4063fb22ae99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:58.120611 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:58.187801 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a9d22-992b-4fd3-bea0-4063fb22ae99 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:16:58.317786 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4990fc-7175-4bb6-8727-6d21fb66229a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:16:58.318267 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4990fc-7175-4bb6-8727-6d21fb66229a service nova] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:16:58.318555 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4990fc-7175-4bb6-8727-6d21fb66229a service nova] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:16:58.318835 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4990fc-7175-4bb6-8727-6d21fb66229a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:16:58.320496 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-8e4990fc-7175-4bb6-8727-6d21fb66229a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:16:58.380827 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:16:58.429264 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4990fc-7175-4bb6-8727-6d21fb66229a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:16:58.430891 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4990fc-7175-4bb6-8727-6d21fb66229a service nova] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:16:58.451051 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 690/1385] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:16:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:17:00.678785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6526c54-777a-4c0c-b82e-33488b4be10e None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:00.679326 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6526c54-777a-4c0c-b82e-33488b4be10e None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:00.679498 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6526c54-777a-4c0c-b82e-33488b4be10e None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:00.681331 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 696/1386] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:17:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:17:00.688026 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0383d-8fae-496c-98a8-a18d5f6faedb None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:00.688438 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0383d-8fae-496c-98a8-a18d5f6faedb None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:00.688619 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0383d-8fae-496c-98a8-a18d5f6faedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:00.754612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-90b0383d-8fae-496c-98a8-a18d5f6faedb None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:17:00.755806 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-90b0383d-8fae-496c-98a8-a18d5f6faedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:00.857408 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 691/1387] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:17:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:17:01.220802 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6526c54-777a-4c0c-b82e-33488b4be10e None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:17:01.222320 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-e6526c54-777a-4c0c-b82e-33488b4be10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:01.302811 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:01.381664 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6526c54-777a-4c0c-b82e-33488b4be10e None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:17:01.508758 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ff212-b23d-4401-94d6-37762e7feb1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:17:01.509490 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ff212-b23d-4401-94d6-37762e7feb1d service nova] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:01.509840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ff212-b23d-4401-94d6-37762e7feb1d service nova] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:01.510187 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ff212-b23d-4401-94d6-37762e7feb1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:01.513049 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-783ff212-b23d-4401-94d6-37762e7feb1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:01.563110 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:01.629640 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ff212-b23d-4401-94d6-37762e7feb1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:17:01.631244 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ff212-b23d-4401-94d6-37762e7feb1d service nova] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:17:01.650371 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 697/1388] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:17:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:17:03.556919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff679709-5608-44ef-aa74-1b1d215ddf97 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:03.558123 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff679709-5608-44ef-aa74-1b1d215ddf97 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:03.558233 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff679709-5608-44ef-aa74-1b1d215ddf97 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:03.559515 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 692/1389] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:17:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:17:03.565155 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41801224-e822-4086-a2b0-0ffea530f5d3 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:03.565546 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41801224-e822-4086-a2b0-0ffea530f5d3 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:03.565725 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41801224-e822-4086-a2b0-0ffea530f5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:03.632212 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-41801224-e822-4086-a2b0-0ffea530f5d3 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:17:03.633449 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-41801224-e822-4086-a2b0-0ffea530f5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:03.678912 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7cd64-22cd-45d6-886c-0a42483b6653 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:03.679201 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7cd64-22cd-45d6-886c-0a42483b6653 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:03.679486 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7cd64-22cd-45d6-886c-0a42483b6653 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:03.681306 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 693/1390] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 04:17:03.686863 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4694ef6-04ab-4d16-a1e5-9dddbbcfb832 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:03.687405 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4694ef6-04ab-4d16-a1e5-9dddbbcfb832 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:03.687711 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4694ef6-04ab-4d16-a1e5-9dddbbcfb832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:03.722385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:03.733121 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 698/1391] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:17:03.754360 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-d4694ef6-04ab-4d16-a1e5-9dddbbcfb832 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:17:03.755566 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-d4694ef6-04ab-4d16-a1e5-9dddbbcfb832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:03.854070 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 694/1392] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:17:04.032670 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f1abf-2554-4a40-aa55-86a38eef1e7e None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:04.032961 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f1abf-2554-4a40-aa55-86a38eef1e7e None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:04.033298 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f1abf-2554-4a40-aa55-86a38eef1e7e None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:04.034646 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 699/1393] 10.222.0.42 () {54 vars in 967 bytes} [Tue Aug 23 04:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:17:04.039782 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9857843-09b9-47c9-a658-82441fb7dc42 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:04.040081 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9857843-09b9-47c9-a658-82441fb7dc42 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:04.040359 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9857843-09b9-47c9-a658-82441fb7dc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:04.117110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-d9857843-09b9-47c9-a658-82441fb7dc42 None None] MFA Rules not processed for user `020af86302e447a6b3973df4abbabafa`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:17:04.118248 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-d9857843-09b9-47c9-a658-82441fb7dc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:04.141082 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f1abf-2554-4a40-aa55-86a38eef1e7e None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:17:04.142632 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-4f2f1abf-2554-4a40-aa55-86a38eef1e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:04.156491 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:04.168310 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:04.202116 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 695/1394] 10.222.0.42 () {58 vars in 1064 bytes} [Tue Aug 23 04:17:04 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:17:04.209741 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9857843-09b9-47c9-a658-82441fb7dc42 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:17:04.218000 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9857843-09b9-47c9-a658-82441fb7dc42 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:17:04.292195 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f1abf-2554-4a40-aa55-86a38eef1e7e None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:17:04.292539 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb370f-b40f-4627-aaf2-3d9ac8bfb309 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '020af86302e447a6b3973df4abbabafa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:17:04.293176 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb370f-b40f-4627-aaf2-3d9ac8bfb309 service glance] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:04.293455 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb370f-b40f-4627-aaf2-3d9ac8bfb309 service glance] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:04.293726 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb370f-b40f-4627-aaf2-3d9ac8bfb309 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:04.295329 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-2beb370f-b40f-4627-aaf2-3d9ac8bfb309 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:04.388041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:04.411499 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb370f-b40f-4627-aaf2-3d9ac8bfb309 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:17:04.413344 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb370f-b40f-4627-aaf2-3d9ac8bfb309 service glance] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:17:04.419727 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1977b-5eb7-4e77-b16d-8bd933ef01b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:17:04.420352 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1977b-5eb7-4e77-b16d-8bd933ef01b0 service nova] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:04.420631 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1977b-5eb7-4e77-b16d-8bd933ef01b0 service nova] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:04.420951 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1977b-5eb7-4e77-b16d-8bd933ef01b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:04.422619 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-7ad1977b-5eb7-4e77-b16d-8bd933ef01b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:04.430392 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:04.436013 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 696/1395] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:17:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:17:04.530007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad1977b-5eb7-4e77-b16d-8bd933ef01b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:17:04.532029 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad1977b-5eb7-4e77-b16d-8bd933ef01b0 service nova] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:17:04.551874 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 700/1396] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:17:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:17:05.309439 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a2e3c-5793-469b-9e1e-5c482bc618ae None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:05.309970 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a2e3c-5793-469b-9e1e-5c482bc618ae None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:05.309970 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a2e3c-5793-469b-9e1e-5c482bc618ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:05.385733 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-833a2e3c-5793-469b-9e1e-5c482bc618ae None None] MFA Rules not processed for user `826b9a7c343b4dbc9aeb3dbc0b75fc92`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:17:05.386936 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-833a2e3c-5793-469b-9e1e-5c482bc618ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:05.476924 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 697/1397] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 23 04:17:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:17:05.518560 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2330f1d-a2f0-491c-bcfe-f31625d5a63d None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:05.519013 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2330f1d-a2f0-491c-bcfe-f31625d5a63d None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:05.519167 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2330f1d-a2f0-491c-bcfe-f31625d5a63d None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:05.520505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 701/1398] 10.222.0.42 () {54 vars in 943 bytes} [Tue Aug 23 04:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:17:05.528413 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710be585-0135-4b76-8c8c-0cb32a3c11d1 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:05.528736 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710be585-0135-4b76-8c8c-0cb32a3c11d1 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:05.529004 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710be585-0135-4b76-8c8c-0cb32a3c11d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:05.606619 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-710be585-0135-4b76-8c8c-0cb32a3c11d1 None None] MFA Rules not processed for user `63190c62bc92403880ffaedc4737485a`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:17:05.607752 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-710be585-0135-4b76-8c8c-0cb32a3c11d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:05.637378 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:05.718630 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 698/1399] 10.222.0.42 () {58 vars in 1040 bytes} [Tue Aug 23 04:17:05 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:17:05.727998 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2330f1d-a2f0-491c-bcfe-f31625d5a63d None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:17:05.729605 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-c2330f1d-a2f0-491c-bcfe-f31625d5a63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:05.827337 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:05.868592 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2330f1d-a2f0-491c-bcfe-f31625d5a63d None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:17:05.978612 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d8946-81c5-4358-b396-ee3ddcd9f7e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63190c62bc92403880ffaedc4737485a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:17:05.979236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d8946-81c5-4358-b396-ee3ddcd9f7e6 service swift] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:05.979515 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d8946-81c5-4358-b396-ee3ddcd9f7e6 service swift] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:05.979785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d8946-81c5-4358-b396-ee3ddcd9f7e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:05.981498 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-2d7d8946-81c5-4358-b396-ee3ddcd9f7e6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:06.065590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d8946-81c5-4358-b396-ee3ddcd9f7e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:17:06.067222 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d8946-81c5-4358-b396-ee3ddcd9f7e6 service swift] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:17:06.070680 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:06.076500 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 702/1400] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 23 04:17:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 04:17:06.614285 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9414e-2a82-4337-ba4c-1855dfa2601a None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:06.614854 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9414e-2a82-4337-ba4c-1855dfa2601a None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:06.615046 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9414e-2a82-4337-ba4c-1855dfa2601a None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:06.616527 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 699/1401] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:17:06.622501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c122e-ebf9-4863-aecf-6b73ec6dcebf None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:06.623370 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c122e-ebf9-4863-aecf-6b73ec6dcebf None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:06.623808 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c122e-ebf9-4863-aecf-6b73ec6dcebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:06.697019 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-f76c122e-ebf9-4863-aecf-6b73ec6dcebf None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:17:06.698412 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-f76c122e-ebf9-4863-aecf-6b73ec6dcebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:06.804445 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 703/1402] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:17:07.094174 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9414e-2a82-4337-ba4c-1855dfa2601a None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:17:07.095700 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-6fe9414e-2a82-4337-ba4c-1855dfa2601a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:07.259168 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9414e-2a82-4337-ba4c-1855dfa2601a None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:17:07.263685 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:07.390369 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a461cdf-bdf0-4dc6-b398-aac406072266 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:17:07.390991 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a461cdf-bdf0-4dc6-b398-aac406072266 service nova] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:07.391312 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a461cdf-bdf0-4dc6-b398-aac406072266 service nova] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:07.391725 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a461cdf-bdf0-4dc6-b398-aac406072266 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:07.393601 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-3a461cdf-bdf0-4dc6-b398-aac406072266 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:07.504053 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a461cdf-bdf0-4dc6-b398-aac406072266 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:17:07.505734 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a461cdf-bdf0-4dc6-b398-aac406072266 service nova] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:17:07.525544 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 700/1403] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:17:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:17:09.829346 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9615a4-405a-405e-9235-f9b4661b12ef None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:09.829903 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9615a4-405a-405e-9235-f9b4661b12ef None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:09.829903 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9615a4-405a-405e-9235-f9b4661b12ef None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:09.831415 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 704/1404] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:17:09.836656 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75276410-2a04-415a-8e76-f3f2aef856c4 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:09.837152 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75276410-2a04-415a-8e76-f3f2aef856c4 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:09.837253 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75276410-2a04-415a-8e76-f3f2aef856c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:09.847569 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:09.908586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-75276410-2a04-415a-8e76-f3f2aef856c4 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:17:09.909938 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-75276410-2a04-415a-8e76-f3f2aef856c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:10.030180 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 701/1405] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:17:10.327726 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9615a4-405a-405e-9235-f9b4661b12ef None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:17:10.329307 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-2b9615a4-405a-405e-9235-f9b4661b12ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:10.420057 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:10.493682 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9615a4-405a-405e-9235-f9b4661b12ef None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:17:10.623209 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc369a9-3902-445b-a2c2-480f609c9167 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:17:10.624091 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc369a9-3902-445b-a2c2-480f609c9167 service nova] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:10.624369 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc369a9-3902-445b-a2c2-480f609c9167 service nova] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:10.624639 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc369a9-3902-445b-a2c2-480f609c9167 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:10.626426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-adc369a9-3902-445b-a2c2-480f609c9167 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:10.670806 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:10.725669 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc369a9-3902-445b-a2c2-480f609c9167 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:17:10.727482 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc369a9-3902-445b-a2c2-480f609c9167 service nova] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:17:10.759186 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 705/1406] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:17:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:17:12.858007 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c6fa4-06d9-48d0-8826-8be0c4ec58af None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:12.858603 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c6fa4-06d9-48d0-8826-8be0c4ec58af None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:12.858603 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c6fa4-06d9-48d0-8826-8be0c4ec58af None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:12.860043 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 702/1407] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:17:12.865276 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c88a9f-2d18-473e-985b-d9217d03d63c None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:12.865714 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c88a9f-2d18-473e-985b-d9217d03d63c None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:12.865809 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c88a9f-2d18-473e-985b-d9217d03d63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:12.941831 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-79c88a9f-2d18-473e-985b-d9217d03d63c None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:17:12.947999 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-79c88a9f-2d18-473e-985b-d9217d03d63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:13.092097 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 706/1408] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:17:13.371610 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c6fa4-06d9-48d0-8826-8be0c4ec58af None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:17:13.373496 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-836c6fa4-06d9-48d0-8826-8be0c4ec58af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:13.501975 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:13.584955 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c6fa4-06d9-48d0-8826-8be0c4ec58af None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:17:13.740707 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de790f2-3677-4ec3-880b-8287c4cd7ce4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:17:13.741384 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de790f2-3677-4ec3-880b-8287c4cd7ce4 service nova] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:13.741665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de790f2-3677-4ec3-880b-8287c4cd7ce4 service nova] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:13.741938 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de790f2-3677-4ec3-880b-8287c4cd7ce4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:13.743574 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-0de790f2-3677-4ec3-880b-8287c4cd7ce4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:13.848153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de790f2-3677-4ec3-880b-8287c4cd7ce4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:17:13.849778 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de790f2-3677-4ec3-880b-8287c4cd7ce4 service nova] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:17:13.879792 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 703/1409] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:17:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:17:14.053827 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:23.073607 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=93 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:24.135180 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=24 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:29.472610 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86099c-073d-4c2c-99f3-af009c059bc7 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:29.473242 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86099c-073d-4c2c-99f3-af009c059bc7 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:29.473242 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86099c-073d-4c2c-99f3-af009c059bc7 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:29.474525 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 707/1410] 10.222.0.42 () {54 vars in 918 bytes} [Tue Aug 23 04:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:17:29.480200 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd472a-5ccd-4edb-b056-97c1701a3716 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:29.480637 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd472a-5ccd-4edb-b056-97c1701a3716 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:29.480938 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd472a-5ccd-4edb-b056-97c1701a3716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:29.557660 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-0ecd472a-5ccd-4edb-b056-97c1701a3716 None None] MFA Rules not processed for user `34794124b7234aeb98a15f0c2ae06a0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:17:29.558915 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-0ecd472a-5ccd-4edb-b056-97c1701a3716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:29.664697 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 704/1411] 10.222.0.42 () {58 vars in 1015 bytes} [Tue Aug 23 04:17:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:17:29.679237 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f37a9-36ef-4c26-b64b-a068185cb396 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:29.679542 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f37a9-36ef-4c26-b64b-a068185cb396 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:29.679817 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f37a9-36ef-4c26-b64b-a068185cb396 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:29.681174 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 708/1412] 10.222.0.42 () {54 vars in 918 bytes} [Tue Aug 23 04:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:17:29.685589 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabec4b-5a0b-4865-a796-97c0b56f6ff7 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:29.685888 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabec4b-5a0b-4865-a796-97c0b56f6ff7 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:29.686193 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabec4b-5a0b-4865-a796-97c0b56f6ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:29.757478 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:29.760835 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-bcabec4b-5a0b-4865-a796-97c0b56f6ff7 None None] MFA Rules not processed for user `1e0236a0acac4b87be977878b5186551`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:17:29.762129 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-bcabec4b-5a0b-4865-a796-97c0b56f6ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:29.877484 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 705/1413] 10.222.0.42 () {58 vars in 1015 bytes} [Tue Aug 23 04:17:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:17:32.225479 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f89d8-4081-4ee5-843a-1e6f82932c7f None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:32.225973 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f89d8-4081-4ee5-843a-1e6f82932c7f None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:32.225973 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f89d8-4081-4ee5-843a-1e6f82932c7f None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:32.227360 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 04:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:17:32.233452 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b8b06-5d4b-40df-88d5-97586911bde9 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:32.233859 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b8b06-5d4b-40df-88d5-97586911bde9 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:32.234145 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b8b06-5d4b-40df-88d5-97586911bde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:32.300316 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-586b8b06-5d4b-40df-88d5-97586911bde9 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:17:32.301546 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-586b8b06-5d4b-40df-88d5-97586911bde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:32.357613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:32.404492 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 04:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:17:32.697890 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f89d8-4081-4ee5-843a-1e6f82932c7f None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:17:32.699412 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-145f89d8-4081-4ee5-843a-1e6f82932c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:32.842872 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f89d8-4081-4ee5-843a-1e6f82932c7f None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:17:32.915054 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:32.954679 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4586374-4bff-43bd-8801-882805c3828f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:17:32.955224 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4586374-4bff-43bd-8801-882805c3828f service nova] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:32.955501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4586374-4bff-43bd-8801-882805c3828f service nova] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:32.955768 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4586374-4bff-43bd-8801-882805c3828f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:32.957406 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-a4586374-4bff-43bd-8801-882805c3828f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:33.046487 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4586374-4bff-43bd-8801-882805c3828f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:17:33.048084 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4586374-4bff-43bd-8801-882805c3828f service nova] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:17:33.066643 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 710/1416] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:17:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:17:33.949472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e3b53-7b36-4c78-bde3-9d5db27fb1aa None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:33.950060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e3b53-7b36-4c78-bde3-9d5db27fb1aa None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:33.950060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e3b53-7b36-4c78-bde3-9d5db27fb1aa None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:33.951369 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 04:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:17:33.956450 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736bc3e-b777-4d5e-b9e1-6364755fa34b None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:33.956884 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736bc3e-b777-4d5e-b9e1-6364755fa34b None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:33.957029 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736bc3e-b777-4d5e-b9e1-6364755fa34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:34.032416 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-6736bc3e-b777-4d5e-b9e1-6364755fa34b None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:17:34.033647 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-6736bc3e-b777-4d5e-b9e1-6364755fa34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:34.059944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:34.127866 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 04:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:17:34.277423 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e3b53-7b36-4c78-bde3-9d5db27fb1aa None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:17:34.278870 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c09e3b53-7b36-4c78-bde3-9d5db27fb1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:34.423011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e3b53-7b36-4c78-bde3-9d5db27fb1aa None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:17:34.463402 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:34.535336 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8f048-d737-4bbf-a1c3-54c82f29cc86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:17:34.535869 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8f048-d737-4bbf-a1c3-54c82f29cc86 service nova] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:34.536148 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8f048-d737-4bbf-a1c3-54c82f29cc86 service nova] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:34.536422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8f048-d737-4bbf-a1c3-54c82f29cc86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:34.538057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-2ff8f048-d737-4bbf-a1c3-54c82f29cc86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:34.625691 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff8f048-d737-4bbf-a1c3-54c82f29cc86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:17:34.627298 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff8f048-d737-4bbf-a1c3-54c82f29cc86 service nova] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:17:34.645305 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 708/1419] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:17:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:17:35.520427 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5a14b-3d65-40b9-9f57-3f0b48cab22b None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:35.520991 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5a14b-3d65-40b9-9f57-3f0b48cab22b None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:35.520991 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5a14b-3d65-40b9-9f57-3f0b48cab22b None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:35.522363 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 04:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:17:35.527936 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c7036-8715-4a51-bc96-765f21092ec6 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:35.528364 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c7036-8715-4a51-bc96-765f21092ec6 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:35.528495 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c7036-8715-4a51-bc96-765f21092ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:35.583635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:35.606138 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-c72c7036-8715-4a51-bc96-765f21092ec6 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:17:35.607342 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c72c7036-8715-4a51-bc96-765f21092ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:35.702388 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 04:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:17:35.853755 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5a14b-3d65-40b9-9f57-3f0b48cab22b None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:17:35.855235 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-a7b5a14b-3d65-40b9-9f57-3f0b48cab22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:35.999362 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5a14b-3d65-40b9-9f57-3f0b48cab22b None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:17:36.011802 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:36.113537 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f1031-bf04-4a61-b542-548017f80b55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:17:36.114070 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f1031-bf04-4a61-b542-548017f80b55 service nova] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:36.114350 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f1031-bf04-4a61-b542-548017f80b55 service nova] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:36.114624 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f1031-bf04-4a61-b542-548017f80b55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:36.116232 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-515f1031-bf04-4a61-b542-548017f80b55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:36.204272 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f1031-bf04-4a61-b542-548017f80b55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:17:36.205922 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f1031-bf04-4a61-b542-548017f80b55 service nova] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:17:36.223727 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 713/1422] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:17:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:17:37.079400 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a6a5b-90d7-410e-a314-39a0ad3f9f0f None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:37.079956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a6a5b-90d7-410e-a314-39a0ad3f9f0f None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:37.079956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a6a5b-90d7-410e-a314-39a0ad3f9f0f None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:37.081362 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 04:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:17:37.086247 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a72d1-43c7-41a8-94b6-a996d722439e None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:37.086637 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a72d1-43c7-41a8-94b6-a996d722439e None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:37.086802 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a72d1-43c7-41a8-94b6-a996d722439e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:37.107545 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:37.162569 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-d45a72d1-43c7-41a8-94b6-a996d722439e None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:17:37.163759 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-d45a72d1-43c7-41a8-94b6-a996d722439e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:37.257870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 04:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:17:37.406407 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a6a5b-90d7-410e-a314-39a0ad3f9f0f None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:17:37.407957 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-ba0a6a5b-90d7-410e-a314-39a0ad3f9f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:37.517381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:37.553513 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a6a5b-90d7-410e-a314-39a0ad3f9f0f None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:17:37.664929 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74075c-7281-43d6-8ec0-335c64cf66ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:17:37.665588 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74075c-7281-43d6-8ec0-335c64cf66ad service nova] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:37.665869 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74075c-7281-43d6-8ec0-335c64cf66ad service nova] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:37.666147 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74075c-7281-43d6-8ec0-335c64cf66ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:37.667732 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-fc74075c-7281-43d6-8ec0-335c64cf66ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:37.742461 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:37.756039 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc74075c-7281-43d6-8ec0-335c64cf66ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:17:37.757666 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc74075c-7281-43d6-8ec0-335c64cf66ad service nova] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:17:37.776655 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 711/1425] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:17:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:17:38.628651 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb172e-14fd-40b0-86a0-d3eadc304b9c None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:38.629244 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb172e-14fd-40b0-86a0-d3eadc304b9c None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:38.629360 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb172e-14fd-40b0-86a0-d3eadc304b9c None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:38.630637 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 04:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:17:38.635606 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ee346-aa92-49a6-b631-3746bc7dd813 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:38.635990 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ee346-aa92-49a6-b631-3746bc7dd813 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:38.636187 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ee346-aa92-49a6-b631-3746bc7dd813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:38.714139 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-ec0ee346-aa92-49a6-b631-3746bc7dd813 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:17:38.715255 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-ec0ee346-aa92-49a6-b631-3746bc7dd813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:38.808842 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 04:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:17:38.959075 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb172e-14fd-40b0-86a0-d3eadc304b9c None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:17:38.960626 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-8dbb172e-14fd-40b0-86a0-d3eadc304b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:39.043850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:39.105276 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb172e-14fd-40b0-86a0-d3eadc304b9c None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:17:39.218662 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4f50f-f9c0-44f0-9511-fb6c22aaaff1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:17:39.219275 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4f50f-f9c0-44f0-9511-fb6c22aaaff1 service nova] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:39.219554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4f50f-f9c0-44f0-9511-fb6c22aaaff1 service nova] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:39.219825 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4f50f-f9c0-44f0-9511-fb6c22aaaff1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:39.221447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-5bd4f50f-f9c0-44f0-9511-fb6c22aaaff1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:39.268792 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:39.308892 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4f50f-f9c0-44f0-9511-fb6c22aaaff1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:17:39.310453 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4f50f-f9c0-44f0-9511-fb6c22aaaff1 service nova] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:17:39.328997 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 716/1428] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:17:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:17:40.191745 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038e512-4417-4ede-9e79-545a7ec96122 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:40.192369 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038e512-4417-4ede-9e79-545a7ec96122 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:40.192369 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038e512-4417-4ede-9e79-545a7ec96122 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:40.193682 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 04:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:17:40.199052 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da900fec-462a-411e-b1ef-3574d24c9a78 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:40.199505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da900fec-462a-411e-b1ef-3574d24c9a78 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:40.199614 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da900fec-462a-411e-b1ef-3574d24c9a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:40.273228 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-da900fec-462a-411e-b1ef-3574d24c9a78 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:17:40.274339 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-da900fec-462a-411e-b1ef-3574d24c9a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:40.369865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 04:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:17:40.521107 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038e512-4417-4ede-9e79-545a7ec96122 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:17:40.522637 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-0038e512-4417-4ede-9e79-545a7ec96122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:40.573562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:40.667957 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038e512-4417-4ede-9e79-545a7ec96122 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:17:40.777909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20de530-4733-4e2c-b1f7-a2159287e12b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:17:40.778538 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20de530-4733-4e2c-b1f7-a2159287e12b service nova] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:40.778814 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20de530-4733-4e2c-b1f7-a2159287e12b service nova] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:40.779087 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20de530-4733-4e2c-b1f7-a2159287e12b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:40.780693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-e20de530-4733-4e2c-b1f7-a2159287e12b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:40.787733 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:40.873858 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20de530-4733-4e2c-b1f7-a2159287e12b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:17:40.876801 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20de530-4733-4e2c-b1f7-a2159287e12b service nova] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:17:40.893814 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 714/1431] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:17:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:17:41.769711 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955dbca-b79f-4409-9c28-155d5ba3eb69 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:41.770293 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955dbca-b79f-4409-9c28-155d5ba3eb69 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:41.770293 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955dbca-b79f-4409-9c28-155d5ba3eb69 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:41.771600 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 04:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:17:41.777030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5f9a3-1a88-439e-a6bb-1b20a427746c None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:41.777459 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5f9a3-1a88-439e-a6bb-1b20a427746c None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:41.777620 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5f9a3-1a88-439e-a6bb-1b20a427746c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:41.969940 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-baa5f9a3-1a88-439e-a6bb-1b20a427746c None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:17:41.971151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-baa5f9a3-1a88-439e-a6bb-1b20a427746c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:42.040591 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:42.069333 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 04:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:17:42.221218 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955dbca-b79f-4409-9c28-155d5ba3eb69 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:17:42.222730 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-5955dbca-b79f-4409-9c28-155d5ba3eb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:42.240020 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:42.371212 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955dbca-b79f-4409-9c28-155d5ba3eb69 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:17:42.458337 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:42.484738 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766fc02-c1ee-4e68-b1ea-e145bc4056c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:17:42.485378 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766fc02-c1ee-4e68-b1ea-e145bc4056c7 service nova] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:42.485659 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766fc02-c1ee-4e68-b1ea-e145bc4056c7 service nova] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:42.486011 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766fc02-c1ee-4e68-b1ea-e145bc4056c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:42.488311 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-e766fc02-c1ee-4e68-b1ea-e145bc4056c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:42.577023 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766fc02-c1ee-4e68-b1ea-e145bc4056c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:17:42.578654 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766fc02-c1ee-4e68-b1ea-e145bc4056c7 service nova] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:17:42.596269 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 719/1434] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:17:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:17:43.447742 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12ce91-bc43-43f2-9f9b-34a9212aaf00 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:43.448239 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12ce91-bc43-43f2-9f9b-34a9212aaf00 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:43.448368 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12ce91-bc43-43f2-9f9b-34a9212aaf00 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:43.449700 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 04:17:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:17:43.454584 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ab8ca-598e-47dd-8fac-01d413ca92e8 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:43.455031 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ab8ca-598e-47dd-8fac-01d413ca92e8 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:43.455162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ab8ca-598e-47dd-8fac-01d413ca92e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:43.532946 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-cd4ab8ca-598e-47dd-8fac-01d413ca92e8 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:17:43.534238 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-cd4ab8ca-598e-47dd-8fac-01d413ca92e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:43.577645 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:43.632561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 04:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:17:43.782630 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12ce91-bc43-43f2-9f9b-34a9212aaf00 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:17:43.784139 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-0f12ce91-bc43-43f2-9f9b-34a9212aaf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:43.933321 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12ce91-bc43-43f2-9f9b-34a9212aaf00 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:17:43.988073 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:44.047848 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c390fb9-2479-49c0-b1f0-64f4f7be7c65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:17:44.048464 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c390fb9-2479-49c0-b1f0-64f4f7be7c65 service nova] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:44.048747 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c390fb9-2479-49c0-b1f0-64f4f7be7c65 service nova] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:44.049021 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c390fb9-2479-49c0-b1f0-64f4f7be7c65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:44.050658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-9c390fb9-2479-49c0-b1f0-64f4f7be7c65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:44.141490 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c390fb9-2479-49c0-b1f0-64f4f7be7c65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:17:44.143092 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c390fb9-2479-49c0-b1f0-64f4f7be7c65 service nova] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:17:44.160640 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 717/1437] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:17:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:17:45.020144 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052e938-c000-44d1-80f3-33959f4eba4c None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:45.020692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052e938-c000-44d1-80f3-33959f4eba4c None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:45.020692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052e938-c000-44d1-80f3-33959f4eba4c None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:45.022107 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 04:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:17:45.027637 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dce6c-f888-467a-bb78-da7c43cfa458 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:45.028070 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dce6c-f888-467a-bb78-da7c43cfa458 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:45.028212 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dce6c-f888-467a-bb78-da7c43cfa458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:45.103732 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-c81dce6c-f888-467a-bb78-da7c43cfa458 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:17:45.104934 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c81dce6c-f888-467a-bb78-da7c43cfa458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:45.106992 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:45.203970 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 04:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:17:45.355082 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052e938-c000-44d1-80f3-33959f4eba4c None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:17:45.356657 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-2052e938-c000-44d1-80f3-33959f4eba4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:45.500360 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052e938-c000-44d1-80f3-33959f4eba4c None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:17:45.527655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:45.612903 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308522e4-9477-454a-ad7d-32e8de6ea062 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:17:45.613545 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308522e4-9477-454a-ad7d-32e8de6ea062 service nova] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:45.613826 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308522e4-9477-454a-ad7d-32e8de6ea062 service nova] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:45.614097 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308522e4-9477-454a-ad7d-32e8de6ea062 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:45.615707 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-308522e4-9477-454a-ad7d-32e8de6ea062 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:45.702832 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308522e4-9477-454a-ad7d-32e8de6ea062 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:17:45.704416 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308522e4-9477-454a-ad7d-32e8de6ea062 service nova] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:17:45.721924 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 722/1440] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:17:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:17:47.522086 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2479e-407f-4cd1-8d53-b334c53fa9bb None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:47.522621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2479e-407f-4cd1-8d53-b334c53fa9bb None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:47.522738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2479e-407f-4cd1-8d53-b334c53fa9bb None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:47.524073 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 04:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:17:47.530118 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee29c3a-6778-413a-a1f2-29d219bc4b62 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:47.530569 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee29c3a-6778-413a-a1f2-29d219bc4b62 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:47.530677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee29c3a-6778-413a-a1f2-29d219bc4b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:47.571421 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:47.596292 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-7ee29c3a-6778-413a-a1f2-29d219bc4b62 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:17:47.599988 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-7ee29c3a-6778-413a-a1f2-29d219bc4b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:47.697198 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 04:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:17:47.983831 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2479e-407f-4cd1-8d53-b334c53fa9bb None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:17:47.985403 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-2dd2479e-407f-4cd1-8d53-b334c53fa9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:48.090453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2479e-407f-4cd1-8d53-b334c53fa9bb None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:17:48.123201 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:48.164921 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14776a-bca2-4083-8011-45e997e600d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:17:48.165577 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14776a-bca2-4083-8011-45e997e600d1 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:48.165855 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14776a-bca2-4083-8011-45e997e600d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:48.166119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14776a-bca2-4083-8011-45e997e600d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:48.167705 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-2a14776a-bca2-4083-8011-45e997e600d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:48.275787 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14776a-bca2-4083-8011-45e997e600d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:17:48.277159 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14776a-bca2-4083-8011-45e997e600d1 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:17:48.294860 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 720/1443] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:17:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:17:50.323348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5070b-4137-48f3-a02c-5d6b17d582b7 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:50.323877 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5070b-4137-48f3-a02c-5d6b17d582b7 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:50.323877 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5070b-4137-48f3-a02c-5d6b17d582b7 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:50.325192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 04:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:17:50.330299 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dfc73-809c-4d96-8665-e67aaabd7239 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:50.330709 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dfc73-809c-4d96-8665-e67aaabd7239 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:50.330848 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dfc73-809c-4d96-8665-e67aaabd7239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:50.395142 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-ab2dfc73-809c-4d96-8665-e67aaabd7239 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:17:50.396328 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-ab2dfc73-809c-4d96-8665-e67aaabd7239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:50.409295 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:50.492525 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 04:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:17:50.773231 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5070b-4137-48f3-a02c-5d6b17d582b7 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:17:50.774780 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-4ff5070b-4137-48f3-a02c-5d6b17d582b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:50.878820 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5070b-4137-48f3-a02c-5d6b17d582b7 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:17:50.891380 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:50.952845 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df7845-a955-4e01-aeae-405c3f6fc94c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:17:50.953491 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df7845-a955-4e01-aeae-405c3f6fc94c service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:50.953770 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df7845-a955-4e01-aeae-405c3f6fc94c service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:50.954042 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df7845-a955-4e01-aeae-405c3f6fc94c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:50.955655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-63df7845-a955-4e01-aeae-405c3f6fc94c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:51.064697 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df7845-a955-4e01-aeae-405c3f6fc94c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:17:51.066116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df7845-a955-4e01-aeae-405c3f6fc94c service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:17:51.085005 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 725/1446] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:17:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:17:53.331987 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335d827-9e2b-46c6-9c55-d44e09f22984 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:53.332506 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335d827-9e2b-46c6-9c55-d44e09f22984 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:53.332506 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335d827-9e2b-46c6-9c55-d44e09f22984 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:53.333818 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 04:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:17:53.338983 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f5f11-bd31-4c13-a6a1-2ce5ecaf6c46 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:53.339359 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f5f11-bd31-4c13-a6a1-2ce5ecaf6c46 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:53.339542 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f5f11-bd31-4c13-a6a1-2ce5ecaf6c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:53.387170 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:53.405378 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-b65f5f11-bd31-4c13-a6a1-2ce5ecaf6c46 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:17:53.406570 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-b65f5f11-bd31-4c13-a6a1-2ce5ecaf6c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:53.501657 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 04:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:17:53.788263 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335d827-9e2b-46c6-9c55-d44e09f22984 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:17:53.789835 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-5335d827-9e2b-46c6-9c55-d44e09f22984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:53.891655 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335d827-9e2b-46c6-9c55-d44e09f22984 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:17:53.930757 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:53.964495 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8f5f3-5468-4ad1-a8de-389d4fde4fe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:17:53.965789 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8f5f3-5468-4ad1-a8de-389d4fde4fe5 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:53.966080 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8f5f3-5468-4ad1-a8de-389d4fde4fe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:53.966555 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8f5f3-5468-4ad1-a8de-389d4fde4fe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:53.968696 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-bbe8f5f3-5468-4ad1-a8de-389d4fde4fe5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:54.078915 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8f5f3-5468-4ad1-a8de-389d4fde4fe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:17:54.080304 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8f5f3-5468-4ad1-a8de-389d4fde4fe5 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:17:54.099352 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 723/1449] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:17:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:17:56.104731 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a08e6-7cb0-4be9-87ec-d5077efbb1a6 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:56.105276 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a08e6-7cb0-4be9-87ec-d5077efbb1a6 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:56.105879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a08e6-7cb0-4be9-87ec-d5077efbb1a6 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:56.107190 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 04:17:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:17:56.112512 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26999051-f218-4e17-8af0-1592459963de None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:56.112909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26999051-f218-4e17-8af0-1592459963de None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:56.113105 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26999051-f218-4e17-8af0-1592459963de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:56.177593 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-26999051-f218-4e17-8af0-1592459963de None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:17:56.178715 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-26999051-f218-4e17-8af0-1592459963de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:56.199574 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:56.274058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 04:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:17:56.571920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0a08e6-7cb0-4be9-87ec-d5077efbb1a6 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:17:56.573492 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-cb0a08e6-7cb0-4be9-87ec-d5077efbb1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:56.674351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0a08e6-7cb0-4be9-87ec-d5077efbb1a6 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:17:56.694257 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:56.747315 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824b74d-9464-4eeb-a53c-aff7487f8177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:17:56.747926 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824b74d-9464-4eeb-a53c-aff7487f8177 service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:56.748205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824b74d-9464-4eeb-a53c-aff7487f8177 service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:56.748475 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824b74d-9464-4eeb-a53c-aff7487f8177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:56.750117 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-9824b74d-9464-4eeb-a53c-aff7487f8177 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:56.857323 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824b74d-9464-4eeb-a53c-aff7487f8177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:17:56.858700 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824b74d-9464-4eeb-a53c-aff7487f8177 service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:17:56.876378 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 728/1452] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:17:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:17:58.843789 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fb5b1-0195-4e56-9c8d-7a6596903966 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:58.844338 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fb5b1-0195-4e56-9c8d-7a6596903966 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:58.844438 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fb5b1-0195-4e56-9c8d-7a6596903966 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:58.845797 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 04:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:17:58.851028 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39331aa2-ba67-4c75-92f0-7646ee37ff82 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:58.851448 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39331aa2-ba67-4c75-92f0-7646ee37ff82 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:58.851587 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39331aa2-ba67-4c75-92f0-7646ee37ff82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:58.915395 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:58.918556 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-39331aa2-ba67-4c75-92f0-7646ee37ff82 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:17:58.919763 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-39331aa2-ba67-4c75-92f0-7646ee37ff82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:59.016648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 04:17:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:17:59.305219 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3fb5b1-0195-4e56-9c8d-7a6596903966 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:17:59.306744 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-8f3fb5b1-0195-4e56-9c8d-7a6596903966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:59.415373 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3fb5b1-0195-4e56-9c8d-7a6596903966 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:17:59.464011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:17:59.490111 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1cccc-0afa-4152-8198-a0ff971b274a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:17:59.490718 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1cccc-0afa-4152-8198-a0ff971b274a service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:17:59.491033 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1cccc-0afa-4152-8198-a0ff971b274a service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:17:59.491302 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1cccc-0afa-4152-8198-a0ff971b274a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:17:59.492884 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-6aa1cccc-0afa-4152-8198-a0ff971b274a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:17:59.606045 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1cccc-0afa-4152-8198-a0ff971b274a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:17:59.607475 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1cccc-0afa-4152-8198-a0ff971b274a service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:17:59.626117 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 726/1455] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:17:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:18:01.667335 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202c547-43a9-41e4-9a7f-e60692c286cd None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:01.667906 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202c547-43a9-41e4-9a7f-e60692c286cd None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:01.667906 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202c547-43a9-41e4-9a7f-e60692c286cd None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:01.669301 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 04:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:18:01.674643 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8ddb6-71fb-4c8f-8c6b-b2fdfa930a4a None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:01.675070 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8ddb6-71fb-4c8f-8c6b-b2fdfa930a4a None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:01.675201 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8ddb6-71fb-4c8f-8c6b-b2fdfa930a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:01.741751 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-2fe8ddb6-71fb-4c8f-8c6b-b2fdfa930a4a None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:18:01.742935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-2fe8ddb6-71fb-4c8f-8c6b-b2fdfa930a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:01.772074 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:18:01.838656 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 04:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:18:02.127007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202c547-43a9-41e4-9a7f-e60692c286cd None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:18:02.128578 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-2202c547-43a9-41e4-9a7f-e60692c286cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:02.231002 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202c547-43a9-41e4-9a7f-e60692c286cd None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:18:02.258148 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:18:02.303119 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cb371-0669-4990-9b55-cbca91394118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:18:02.303727 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cb371-0669-4990-9b55-cbca91394118 service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:02.304005 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cb371-0669-4990-9b55-cbca91394118 service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:02.304272 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cb371-0669-4990-9b55-cbca91394118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:02.305889 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-7f2cb371-0669-4990-9b55-cbca91394118 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:02.410673 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2cb371-0669-4990-9b55-cbca91394118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:18:02.412095 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2cb371-0669-4990-9b55-cbca91394118 service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:18:02.430570 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 731/1458] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:18:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:18:04.384178 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcac258-eea6-447b-8c4d-82e2c8f548f2 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:04.384710 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcac258-eea6-447b-8c4d-82e2c8f548f2 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:04.384710 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcac258-eea6-447b-8c4d-82e2c8f548f2 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:04.386116 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 04:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:18:04.391320 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a14783-3184-458d-8d45-4bc3be28c213 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:04.391724 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a14783-3184-458d-8d45-4bc3be28c213 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:04.391896 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a14783-3184-458d-8d45-4bc3be28c213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:04.457653 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-02a14783-3184-458d-8d45-4bc3be28c213 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:18:04.458855 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-02a14783-3184-458d-8d45-4bc3be28c213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:04.467643 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:18:04.555067 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 04:18:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:18:04.839049 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcac258-eea6-447b-8c4d-82e2c8f548f2 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:18:04.841847 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-0fcac258-eea6-447b-8c4d-82e2c8f548f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:04.943470 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcac258-eea6-447b-8c4d-82e2c8f548f2 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:18:04.999128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:18:05.018910 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3d84d-263c-4dbf-83d8-80acfb5199aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:18:05.019517 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3d84d-263c-4dbf-83d8-80acfb5199aa service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:05.019795 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3d84d-263c-4dbf-83d8-80acfb5199aa service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:05.020064 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3d84d-263c-4dbf-83d8-80acfb5199aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:05.021698 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-0ab3d84d-263c-4dbf-83d8-80acfb5199aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:05.129011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab3d84d-263c-4dbf-83d8-80acfb5199aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:18:05.130400 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab3d84d-263c-4dbf-83d8-80acfb5199aa service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:18:05.148934 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 729/1461] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:18:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:18:07.074115 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3600f-6dda-4d78-af45-cf76f957a05f None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:07.074664 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3600f-6dda-4d78-af45-cf76f957a05f None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:07.074664 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3600f-6dda-4d78-af45-cf76f957a05f None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:07.076097 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 04:18:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:18:07.081534 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf53cb-dee8-43c5-8891-051f4669cf47 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:07.081940 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf53cb-dee8-43c5-8891-051f4669cf47 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:07.082120 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf53cb-dee8-43c5-8891-051f4669cf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:07.148285 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-98cf53cb-dee8-43c5-8891-051f4669cf47 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:18:07.149511 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-98cf53cb-dee8-43c5-8891-051f4669cf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:07.187568 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:18:07.244667 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 04:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:18:07.530724 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb3600f-6dda-4d78-af45-cf76f957a05f None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:18:07.532266 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-8eb3600f-6dda-4d78-af45-cf76f957a05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:07.634248 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb3600f-6dda-4d78-af45-cf76f957a05f None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:18:07.672578 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:18:07.708738 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101ba82-0200-402a-98fb-6c48e9284408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:18:07.709377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101ba82-0200-402a-98fb-6c48e9284408 service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:07.709661 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101ba82-0200-402a-98fb-6c48e9284408 service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:07.709941 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101ba82-0200-402a-98fb-6c48e9284408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:07.711550 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-6101ba82-0200-402a-98fb-6c48e9284408 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:07.819198 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6101ba82-0200-402a-98fb-6c48e9284408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:18:07.820555 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6101ba82-0200-402a-98fb-6c48e9284408 service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:18:07.838659 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 734/1464] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:18:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:18:09.754277 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52202b-b696-49ff-bac5-29099f1d66d7 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:09.754805 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52202b-b696-49ff-bac5-29099f1d66d7 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:09.754805 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52202b-b696-49ff-bac5-29099f1d66d7 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:09.756198 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 04:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:18:09.761581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86742736-fe03-4490-a88c-e973ca902b66 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:09.762029 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86742736-fe03-4490-a88c-e973ca902b66 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:09.762136 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86742736-fe03-4490-a88c-e973ca902b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:09.826565 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-86742736-fe03-4490-a88c-e973ca902b66 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:18:09.827745 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-86742736-fe03-4490-a88c-e973ca902b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:09.845742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:18:09.923800 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 04:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:18:10.208934 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52202b-b696-49ff-bac5-29099f1d66d7 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:18:10.210565 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-9c52202b-b696-49ff-bac5-29099f1d66d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:10.313891 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52202b-b696-49ff-bac5-29099f1d66d7 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:18:10.378725 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:18:10.385156 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0d13f-e789-4a03-8fc9-9ac82cabefb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:18:10.385799 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0d13f-e789-4a03-8fc9-9ac82cabefb4 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:10.386078 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0d13f-e789-4a03-8fc9-9ac82cabefb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:10.386349 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0d13f-e789-4a03-8fc9-9ac82cabefb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:10.388480 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-06e0d13f-e789-4a03-8fc9-9ac82cabefb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:10.501147 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0d13f-e789-4a03-8fc9-9ac82cabefb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:18:10.502528 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0d13f-e789-4a03-8fc9-9ac82cabefb4 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:18:10.521401 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 732/1467] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:18:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:18:12.447609 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bd2e0-f11d-46d2-8516-225e5adb58e7 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:12.448180 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bd2e0-f11d-46d2-8516-225e5adb58e7 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:12.448180 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bd2e0-f11d-46d2-8516-225e5adb58e7 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:12.450078 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 04:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:18:12.455559 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1990870-aa7c-4053-b479-dedf53873754 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:12.455981 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1990870-aa7c-4053-b479-dedf53873754 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:12.456120 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1990870-aa7c-4053-b479-dedf53873754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:12.522281 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-d1990870-aa7c-4053-b479-dedf53873754 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:18:12.523491 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-d1990870-aa7c-4053-b479-dedf53873754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:12.572917 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:18:12.622662 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 04:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:18:12.909407 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bd2e0-f11d-46d2-8516-225e5adb58e7 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:18:12.910986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-965bd2e0-f11d-46d2-8516-225e5adb58e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:13.015614 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bd2e0-f11d-46d2-8516-225e5adb58e7 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:18:13.064516 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:18:13.090320 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2a765-97df-44d9-b32d-e76b9adb7dac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:18:13.090937 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2a765-97df-44d9-b32d-e76b9adb7dac service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:13.091221 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2a765-97df-44d9-b32d-e76b9adb7dac service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:13.091498 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2a765-97df-44d9-b32d-e76b9adb7dac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:13.093137 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-d0a2a765-97df-44d9-b32d-e76b9adb7dac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:13.202420 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2a765-97df-44d9-b32d-e76b9adb7dac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:18:13.203869 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2a765-97df-44d9-b32d-e76b9adb7dac service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:18:13.221945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 737/1470] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:18:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:18:22.620795 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=22 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:18:23.219741 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=66 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:18:32.675630 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681de0e8-1025-4b9d-b15e-ff8b12cc158d None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:32.676238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681de0e8-1025-4b9d-b15e-ff8b12cc158d None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:32.676238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681de0e8-1025-4b9d-b15e-ff8b12cc158d None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:32.677593 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 734/1471] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:18:32.683532 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f2eb6-8e03-44cd-ba2a-547d7ce9e49b None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:32.683959 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f2eb6-8e03-44cd-ba2a-547d7ce9e49b None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:32.684067 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f2eb6-8e03-44cd-ba2a-547d7ce9e49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:32.748993 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-6d0f2eb6-8e03-44cd-ba2a-547d7ce9e49b None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:18:32.750225 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-6d0f2eb6-8e03-44cd-ba2a-547d7ce9e49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:32.847808 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 738/1472] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:18:33.154085 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d113f2-cfeb-44c6-8fd3-eea2afee2a19 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:33.154372 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d113f2-cfeb-44c6-8fd3-eea2afee2a19 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:33.154647 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d113f2-cfeb-44c6-8fd3-eea2afee2a19 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:33.155976 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 735/1473] 10.222.0.42 () {54 vars in 967 bytes} [Tue Aug 23 04:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:18:33.160865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47871c3b-0a23-4b2b-bf30-82fe7f17e66d None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:33.161257 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47871c3b-0a23-4b2b-bf30-82fe7f17e66d None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:33.161532 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47871c3b-0a23-4b2b-bf30-82fe7f17e66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:33.235890 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-47871c3b-0a23-4b2b-bf30-82fe7f17e66d None None] MFA Rules not processed for user `020af86302e447a6b3973df4abbabafa`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:18:33.237004 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-47871c3b-0a23-4b2b-bf30-82fe7f17e66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:33.257222 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:18:33.312313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 739/1474] 10.222.0.42 () {58 vars in 1064 bytes} [Tue Aug 23 04:18:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:18:33.319978 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d113f2-cfeb-44c6-8fd3-eea2afee2a19 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:18:33.321526 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-b0d113f2-cfeb-44c6-8fd3-eea2afee2a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:33.423591 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d113f2-cfeb-44c6-8fd3-eea2afee2a19 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:18:33.495170 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96afc1a-2cb1-4bbf-8af4-a1b471c18c1c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '020af86302e447a6b3973df4abbabafa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:18:33.496311 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96afc1a-2cb1-4bbf-8af4-a1b471c18c1c service glance] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:33.496594 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96afc1a-2cb1-4bbf-8af4-a1b471c18c1c service glance] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:33.496864 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96afc1a-2cb1-4bbf-8af4-a1b471c18c1c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:33.498488 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-f96afc1a-2cb1-4bbf-8af4-a1b471c18c1c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:33.551990 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:18:33.606893 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96afc1a-2cb1-4bbf-8af4-a1b471c18c1c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:18:33.608326 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96afc1a-2cb1-4bbf-8af4-a1b471c18c1c service glance] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:18:33.626872 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 736/1475] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:18:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:18:35.623972 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff776a19-bb41-480c-b7c8-494c84ebfe99 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:35.624533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff776a19-bb41-480c-b7c8-494c84ebfe99 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:35.624533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff776a19-bb41-480c-b7c8-494c84ebfe99 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:35.625976 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 740/1476] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:18:35.631326 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff12de-9db8-40c2-b5af-9b43d726d6f2 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:35.631759 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff12de-9db8-40c2-b5af-9b43d726d6f2 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:35.631890 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff12de-9db8-40c2-b5af-9b43d726d6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:35.697176 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-c7ff12de-9db8-40c2-b5af-9b43d726d6f2 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:18:35.698897 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c7ff12de-9db8-40c2-b5af-9b43d726d6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:35.795172 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 737/1477] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:18:36.073747 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff776a19-bb41-480c-b7c8-494c84ebfe99 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:18:36.075299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-ff776a19-bb41-480c-b7c8-494c84ebfe99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:36.199816 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff776a19-bb41-480c-b7c8-494c84ebfe99 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:18:36.249069 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:18:36.297299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfcebd6-5ea4-424c-ad09-b04c35b28389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:18:36.297989 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfcebd6-5ea4-424c-ad09-b04c35b28389 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:36.298266 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfcebd6-5ea4-424c-ad09-b04c35b28389 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:36.298537 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfcebd6-5ea4-424c-ad09-b04c35b28389 admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:36.299169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfcebd6-5ea4-424c-ad09-b04c35b28389 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:18:36.301010 dv-cinder-854070-1-smb devstack@keystone.service[82355]: WARNING py.warnings [None req-7cfcebd6-5ea4-424c-ad09-b04c35b28389 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 04:18:36.301010 dv-cinder-854070-1-smb devstack@keystone.service[82355]: warnings.warn(msg) Aug 23 04:18:36.301010 dv-cinder-854070-1-smb devstack@keystone.service[82355]: Aug 23 04:18:36.302312 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfcebd6-5ea4-424c-ad09-b04c35b28389 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:18:36.321805 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 741/1478] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 23 04:18:36 2022] GET /identity/v3/projects => generated 2553 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:18:38.227153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714427d-fa85-4add-96f9-f4267511057c None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:38.227681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714427d-fa85-4add-96f9-f4267511057c None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:38.227681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714427d-fa85-4add-96f9-f4267511057c None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:38.228959 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 738/1479] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:18:38.234964 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fb970-682e-4de1-9c34-4957ea33d73c None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:38.235376 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fb970-682e-4de1-9c34-4957ea33d73c None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:38.235520 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fb970-682e-4de1-9c34-4957ea33d73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:38.301012 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-3e4fb970-682e-4de1-9c34-4957ea33d73c None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:18:38.302248 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-3e4fb970-682e-4de1-9c34-4957ea33d73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:38.395724 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 742/1480] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:18:38.691395 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714427d-fa85-4add-96f9-f4267511057c None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:18:38.692940 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-6714427d-fa85-4add-96f9-f4267511057c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:38.703017 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:18:38.837746 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714427d-fa85-4add-96f9-f4267511057c None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:18:38.916351 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:18:38.951682 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776de96-41ff-4685-b8a4-a3a55b767999 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:18:38.952292 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776de96-41ff-4685-b8a4-a3a55b767999 service nova] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:38.952572 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776de96-41ff-4685-b8a4-a3a55b767999 service nova] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:38.952841 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776de96-41ff-4685-b8a4-a3a55b767999 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:38.954494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-8776de96-41ff-4685-b8a4-a3a55b767999 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:39.049000 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8776de96-41ff-4685-b8a4-a3a55b767999 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:18:39.050616 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8776de96-41ff-4685-b8a4-a3a55b767999 service nova] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:18:39.068725 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 739/1481] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:18:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:18:41.154918 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a4900-a265-44ee-9d5a-4783b433d376 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:41.154918 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a4900-a265-44ee-9d5a-4783b433d376 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:41.154918 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a4900-a265-44ee-9d5a-4783b433d376 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:41.154918 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 743/1482] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:18:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:18:41.157479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5dcaf-f9cd-4cd7-9454-fc0361fdc51f None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:41.157880 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5dcaf-f9cd-4cd7-9454-fc0361fdc51f None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:41.158059 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5dcaf-f9cd-4cd7-9454-fc0361fdc51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:41.226447 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-b7e5dcaf-f9cd-4cd7-9454-fc0361fdc51f None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:18:41.227643 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-b7e5dcaf-f9cd-4cd7-9454-fc0361fdc51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:41.274340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:18:41.325361 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 740/1483] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:18:41.610257 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a4900-a265-44ee-9d5a-4783b433d376 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:18:41.611824 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-dd2a4900-a265-44ee-9d5a-4783b433d376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:41.635757 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:18:41.716408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a4900-a265-44ee-9d5a-4783b433d376 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:18:41.789050 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504ff0d-c043-4487-aba4-86837ee9a71c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:18:41.789775 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504ff0d-c043-4487-aba4-86837ee9a71c service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:41.790052 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504ff0d-c043-4487-aba4-86837ee9a71c service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:41.790323 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504ff0d-c043-4487-aba4-86837ee9a71c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:41.791944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-a504ff0d-c043-4487-aba4-86837ee9a71c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:41.867381 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:18:41.903712 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a504ff0d-c043-4487-aba4-86837ee9a71c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:18:41.905244 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a504ff0d-c043-4487-aba4-86837ee9a71c service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:18:41.923565 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 744/1484] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:18:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:18:43.883857 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054fb66-c7df-45f6-9485-57f59cc67085 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:43.884400 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054fb66-c7df-45f6-9485-57f59cc67085 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:43.884400 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054fb66-c7df-45f6-9485-57f59cc67085 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:43.885820 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 741/1485] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:18:43.890965 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e4f67-8903-4997-9d93-534b650bd047 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:43.891378 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e4f67-8903-4997-9d93-534b650bd047 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:43.891516 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e4f67-8903-4997-9d93-534b650bd047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:43.957026 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-044e4f67-8903-4997-9d93-534b650bd047 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:18:43.958266 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-044e4f67-8903-4997-9d93-534b650bd047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:44.056764 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 745/1486] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:18:44.346373 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054fb66-c7df-45f6-9485-57f59cc67085 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:18:44.347915 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-b054fb66-c7df-45f6-9485-57f59cc67085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:44.452648 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054fb66-c7df-45f6-9485-57f59cc67085 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:18:44.524108 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:18:44.526372 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb4d0c-f360-477e-8c0d-29cbf8955b3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:18:44.527326 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb4d0c-f360-477e-8c0d-29cbf8955b3a service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:44.527606 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb4d0c-f360-477e-8c0d-29cbf8955b3a service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:44.527876 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb4d0c-f360-477e-8c0d-29cbf8955b3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:44.529506 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-19cb4d0c-f360-477e-8c0d-29cbf8955b3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:44.642496 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb4d0c-f360-477e-8c0d-29cbf8955b3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:18:44.643932 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb4d0c-f360-477e-8c0d-29cbf8955b3a service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:18:44.662214 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 742/1487] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:18:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:18:46.644336 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f63a8-c1e4-449a-a679-407be97b6713 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:46.644901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f63a8-c1e4-449a-a679-407be97b6713 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:46.645020 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f63a8-c1e4-449a-a679-407be97b6713 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:46.646456 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 746/1488] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:18:46.652250 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e57f8a-13da-4670-b7d7-d2b502884577 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:46.652673 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e57f8a-13da-4670-b7d7-d2b502884577 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:46.652799 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e57f8a-13da-4670-b7d7-d2b502884577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:46.719255 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-80e57f8a-13da-4670-b7d7-d2b502884577 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:18:46.720458 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-80e57f8a-13da-4670-b7d7-d2b502884577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:46.773501 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:18:46.816851 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 743/1489] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:18:47.111994 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f63a8-c1e4-449a-a679-407be97b6713 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:18:47.113588 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-671f63a8-c1e4-449a-a679-407be97b6713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:47.149844 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:18:47.216531 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f63a8-c1e4-449a-a679-407be97b6713 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:18:47.287854 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833f304-24a4-4281-a454-1db42f796a82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:18:47.288460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833f304-24a4-4281-a454-1db42f796a82 service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:47.288739 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833f304-24a4-4281-a454-1db42f796a82 service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:47.289012 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833f304-24a4-4281-a454-1db42f796a82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:47.290646 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-b833f304-24a4-4281-a454-1db42f796a82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:47.370642 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:18:47.398989 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833f304-24a4-4281-a454-1db42f796a82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:18:47.400911 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833f304-24a4-4281-a454-1db42f796a82 service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:18:47.419943 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 747/1490] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:18:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:18:49.642777 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac772e46-a330-4f86-9d28-5dc2b015d983 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:49.643344 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac772e46-a330-4f86-9d28-5dc2b015d983 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:49.643344 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac772e46-a330-4f86-9d28-5dc2b015d983 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:49.644669 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 744/1491] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 23 04:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:18:49.650075 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683a62e-351f-479f-af83-4a49d9cc8921 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:49.650463 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683a62e-351f-479f-af83-4a49d9cc8921 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:49.650632 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683a62e-351f-479f-af83-4a49d9cc8921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:49.715666 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-8683a62e-351f-479f-af83-4a49d9cc8921 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:18:49.716866 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-8683a62e-351f-479f-af83-4a49d9cc8921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:49.811720 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 748/1492] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 23 04:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:18:50.096963 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac772e46-a330-4f86-9d28-5dc2b015d983 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:18:50.101341 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-ac772e46-a330-4f86-9d28-5dc2b015d983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:50.202646 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac772e46-a330-4f86-9d28-5dc2b015d983 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:18:50.275910 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b24071-703b-410c-8e66-2ec6d3982691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:18:50.276512 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b24071-703b-410c-8e66-2ec6d3982691 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:18:50.276792 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b24071-703b-410c-8e66-2ec6d3982691 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:18:50.277063 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b24071-703b-410c-8e66-2ec6d3982691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:18:50.278683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c1b24071-703b-410c-8e66-2ec6d3982691 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:18:50.287677 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:18:50.386574 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b24071-703b-410c-8e66-2ec6d3982691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:18:50.388015 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b24071-703b-410c-8e66-2ec6d3982691 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:18:50.406100 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 745/1493] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:18:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:18:59.809728 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=82 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:19:00.403834 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=50 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:20:39.299460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e912c1e-2c10-443b-9cb7-99360859a92d None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:20:39.299992 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e912c1e-2c10-443b-9cb7-99360859a92d None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:20:39.299992 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e912c1e-2c10-443b-9cb7-99360859a92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:20:39.376619 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-3e912c1e-2c10-443b-9cb7-99360859a92d None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:20:39.377851 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-3e912c1e-2c10-443b-9cb7-99360859a92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:20:39.474104 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 749/1494] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:20:39.482717 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7069b38-63d7-4850-b316-ceabcb0f29b0 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:20:39.483196 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7069b38-63d7-4850-b316-ceabcb0f29b0 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:20:39.483303 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7069b38-63d7-4850-b316-ceabcb0f29b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:20:39.560238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-f7069b38-63d7-4850-b316-ceabcb0f29b0 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:20:39.561508 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-f7069b38-63d7-4850-b316-ceabcb0f29b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:20:39.658679 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 746/1495] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:20:39.663348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e912c1e-2c10-443b-9cb7-99360859a92d None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:20:39.664556 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-3e912c1e-2c10-443b-9cb7-99360859a92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:20:39.676418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e912c1e-2c10-443b-9cb7-99360859a92d None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:20:39.737611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:20:39.770973 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d755abe-3800-4d1d-945e-8b665ac175ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:20:39.771582 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d755abe-3800-4d1d-945e-8b665ac175ac admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:20:39.771861 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d755abe-3800-4d1d-945e-8b665ac175ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:20:39.772129 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d755abe-3800-4d1d-945e-8b665ac175ac admin admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:20:39.772773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d755abe-3800-4d1d-945e-8b665ac175ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:20:39.773076 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d755abe-3800-4d1d-945e-8b665ac175ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:20:39.774116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: WARNING py.warnings [None req-5d755abe-3800-4d1d-945e-8b665ac175ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 04:20:39.774116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: warnings.warn(msg) Aug 23 04:20:39.774116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: Aug 23 04:20:39.775004 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d755abe-3800-4d1d-945e-8b665ac175ac admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:20:39.786793 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 750/1496] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:20:39.795053 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7069b38-63d7-4850-b316-ceabcb0f29b0 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:20:39.804217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7069b38-63d7-4850-b316-ceabcb0f29b0 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:20:39.866979 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:20:39.900871 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e3f71-b407-428e-89bf-526e5b2f093e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:20:39.901507 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e3f71-b407-428e-89bf-526e5b2f093e admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:20:39.901793 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e3f71-b407-428e-89bf-526e5b2f093e admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:20:39.902065 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e3f71-b407-428e-89bf-526e5b2f093e admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:20:39.903760 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e3f71-b407-428e-89bf-526e5b2f093e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:20:39.905974 dv-cinder-854070-1-smb devstack@keystone.service[82354]: WARNING py.warnings [None req-1f3e3f71-b407-428e-89bf-526e5b2f093e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 04:20:39.905974 dv-cinder-854070-1-smb devstack@keystone.service[82354]: warnings.warn(msg) Aug 23 04:20:39.905974 dv-cinder-854070-1-smb devstack@keystone.service[82354]: Aug 23 04:20:39.907178 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e3f71-b407-428e-89bf-526e5b2f093e admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:20:40.033954 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 747/1497] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:20:39 2022] POST /identity/v3/projects => generated 377 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:20:40.038064 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d755abe-3800-4d1d-945e-8b665ac175ac admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:20:40.039710 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-5d755abe-3800-4d1d-945e-8b665ac175ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:20:40.073031 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d755abe-3800-4d1d-945e-8b665ac175ac admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:20:40.165332 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa757e0-2b42-448c-9614-ae289247ad34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:20:40.165933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa757e0-2b42-448c-9614-ae289247ad34 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:20:40.166210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa757e0-2b42-448c-9614-ae289247ad34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:20:40.166480 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa757e0-2b42-448c-9614-ae289247ad34 admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:20:40.167094 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa757e0-2b42-448c-9614-ae289247ad34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:20:40.168096 dv-cinder-854070-1-smb devstack@keystone.service[82355]: WARNING py.warnings [None req-baa757e0-2b42-448c-9614-ae289247ad34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 04:20:40.168096 dv-cinder-854070-1-smb devstack@keystone.service[82355]: warnings.warn(msg) Aug 23 04:20:40.168096 dv-cinder-854070-1-smb devstack@keystone.service[82355]: Aug 23 04:20:40.169396 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa757e0-2b42-448c-9614-ae289247ad34 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:20:40.278322 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 751/1498] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:20:40 2022] POST /identity/v3/users => generated 289 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:20:40.282511 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e3f71-b407-428e-89bf-526e5b2f093e admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:20:40.284073 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-1f3e3f71-b407-428e-89bf-526e5b2f093e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:20:40.348768 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e3f71-b407-428e-89bf-526e5b2f093e admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:20:40.431867 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:20:40.442827 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187e781-a444-4b86-9cb1-af02306e4bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:20:40.444584 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187e781-a444-4b86-9cb1-af02306e4bbd admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:20:40.444584 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187e781-a444-4b86-9cb1-af02306e4bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:20:40.444584 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187e781-a444-4b86-9cb1-af02306e4bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:20:40.444584 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187e781-a444-4b86-9cb1-af02306e4bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:20:40.445638 dv-cinder-854070-1-smb devstack@keystone.service[82354]: WARNING py.warnings [None req-6187e781-a444-4b86-9cb1-af02306e4bbd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 04:20:40.445638 dv-cinder-854070-1-smb devstack@keystone.service[82354]: warnings.warn(msg) Aug 23 04:20:40.445638 dv-cinder-854070-1-smb devstack@keystone.service[82354]: Aug 23 04:20:40.446537 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187e781-a444-4b86-9cb1-af02306e4bbd admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:20:40.459308 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 748/1499] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:20:40.463417 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa757e0-2b42-448c-9614-ae289247ad34 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:20:40.465065 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-baa757e0-2b42-448c-9614-ae289247ad34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:20:40.476658 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa757e0-2b42-448c-9614-ae289247ad34 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:20:40.502884 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:20:40.573527 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26fc1c-7946-4099-b60d-133816fef92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:20:40.574094 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26fc1c-7946-4099-b60d-133816fef92b admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:20:40.574374 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26fc1c-7946-4099-b60d-133816fef92b admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:20:40.574648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26fc1c-7946-4099-b60d-133816fef92b admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:20:40.575293 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26fc1c-7946-4099-b60d-133816fef92b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:20:40.576301 dv-cinder-854070-1-smb devstack@keystone.service[82355]: WARNING py.warnings [None req-1b26fc1c-7946-4099-b60d-133816fef92b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 04:20:40.576301 dv-cinder-854070-1-smb devstack@keystone.service[82355]: warnings.warn(msg) Aug 23 04:20:40.576301 dv-cinder-854070-1-smb devstack@keystone.service[82355]: Aug 23 04:20:40.577215 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26fc1c-7946-4099-b60d-133816fef92b admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:20:40.589431 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 752/1500] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:20:40.593629 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187e781-a444-4b86-9cb1-af02306e4bbd admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:20:40.595179 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-6187e781-a444-4b86-9cb1-af02306e4bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:20:40.629411 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187e781-a444-4b86-9cb1-af02306e4bbd admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:20:40.720967 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe09fd-ca1d-4a25-a17a-9e4b0013c32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:20:40.721646 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe09fd-ca1d-4a25-a17a-9e4b0013c32f admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:20:40.721926 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe09fd-ca1d-4a25-a17a-9e4b0013c32f admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:20:40.722199 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe09fd-ca1d-4a25-a17a-9e4b0013c32f admin admin] PATH_INFO: `/v3/projects/5b08588027834f698a721610d94e2f66/users/7d5621747e104c3f8dba1b0e6ca2b535/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:20:40.744256 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe09fd-ca1d-4a25-a17a-9e4b0013c32f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b08588027834f698a721610d94e2f66, user_id=7d5621747e104c3f8dba1b0e6ca2b535, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:20:40.745319 dv-cinder-854070-1-smb devstack@keystone.service[82354]: WARNING py.warnings [None req-6fbe09fd-ca1d-4a25-a17a-9e4b0013c32f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 04:20:40.745319 dv-cinder-854070-1-smb devstack@keystone.service[82354]: warnings.warn(msg) Aug 23 04:20:40.745319 dv-cinder-854070-1-smb devstack@keystone.service[82354]: Aug 23 04:20:40.747942 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe09fd-ca1d-4a25-a17a-9e4b0013c32f admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:20:40.816692 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 749/1501] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:20:40 2022] PUT /identity/v3/projects/5b08588027834f698a721610d94e2f66/users/7d5621747e104c3f8dba1b0e6ca2b535/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:20:40.829959 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0f00c-fe21-4ed7-abbc-d613525e2c9a None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:20:40.830383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0f00c-fe21-4ed7-abbc-d613525e2c9a None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:20:40.830779 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0f00c-fe21-4ed7-abbc-d613525e2c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:20:40.895213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-9ab0f00c-fe21-4ed7-abbc-d613525e2c9a None None] MFA Rules not processed for user `7d5621747e104c3f8dba1b0e6ca2b535`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:20:40.896556 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-9ab0f00c-fe21-4ed7-abbc-d613525e2c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:20:40.984468 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 753/1502] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:20:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:20:40.998359 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36104eda-9fc5-40b7-a333-92a8ad6a7d4a None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:20:40.998658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36104eda-9fc5-40b7-a333-92a8ad6a7d4a None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:20:40.998941 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36104eda-9fc5-40b7-a333-92a8ad6a7d4a None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:20:41.000324 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 750/1503] 10.222.0.42 () {54 vars in 964 bytes} [Tue Aug 23 04:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:20:41.005293 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150845a8-4232-40bb-a7ce-7ed5645f0abb None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:20:41.005633 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150845a8-4232-40bb-a7ce-7ed5645f0abb None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:20:41.005911 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150845a8-4232-40bb-a7ce-7ed5645f0abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:20:41.037057 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:20:41.082143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-150845a8-4232-40bb-a7ce-7ed5645f0abb None None] MFA Rules not processed for user `a0b0ac2dd135450c9bfe918f98c19425`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:20:41.083280 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-150845a8-4232-40bb-a7ce-7ed5645f0abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:20:41.157797 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 754/1504] 10.222.0.42 () {58 vars in 1061 bytes} [Tue Aug 23 04:20:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:20:41.165720 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36104eda-9fc5-40b7-a333-92a8ad6a7d4a None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:20:41.167231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-36104eda-9fc5-40b7-a333-92a8ad6a7d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:20:41.218524 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:20:41.271923 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36104eda-9fc5-40b7-a333-92a8ad6a7d4a None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:20:41.351687 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b60b5a-1a62-4cc7-9875-d70ffa381332 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:20:41.351687 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b60b5a-1a62-4cc7-9875-d70ffa381332 service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:20:41.351687 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b60b5a-1a62-4cc7-9875-d70ffa381332 service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:20:41.351687 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b60b5a-1a62-4cc7-9875-d70ffa381332 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:20:41.352119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-f8b60b5a-1a62-4cc7-9875-d70ffa381332 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:20:41.449870 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b60b5a-1a62-4cc7-9875-d70ffa381332 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:20:41.451301 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b60b5a-1a62-4cc7-9875-d70ffa381332 service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:20:41.454857 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:20:41.469368 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 751/1505] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:20:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:20:41.514049 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a6277-2b5a-4ca2-9bd9-a652ba4c772b None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:20:41.514483 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a6277-2b5a-4ca2-9bd9-a652ba4c772b None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:20:41.514611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a6277-2b5a-4ca2-9bd9-a652ba4c772b None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:20:41.515888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 755/1506] 10.222.0.42 () {52 vars in 830 bytes} [Tue Aug 23 04:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:20:41.519611 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b60b5a-1a62-4cc7-9875-d70ffa381332 service cinder] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:20:41.520851 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-f8b60b5a-1a62-4cc7-9875-d70ffa381332 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:20:41.619384 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b60b5a-1a62-4cc7-9875-d70ffa381332 service cinder] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:20:41.712603 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0abaa-c059-4c7b-a78c-e9ff82f72188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:20:41.713267 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0abaa-c059-4c7b-a78c-e9ff82f72188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:20:41.713548 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0abaa-c059-4c7b-a78c-e9ff82f72188 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:20:41.713822 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0abaa-c059-4c7b-a78c-e9ff82f72188 admin admin] PATH_INFO: `/v3/users/7d5621747e104c3f8dba1b0e6ca2b535` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:20:41.726040 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0abaa-c059-4c7b-a78c-e9ff82f72188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d5621747e104c3f8dba1b0e6ca2b535)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:20:41.727050 dv-cinder-854070-1-smb devstack@keystone.service[82354]: WARNING py.warnings [None req-7fc0abaa-c059-4c7b-a78c-e9ff82f72188 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 04:20:41.727050 dv-cinder-854070-1-smb devstack@keystone.service[82354]: warnings.warn(msg) Aug 23 04:20:41.727050 dv-cinder-854070-1-smb devstack@keystone.service[82354]: Aug 23 04:20:41.728272 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0abaa-c059-4c7b-a78c-e9ff82f72188 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:20:41.737941 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:20:41.953352 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-7fc0abaa-c059-4c7b-a78c-e9ff82f72188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d5621747e104c3f8dba1b0e6ca2b535'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:20:42.016273 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-7fc0abaa-c059-4c7b-a78c-e9ff82f72188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d5621747e104c3f8dba1b0e6ca2b535'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:20:42.033754 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-7fc0abaa-c059-4c7b-a78c-e9ff82f72188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d5621747e104c3f8dba1b0e6ca2b535'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:20:42.063017 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-7fc0abaa-c059-4c7b-a78c-e9ff82f72188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d5621747e104c3f8dba1b0e6ca2b535'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:20:42.063618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-7fc0abaa-c059-4c7b-a78c-e9ff82f72188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d5621747e104c3f8dba1b0e6ca2b535'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:20:42.069827 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 752/1507] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:20:41 2022] DELETE /identity/v3/users/7d5621747e104c3f8dba1b0e6ca2b535 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:20:42.074885 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e127d9-8d60-41c4-9a0b-4157b0bd7839 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:20:42.075246 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e127d9-8d60-41c4-9a0b-4157b0bd7839 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:20:42.083651 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e127d9-8d60-41c4-9a0b-4157b0bd7839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:20:42.145389 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-d2e127d9-8d60-41c4-9a0b-4157b0bd7839 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:20:42.146780 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-d2e127d9-8d60-41c4-9a0b-4157b0bd7839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:20:42.229185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:20:42.242971 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 756/1508] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:20:42.252844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0abaa-c059-4c7b-a78c-e9ff82f72188 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:20:42.254128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-7fc0abaa-c059-4c7b-a78c-e9ff82f72188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:20:42.360540 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0abaa-c059-4c7b-a78c-e9ff82f72188 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:20:42.416307 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:20:42.434391 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce3213-358b-4ffa-9a40-a41df3b13d0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:20:42.435004 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce3213-358b-4ffa-9a40-a41df3b13d0b service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:20:42.435286 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce3213-358b-4ffa-9a40-a41df3b13d0b service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:20:42.435560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce3213-358b-4ffa-9a40-a41df3b13d0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:20:42.444469 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce3213-358b-4ffa-9a40-a41df3b13d0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:20:42.445943 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce3213-358b-4ffa-9a40-a41df3b13d0b service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:20:42.456004 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 753/1509] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:20:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:20:43.070122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e127d9-8d60-41c4-9a0b-4157b0bd7839 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:20:43.071562 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-d2e127d9-8d60-41c4-9a0b-4157b0bd7839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:20:43.083458 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e127d9-8d60-41c4-9a0b-4157b0bd7839 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:20:43.091557 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da83a2-cb05-4857-9311-472b05bde366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:20:43.091557 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da83a2-cb05-4857-9311-472b05bde366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:20:43.091557 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da83a2-cb05-4857-9311-472b05bde366 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:20:43.091557 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da83a2-cb05-4857-9311-472b05bde366 admin admin] PATH_INFO: `/v3/projects/5b08588027834f698a721610d94e2f66` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:20:43.102535 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da83a2-cb05-4857-9311-472b05bde366 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b08588027834f698a721610d94e2f66)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:20:43.103584 dv-cinder-854070-1-smb devstack@keystone.service[82355]: WARNING py.warnings [None req-43da83a2-cb05-4857-9311-472b05bde366 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 04:20:43.103584 dv-cinder-854070-1-smb devstack@keystone.service[82355]: warnings.warn(msg) Aug 23 04:20:43.103584 dv-cinder-854070-1-smb devstack@keystone.service[82355]: Aug 23 04:20:43.104814 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da83a2-cb05-4857-9311-472b05bde366 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:20:43.255747 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-43da83a2-cb05-4857-9311-472b05bde366 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b08588027834f698a721610d94e2f66', 'request_id': 'req-43da83a2-cb05-4857-9311-472b05bde366'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:20:43.268795 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-43da83a2-cb05-4857-9311-472b05bde366 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b08588027834f698a721610d94e2f66', 'request_id': 'req-43da83a2-cb05-4857-9311-472b05bde366'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:20:43.274904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-43da83a2-cb05-4857-9311-472b05bde366 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b08588027834f698a721610d94e2f66', 'request_id': 'req-43da83a2-cb05-4857-9311-472b05bde366'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:20:43.370447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-43da83a2-cb05-4857-9311-472b05bde366 admin admin] The token cache is being invalidate because project 5b08588027834f698a721610d94e2f66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:20:43.370742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-43da83a2-cb05-4857-9311-472b05bde366 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:20:43.371408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-43da83a2-cb05-4857-9311-472b05bde366 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:20:43.373054 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 757/1510] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:20:43 2022] DELETE /identity/v3/projects/5b08588027834f698a721610d94e2f66 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:20:52.519121 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=10 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:20:53.366697 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=36,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:22:21.086593 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f608b-a630-4791-93d9-dbd40435faec None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:22:21.087212 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f608b-a630-4791-93d9-dbd40435faec None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:22:21.087212 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f608b-a630-4791-93d9-dbd40435faec None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:22:21.089058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 04:22:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:22:21.093803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439d5e5-f611-499c-ab02-c6dad4a2e65f None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:22:21.094233 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439d5e5-f611-499c-ab02-c6dad4a2e65f None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:22:21.094377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439d5e5-f611-499c-ab02-c6dad4a2e65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:22:21.141838 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-1439d5e5-f611-499c-ab02-c6dad4a2e65f None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:22:21.143049 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-1439d5e5-f611-499c-ab02-c6dad4a2e65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:22:21.202895 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 04:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:22:21.357495 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f608b-a630-4791-93d9-dbd40435faec None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:22:21.364827 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-1b6f608b-a630-4791-93d9-dbd40435faec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:22:21.458865 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f608b-a630-4791-93d9-dbd40435faec None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:22:21.464833 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158a5d3-73fb-40be-bc18-b284f91861e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:22:21.465408 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158a5d3-73fb-40be-bc18-b284f91861e9 service nova] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:22:21.465691 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158a5d3-73fb-40be-bc18-b284f91861e9 service nova] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:22:21.465962 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158a5d3-73fb-40be-bc18-b284f91861e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:22:21.473848 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4158a5d3-73fb-40be-bc18-b284f91861e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:22:21.475416 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4158a5d3-73fb-40be-bc18-b284f91861e9 service nova] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:22:21.485164 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 755/1513] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:22:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:22:22.311722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb999338-abe1-464d-be0a-25d1f1ee7091 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:22:22.312291 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb999338-abe1-464d-be0a-25d1f1ee7091 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:22:22.312399 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb999338-abe1-464d-be0a-25d1f1ee7091 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:22:22.313792 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 04:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:22:22.318487 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea432c-9b18-4965-a7b5-e69e3637f9c3 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:22:22.318915 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea432c-9b18-4965-a7b5-e69e3637f9c3 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:22:22.319034 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea432c-9b18-4965-a7b5-e69e3637f9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:22:22.339040 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-91ea432c-9b18-4965-a7b5-e69e3637f9c3 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:22:22.340236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-91ea432c-9b18-4965-a7b5-e69e3637f9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:22:22.348051 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 04:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:22:22.502944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb999338-abe1-464d-be0a-25d1f1ee7091 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:22:22.517601 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb999338-abe1-464d-be0a-25d1f1ee7091 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:22:22.525216 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c36cb-1c31-4682-9246-9f869046130c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:22:22.525825 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c36cb-1c31-4682-9246-9f869046130c service nova] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:22:22.526104 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c36cb-1c31-4682-9246-9f869046130c service nova] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:22:22.526381 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c36cb-1c31-4682-9246-9f869046130c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:22:22.535039 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c36cb-1c31-4682-9246-9f869046130c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:22:22.536703 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c36cb-1c31-4682-9246-9f869046130c service nova] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:22:22.546472 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 760/1516] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:22:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:22:22.835911 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9898586-474f-4da6-b6fb-a1652f9c989e None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:22:22.836198 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9898586-474f-4da6-b6fb-a1652f9c989e None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:22:22.836477 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9898586-474f-4da6-b6fb-a1652f9c989e None None] PATH_INFO: `/v3` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:22:22.838357 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 757/1517] 10.222.0.26 () {54 vars in 925 bytes} [Tue Aug 23 04:22:22 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:22:22.844621 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88d46e-dde0-46a8-b3e6-46fc804554fd None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:22:22.844914 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88d46e-dde0-46a8-b3e6-46fc804554fd None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:22:22.845229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88d46e-dde0-46a8-b3e6-46fc804554fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:22:22.903500 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-3c88d46e-dde0-46a8-b3e6-46fc804554fd None None] MFA Rules not processed for user `34794124b7234aeb98a15f0c2ae06a0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:22:22.904688 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-3c88d46e-dde0-46a8-b3e6-46fc804554fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:22:22.974635 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 761/1518] 10.222.0.26 () {58 vars in 1015 bytes} [Tue Aug 23 04:22:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:22:26.943601 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac6bfc-b56d-4f0f-92b8-a2f9d8af2908 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:22:26.944092 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac6bfc-b56d-4f0f-92b8-a2f9d8af2908 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:22:26.944092 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac6bfc-b56d-4f0f-92b8-a2f9d8af2908 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:22:26.945497 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 758/1519] 10.222.0.42 () {54 vars in 961 bytes} [Tue Aug 23 04:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:22:26.951227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f49bd-3f99-4dac-9697-9c4306df2a4c None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:22:26.951637 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f49bd-3f99-4dac-9697-9c4306df2a4c None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:22:26.951785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f49bd-3f99-4dac-9697-9c4306df2a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:22:26.971519 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-1d1f49bd-3f99-4dac-9697-9c4306df2a4c None None] MFA Rules not processed for user `34794124b7234aeb98a15f0c2ae06a0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:22:26.972746 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-1d1f49bd-3f99-4dac-9697-9c4306df2a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:22:26.981283 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 762/1520] 10.222.0.42 () {58 vars in 1058 bytes} [Tue Aug 23 04:22:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:22:26.988598 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac6bfc-b56d-4f0f-92b8-a2f9d8af2908 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:22:27.001687 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac6bfc-b56d-4f0f-92b8-a2f9d8af2908 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:22:27.006531 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a47bb-ea53-4a17-ba71-240327120910 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34794124b7234aeb98a15f0c2ae06a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:22:27.007121 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a47bb-ea53-4a17-ba71-240327120910 service placement] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:22:27.007403 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a47bb-ea53-4a17-ba71-240327120910 service placement] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:22:27.007677 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a47bb-ea53-4a17-ba71-240327120910 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:22:27.016254 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a47bb-ea53-4a17-ba71-240327120910 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:22:27.017872 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a47bb-ea53-4a17-ba71-240327120910 service placement] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:22:27.028429 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 759/1521] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:22:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:22:33.742167 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006c921-20f8-4682-8ca8-45db1beaf83b None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:22:33.743348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006c921-20f8-4682-8ca8-45db1beaf83b None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:22:33.743348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006c921-20f8-4682-8ca8-45db1beaf83b None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:22:33.744659 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 763/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 04:22:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:22:33.749360 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f084c-6cc4-4978-a572-5ccb6b8af49a None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:22:33.749815 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f084c-6cc4-4978-a572-5ccb6b8af49a None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:22:33.749923 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f084c-6cc4-4978-a572-5ccb6b8af49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:22:33.768948 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-234f084c-6cc4-4978-a572-5ccb6b8af49a None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:22:33.770183 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-234f084c-6cc4-4978-a572-5ccb6b8af49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:22:33.777973 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 760/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 04:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:22:33.929587 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006c921-20f8-4682-8ca8-45db1beaf83b None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:22:33.944368 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006c921-20f8-4682-8ca8-45db1beaf83b None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:22:33.952675 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a15b29-6c5a-4f6f-8cdb-562f3e089b79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:22:33.952675 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a15b29-6c5a-4f6f-8cdb-562f3e089b79 service nova] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:22:33.952675 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a15b29-6c5a-4f6f-8cdb-562f3e089b79 service nova] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:22:33.953072 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a15b29-6c5a-4f6f-8cdb-562f3e089b79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:22:33.962776 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a15b29-6c5a-4f6f-8cdb-562f3e089b79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:22:33.964564 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a15b29-6c5a-4f6f-8cdb-562f3e089b79 service nova] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:22:33.968483 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:22:33.975332 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 764/1524] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:22:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:22:34.793061 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bee3d-1367-4995-9838-ba74587c5c3c None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:22:34.793616 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bee3d-1367-4995-9838-ba74587c5c3c None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:22:34.793616 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bee3d-1367-4995-9838-ba74587c5c3c None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:22:34.795005 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 04:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:22:34.799810 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee3949-3533-4468-b940-f4f8af0cf2de None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:22:34.800222 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee3949-3533-4468-b940-f4f8af0cf2de None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:22:34.800364 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee3949-3533-4468-b940-f4f8af0cf2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:22:34.819472 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-00ee3949-3533-4468-b940-f4f8af0cf2de None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:22:34.821306 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-00ee3949-3533-4468-b940-f4f8af0cf2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:22:34.828887 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 04:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:22:34.978702 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379bee3d-1367-4995-9838-ba74587c5c3c None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:22:34.993728 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379bee3d-1367-4995-9838-ba74587c5c3c None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:22:34.999171 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26213c-af55-4763-bb4b-c9a9ea5bffd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:22:34.999764 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26213c-af55-4763-bb4b-c9a9ea5bffd5 service nova] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:22:35.000048 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26213c-af55-4763-bb4b-c9a9ea5bffd5 service nova] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:22:35.000326 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26213c-af55-4763-bb4b-c9a9ea5bffd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:22:35.008881 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26213c-af55-4763-bb4b-c9a9ea5bffd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:22:35.010497 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26213c-af55-4763-bb4b-c9a9ea5bffd5 service nova] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:22:35.019703 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 762/1527] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:22:39.695373 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba450965-8add-4d23-9756-d51cd90b6608 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:22:39.695948 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba450965-8add-4d23-9756-d51cd90b6608 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:22:39.695948 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba450965-8add-4d23-9756-d51cd90b6608 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:22:39.697342 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 04:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 04:22:39.702675 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123fe43-3863-4b81-9952-747e24989dec None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:22:39.703074 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123fe43-3863-4b81-9952-747e24989dec None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:22:39.703238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123fe43-3863-4b81-9952-747e24989dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:22:39.722443 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-d123fe43-3863-4b81-9952-747e24989dec None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:22:39.723630 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-d123fe43-3863-4b81-9952-747e24989dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:22:39.731770 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 04:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:22:40.020939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba450965-8add-4d23-9756-d51cd90b6608 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:22:40.022683 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-ba450965-8add-4d23-9756-d51cd90b6608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:22:40.099404 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba450965-8add-4d23-9756-d51cd90b6608 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:22:40.103590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fda93b-80e3-490b-8af1-5c6838d61833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:22:40.104215 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fda93b-80e3-490b-8af1-5c6838d61833 service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:22:40.104496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fda93b-80e3-490b-8af1-5c6838d61833 service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:22:40.104768 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fda93b-80e3-490b-8af1-5c6838d61833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:22:40.114311 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fda93b-80e3-490b-8af1-5c6838d61833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:22:40.115776 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fda93b-80e3-490b-8af1-5c6838d61833 service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:22:40.125107 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 767/1530] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:22:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:22:42.010440 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be2f6b-c04c-4b8c-ace3-c283facf485a None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:22:42.010974 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be2f6b-c04c-4b8c-ace3-c283facf485a None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:22:42.010974 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be2f6b-c04c-4b8c-ace3-c283facf485a None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:22:42.012327 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 04:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:22:42.017707 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9c26c-e7e0-4f0b-b339-f5b3f34f00e0 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:22:42.018138 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9c26c-e7e0-4f0b-b339-f5b3f34f00e0 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:22:42.018281 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9c26c-e7e0-4f0b-b339-f5b3f34f00e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:22:42.155576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-7ce9c26c-e7e0-4f0b-b339-f5b3f34f00e0 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:22:42.156802 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-7ce9c26c-e7e0-4f0b-b339-f5b3f34f00e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:22:42.165191 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 04:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:22:42.450907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be2f6b-c04c-4b8c-ace3-c283facf485a None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:22:42.462301 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be2f6b-c04c-4b8c-ace3-c283facf485a None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:22:42.465784 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32a08f-7f52-44f5-ab98-baa8a8e7e41a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:22:42.466383 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32a08f-7f52-44f5-ab98-baa8a8e7e41a service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:22:42.466665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32a08f-7f52-44f5-ab98-baa8a8e7e41a service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:22:42.466940 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32a08f-7f52-44f5-ab98-baa8a8e7e41a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:22:42.475635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32a08f-7f52-44f5-ab98-baa8a8e7e41a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:22:42.477733 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32a08f-7f52-44f5-ab98-baa8a8e7e41a service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:22:42.489683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 765/1533] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:22:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:22:45.849041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf340b4-f761-4d34-b174-e3a07054b1d0 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:22:45.849602 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf340b4-f761-4d34-b174-e3a07054b1d0 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:22:45.849602 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf340b4-f761-4d34-b174-e3a07054b1d0 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:22:45.850972 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 04:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:22:45.856291 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bc6f3-f7b6-473c-9112-52802e6b9c1f None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:22:45.856761 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bc6f3-f7b6-473c-9112-52802e6b9c1f None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:22:45.856869 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bc6f3-f7b6-473c-9112-52802e6b9c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:22:45.864384 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=74 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:22:45.876170 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-272bc6f3-f7b6-473c-9112-52802e6b9c1f None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:22:45.886326 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-272bc6f3-f7b6-473c-9112-52802e6b9c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:22:45.886326 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 04:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:22:46.434798 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf340b4-f761-4d34-b174-e3a07054b1d0 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:22:46.436462 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-caf340b4-f761-4d34-b174-e3a07054b1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:22:46.512769 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf340b4-f761-4d34-b174-e3a07054b1d0 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:22:46.516296 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cded6f3-9a28-4e67-87d7-6c4280594830 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:22:46.516902 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cded6f3-9a28-4e67-87d7-6c4280594830 service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:22:46.517210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cded6f3-9a28-4e67-87d7-6c4280594830 service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:22:46.517482 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cded6f3-9a28-4e67-87d7-6c4280594830 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:22:46.526230 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cded6f3-9a28-4e67-87d7-6c4280594830 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:22:46.527658 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cded6f3-9a28-4e67-87d7-6c4280594830 service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:22:46.536871 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 770/1536] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:22:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:22:48.467034 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6dc624-1a54-46f8-aef3-af6e6f897d8e None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:22:48.467671 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6dc624-1a54-46f8-aef3-af6e6f897d8e None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:22:48.467671 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6dc624-1a54-46f8-aef3-af6e6f897d8e None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:22:48.468977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 04:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:22:48.474280 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392b1ae-2afb-4b7a-9805-ed91512dbb47 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:22:48.474709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392b1ae-2afb-4b7a-9805-ed91512dbb47 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:22:48.474821 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392b1ae-2afb-4b7a-9805-ed91512dbb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:22:48.494210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-5392b1ae-2afb-4b7a-9805-ed91512dbb47 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:22:48.495387 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-5392b1ae-2afb-4b7a-9805-ed91512dbb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:22:48.502992 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 04:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:22:49.053693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6dc624-1a54-46f8-aef3-af6e6f897d8e None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:22:49.055919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-ff6dc624-1a54-46f8-aef3-af6e6f897d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:22:49.068918 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6dc624-1a54-46f8-aef3-af6e6f897d8e None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:22:49.073035 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53beef04-a892-46a6-863d-d1bec4f5fba1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:22:49.073671 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53beef04-a892-46a6-863d-d1bec4f5fba1 service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:22:49.073950 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53beef04-a892-46a6-863d-d1bec4f5fba1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:22:49.074220 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53beef04-a892-46a6-863d-d1bec4f5fba1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:22:49.082968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53beef04-a892-46a6-863d-d1bec4f5fba1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:22:49.084377 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53beef04-a892-46a6-863d-d1bec4f5fba1 service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:22:49.093542 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 768/1539] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:22:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:22:58.489498 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=76 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:22:59.089492 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=8 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:17.287325 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04253b1d-4cb0-4bd7-8bf0-d98c8224c5ba None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:17.288608 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04253b1d-4cb0-4bd7-8bf0-d98c8224c5ba None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:17.292546 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04253b1d-4cb0-4bd7-8bf0-d98c8224c5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:17.303090 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b3c45-6a49-41d0-89a4-e6405db46815 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:17.303680 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b3c45-6a49-41d0-89a4-e6405db46815 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:17.303680 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b3c45-6a49-41d0-89a4-e6405db46815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:17.334052 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-04253b1d-4cb0-4bd7-8bf0-d98c8224c5ba None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:17.335313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-04253b1d-4cb0-4bd7-8bf0-d98c8224c5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:17.346801 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-fc1b3c45-6a49-41d0-89a4-e6405db46815 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:17.348016 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-fc1b3c45-6a49-41d0-89a4-e6405db46815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:17.365920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 772/1540] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:17.375411 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 769/1541] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:24:17.376770 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173e5a4-0bf7-4e7f-a2b9-801617afaf5f None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:17.377057 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173e5a4-0bf7-4e7f-a2b9-801617afaf5f None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:17.377407 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173e5a4-0bf7-4e7f-a2b9-801617afaf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:17.384373 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fa9bd-54fc-4a12-b25a-4bd79e0e8827 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:17.384663 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fa9bd-54fc-4a12-b25a-4bd79e0e8827 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:17.384939 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fa9bd-54fc-4a12-b25a-4bd79e0e8827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:17.416383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-8173e5a4-0bf7-4e7f-a2b9-801617afaf5f None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:17.417618 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-8173e5a4-0bf7-4e7f-a2b9-801617afaf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:17.429655 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-3b2fa9bd-54fc-4a12-b25a-4bd79e0e8827 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:17.430866 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-3b2fa9bd-54fc-4a12-b25a-4bd79e0e8827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:17.440319 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 773/1542] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:17.444886 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173e5a4-0bf7-4e7f-a2b9-801617afaf5f None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:17.453670 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 770/1543] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:17.460180 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fa9bd-54fc-4a12-b25a-4bd79e0e8827 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:17.473114 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173e5a4-0bf7-4e7f-a2b9-801617afaf5f None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:17.482445 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fa9bd-54fc-4a12-b25a-4bd79e0e8827 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:17.486814 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5919c32c-e0eb-43ef-bd89-2fbc4dcf543f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:17.487901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919c32c-e0eb-43ef-bd89-2fbc4dcf543f admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:17.488345 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919c32c-e0eb-43ef-bd89-2fbc4dcf543f admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:17.489342 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919c32c-e0eb-43ef-bd89-2fbc4dcf543f admin admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:17.491263 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5919c32c-e0eb-43ef-bd89-2fbc4dcf543f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:24:17.491774 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5919c32c-e0eb-43ef-bd89-2fbc4dcf543f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:17.493990 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5919c32c-e0eb-43ef-bd89-2fbc4dcf543f admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:17.497320 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0446cd-8649-45c1-b0d0-c14ff9fd760b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:17.498495 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0446cd-8649-45c1-b0d0-c14ff9fd760b admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:17.499010 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0446cd-8649-45c1-b0d0-c14ff9fd760b admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:17.499437 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0446cd-8649-45c1-b0d0-c14ff9fd760b admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:17.500286 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0446cd-8649-45c1-b0d0-c14ff9fd760b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:24:17.501214 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0446cd-8649-45c1-b0d0-c14ff9fd760b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:17.503368 dv-cinder-854070-1-smb devstack@keystone.service[82354]: WARNING py.warnings [None req-4e0446cd-8649-45c1-b0d0-c14ff9fd760b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 04:24:17.503368 dv-cinder-854070-1-smb devstack@keystone.service[82354]: warnings.warn(msg) Aug 23 04:24:17.503368 dv-cinder-854070-1-smb devstack@keystone.service[82354]: Aug 23 04:24:17.507971 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0446cd-8649-45c1-b0d0-c14ff9fd760b admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:17.530952 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 774/1544] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:24:17.532652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae7356-0cfc-4dce-a825-f7956335d738 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:17.534391 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae7356-0cfc-4dce-a825-f7956335d738 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:17.534999 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae7356-0cfc-4dce-a825-f7956335d738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:17.542703 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 771/1545] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:24:17.543732 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0446cd-8649-45c1-b0d0-c14ff9fd760b admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:17.564900 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0446cd-8649-45c1-b0d0-c14ff9fd760b admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:17.573054 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-d3ae7356-0cfc-4dce-a825-f7956335d738 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:17.575278 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-d3ae7356-0cfc-4dce-a825-f7956335d738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:17.577548 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9ed55-2196-4d5a-939c-47e9adee5fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:17.578409 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9ed55-2196-4d5a-939c-47e9adee5fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:17.579253 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9ed55-2196-4d5a-939c-47e9adee5fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:17.579952 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9ed55-2196-4d5a-939c-47e9adee5fa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:17.580807 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9ed55-2196-4d5a-939c-47e9adee5fa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:17.585701 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9ed55-2196-4d5a-939c-47e9adee5fa5 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:17.594879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 775/1546] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:17.595991 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae7356-0cfc-4dce-a825-f7956335d738 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:17.609694 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae7356-0cfc-4dce-a825-f7956335d738 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:17.615391 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035c0e7-edd4-453c-9d57-62f519903970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:17.616285 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035c0e7-edd4-453c-9d57-62f519903970 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:17.616565 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035c0e7-edd4-453c-9d57-62f519903970 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:17.616832 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035c0e7-edd4-453c-9d57-62f519903970 admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:17.617499 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035c0e7-edd4-453c-9d57-62f519903970 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:17.618512 dv-cinder-854070-1-smb devstack@keystone.service[82355]: WARNING py.warnings [None req-c035c0e7-edd4-453c-9d57-62f519903970 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 04:24:17.618512 dv-cinder-854070-1-smb devstack@keystone.service[82355]: warnings.warn(msg) Aug 23 04:24:17.618512 dv-cinder-854070-1-smb devstack@keystone.service[82355]: Aug 23 04:24:17.619790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035c0e7-edd4-453c-9d57-62f519903970 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:17.703784 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 772/1547] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:24:17 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:17.705142 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd5a13-d742-483c-a544-5a443d118988 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:17.705433 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd5a13-d742-483c-a544-5a443d118988 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:17.705706 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd5a13-d742-483c-a544-5a443d118988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:17.726506 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-58dd5a13-d742-483c-a544-5a443d118988 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:17.727700 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-58dd5a13-d742-483c-a544-5a443d118988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:17.732151 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 776/1548] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:24:17 2022] POST /identity/v3/projects => generated 393 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:17.734206 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e804a9-d80f-45e7-9662-b315c2c92d79 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:17.734625 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e804a9-d80f-45e7-9662-b315c2c92d79 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:17.734908 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e804a9-d80f-45e7-9662-b315c2c92d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:17.753589 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-80e804a9-d80f-45e7-9662-b315c2c92d79 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:17.754785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-80e804a9-d80f-45e7-9662-b315c2c92d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:17.786742 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 773/1549] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:17.787838 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4535ac-d4aa-47e4-900b-0609ab12b137 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:17.788132 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4535ac-d4aa-47e4-900b-0609ab12b137 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:17.788408 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4535ac-d4aa-47e4-900b-0609ab12b137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:17.807101 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-7c4535ac-d4aa-47e4-900b-0609ab12b137 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:17.808222 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-7c4535ac-d4aa-47e4-900b-0609ab12b137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:17.821994 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 777/1550] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:17.823309 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cf3e9-60c5-494e-a8b0-d8430bb3b6bb None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:17.823600 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cf3e9-60c5-494e-a8b0-d8430bb3b6bb None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:17.823870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cf3e9-60c5-494e-a8b0-d8430bb3b6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:17.846365 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-ea3cf3e9-60c5-494e-a8b0-d8430bb3b6bb None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:17.847567 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-ea3cf3e9-60c5-494e-a8b0-d8430bb3b6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:17.855610 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 778/1551] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:17.856792 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142038ab-d385-4954-8be4-adcf989eea94 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:17.857076 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142038ab-d385-4954-8be4-adcf989eea94 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:17.857378 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142038ab-d385-4954-8be4-adcf989eea94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:17.874210 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 774/1552] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:17.875459 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93402d-1f37-477d-b156-b7db873cc30c None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:17.875750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93402d-1f37-477d-b156-b7db873cc30c None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:17.876021 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-142038ab-d385-4954-8be4-adcf989eea94 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:17.876140 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93402d-1f37-477d-b156-b7db873cc30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:17.877263 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-142038ab-d385-4954-8be4-adcf989eea94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:17.886981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 779/1553] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:17.887632 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142038ab-d385-4954-8be4-adcf989eea94 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:17.897891 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142038ab-d385-4954-8be4-adcf989eea94 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:17.902567 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d36ec-835d-4fb1-84a6-06e804c0348d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:17.902798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-2b93402d-1f37-477d-b156-b7db873cc30c None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:17.903165 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d36ec-835d-4fb1-84a6-06e804c0348d admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:17.903445 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d36ec-835d-4fb1-84a6-06e804c0348d admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:17.903717 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d36ec-835d-4fb1-84a6-06e804c0348d admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:17.904002 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-2b93402d-1f37-477d-b156-b7db873cc30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:17.904337 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82d36ec-835d-4fb1-84a6-06e804c0348d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:17.906290 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82d36ec-835d-4fb1-84a6-06e804c0348d admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:17.911964 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 775/1554] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:17.912712 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93402d-1f37-477d-b156-b7db873cc30c None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:17.923870 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93402d-1f37-477d-b156-b7db873cc30c None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:17.928822 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d3447-a91b-4f5d-8377-2d7815939c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:17.929472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d3447-a91b-4f5d-8377-2d7815939c67 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:17.929776 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d3447-a91b-4f5d-8377-2d7815939c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:17.932351 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d3447-a91b-4f5d-8377-2d7815939c67 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:17.932351 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d3447-a91b-4f5d-8377-2d7815939c67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:17.932351 dv-cinder-854070-1-smb devstack@keystone.service[82354]: WARNING py.warnings [None req-a47d3447-a91b-4f5d-8377-2d7815939c67 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 04:24:17.932351 dv-cinder-854070-1-smb devstack@keystone.service[82354]: warnings.warn(msg) Aug 23 04:24:17.932351 dv-cinder-854070-1-smb devstack@keystone.service[82354]: Aug 23 04:24:17.932869 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d3447-a91b-4f5d-8377-2d7815939c67 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:18.015980 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 780/1555] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:24:17 2022] POST /identity/v3/users => generated 287 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:18.017258 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88ec59-f8a7-4b1b-8f74-345a7c48c926 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:18.017549 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88ec59-f8a7-4b1b-8f74-345a7c48c926 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:18.017825 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88ec59-f8a7-4b1b-8f74-345a7c48c926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:18.041786 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 776/1556] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:24:17 2022] POST /identity/v3/users => generated 297 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:18.042015 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-6e88ec59-f8a7-4b1b-8f74-345a7c48c926 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:18.042126 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e33ba-6016-4c97-b430-b94f14bb3c31 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:18.042217 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-6e88ec59-f8a7-4b1b-8f74-345a7c48c926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:18.042305 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e33ba-6016-4c97-b430-b94f14bb3c31 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:18.042305 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e33ba-6016-4c97-b430-b94f14bb3c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:18.052641 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 781/1557] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:18.052641 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88ec59-f8a7-4b1b-8f74-345a7c48c926 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:18.059558 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88ec59-f8a7-4b1b-8f74-345a7c48c926 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:18.060669 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-c38e33ba-6016-4c97-b430-b94f14bb3c31 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:18.061926 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c38e33ba-6016-4c97-b430-b94f14bb3c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:18.064050 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81054e-3940-4db1-9e5f-5ff821cdf8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:18.064673 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81054e-3940-4db1-9e5f-5ff821cdf8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:18.064969 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81054e-3940-4db1-9e5f-5ff821cdf8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:18.065271 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81054e-3940-4db1-9e5f-5ff821cdf8c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:18.065967 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81054e-3940-4db1-9e5f-5ff821cdf8c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:24:18.066266 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81054e-3940-4db1-9e5f-5ff821cdf8c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:18.068347 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81054e-3940-4db1-9e5f-5ff821cdf8c7 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:18.070273 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 777/1558] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:18.071448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268052c-4d8e-4e8e-922d-d2d44d27d6aa None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:18.071737 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268052c-4d8e-4e8e-922d-d2d44d27d6aa None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:18.072011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268052c-4d8e-4e8e-922d-d2d44d27d6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:18.084603 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 782/1559] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:24:18.085914 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914f2b4-021c-4a63-8954-461c4d7adcf6 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:18.086200 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914f2b4-021c-4a63-8954-461c4d7adcf6 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:18.086469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914f2b4-021c-4a63-8954-461c4d7adcf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:18.093229 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-f268052c-4d8e-4e8e-922d-d2d44d27d6aa None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:18.094439 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-f268052c-4d8e-4e8e-922d-d2d44d27d6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:18.102310 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 778/1560] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:18.103500 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2ea1f-1244-42c4-94ea-88b6d9c9b5c8 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:18.103787 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2ea1f-1244-42c4-94ea-88b6d9c9b5c8 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:18.104064 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2ea1f-1244-42c4-94ea-88b6d9c9b5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:18.106785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-b914f2b4-021c-4a63-8954-461c4d7adcf6 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:18.107959 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-b914f2b4-021c-4a63-8954-461c4d7adcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:18.116199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 783/1561] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:18.117024 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914f2b4-021c-4a63-8954-461c4d7adcf6 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:18.120226 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:18.123929 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-d9e2ea1f-1244-42c4-94ea-88b6d9c9b5c8 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:18.125246 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-d9e2ea1f-1244-42c4-94ea-88b6d9c9b5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:18.126165 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914f2b4-021c-4a63-8954-461c4d7adcf6 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:18.131315 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c5363-ddc7-4d0e-b61b-12e5229c9c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:18.131903 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c5363-ddc7-4d0e-b61b-12e5229c9c1a admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:18.132176 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c5363-ddc7-4d0e-b61b-12e5229c9c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:18.132443 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c5363-ddc7-4d0e-b61b-12e5229c9c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:18.133080 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c5363-ddc7-4d0e-b61b-12e5229c9c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:18.134161 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 779/1562] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:18.134795 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c5363-ddc7-4d0e-b61b-12e5229c9c1a admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:18.134924 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2ea1f-1244-42c4-94ea-88b6d9c9b5c8 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:18.144031 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2ea1f-1244-42c4-94ea-88b6d9c9b5c8 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:18.147734 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 784/1563] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:18.147734 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c5363-ddc7-4d0e-b61b-12e5229c9c1a admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:18.159893 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4153f1-ee0b-4196-9750-4c2999361f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:18.159893 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4153f1-ee0b-4196-9750-4c2999361f6d admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:18.159893 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4153f1-ee0b-4196-9750-4c2999361f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:18.159893 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4153f1-ee0b-4196-9750-4c2999361f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:18.160285 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4153f1-ee0b-4196-9750-4c2999361f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:18.160285 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4153f1-ee0b-4196-9750-4c2999361f6d admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:18.160472 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c5363-ddc7-4d0e-b61b-12e5229c9c1a admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:18.162616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8ea3b-cd8b-4b97-ae10-fd54c782abfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:18.163213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8ea3b-cd8b-4b97-ae10-fd54c782abfd admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:18.163493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8ea3b-cd8b-4b97-ae10-fd54c782abfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:18.163766 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8ea3b-cd8b-4b97-ae10-fd54c782abfd admin admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:18.167095 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 780/1564] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:18.167210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc8ea3b-cd8b-4b97-ae10-fd54c782abfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:24:18.167312 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4153f1-ee0b-4196-9750-4c2999361f6d admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:18.167392 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc8ea3b-cd8b-4b97-ae10-fd54c782abfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:18.167392 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc8ea3b-cd8b-4b97-ae10-fd54c782abfd admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:18.175879 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4153f1-ee0b-4196-9750-4c2999361f6d admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:18.179236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 785/1565] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:24:18.180016 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8ea3b-cd8b-4b97-ae10-fd54c782abfd admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:18.180962 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7fe47-31fc-40bd-97ae-0984d2d3deaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:18.181587 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7fe47-31fc-40bd-97ae-0984d2d3deaa admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:18.181875 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7fe47-31fc-40bd-97ae-0984d2d3deaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:18.182151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7fe47-31fc-40bd-97ae-0984d2d3deaa admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:18.182797 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7fe47-31fc-40bd-97ae-0984d2d3deaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:24:18.183109 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7fe47-31fc-40bd-97ae-0984d2d3deaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:18.184698 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7fe47-31fc-40bd-97ae-0984d2d3deaa admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:18.190384 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8ea3b-cd8b-4b97-ae10-fd54c782abfd admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:18.196590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf48502-dc5f-4e7d-b298-5342fce1aab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:18.197334 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf48502-dc5f-4e7d-b298-5342fce1aab1 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:18.197620 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf48502-dc5f-4e7d-b298-5342fce1aab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:18.197887 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 781/1566] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:24:18.198038 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf48502-dc5f-4e7d-b298-5342fce1aab1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:18.198646 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf48502-dc5f-4e7d-b298-5342fce1aab1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:18.198770 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7fe47-31fc-40bd-97ae-0984d2d3deaa admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:18.200555 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf48502-dc5f-4e7d-b298-5342fce1aab1 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:18.208150 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7fe47-31fc-40bd-97ae-0984d2d3deaa admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:18.212697 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08966e1-09e3-4207-99c9-11e1b47f9c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:18.215496 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08966e1-09e3-4207-99c9-11e1b47f9c6a admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:18.215496 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08966e1-09e3-4207-99c9-11e1b47f9c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:18.215496 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08966e1-09e3-4207-99c9-11e1b47f9c6a admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:18.215496 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08966e1-09e3-4207-99c9-11e1b47f9c6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:24:18.215496 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08966e1-09e3-4207-99c9-11e1b47f9c6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:18.216372 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08966e1-09e3-4207-99c9-11e1b47f9c6a admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:18.228118 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 782/1567] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:24:18.228939 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08966e1-09e3-4207-99c9-11e1b47f9c6a admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:18.238344 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08966e1-09e3-4207-99c9-11e1b47f9c6a admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:18.243474 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5565fdb-3fd7-4335-a30c-5ca48324083b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:18.244082 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5565fdb-3fd7-4335-a30c-5ca48324083b admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:18.248481 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5565fdb-3fd7-4335-a30c-5ca48324083b admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:18.248481 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5565fdb-3fd7-4335-a30c-5ca48324083b admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:18.248481 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5565fdb-3fd7-4335-a30c-5ca48324083b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:24:18.248481 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5565fdb-3fd7-4335-a30c-5ca48324083b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:18.248481 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5565fdb-3fd7-4335-a30c-5ca48324083b admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:18.259900 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 783/1568] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:24:18.260658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5565fdb-3fd7-4335-a30c-5ca48324083b admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:18.269894 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5565fdb-3fd7-4335-a30c-5ca48324083b admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:18.274873 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72f3fc-b803-4a5d-bdcf-b3e95c083637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:18.277213 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72f3fc-b803-4a5d-bdcf-b3e95c083637 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:18.277213 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72f3fc-b803-4a5d-bdcf-b3e95c083637 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:18.277213 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72f3fc-b803-4a5d-bdcf-b3e95c083637 admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:18.277213 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72f3fc-b803-4a5d-bdcf-b3e95c083637 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:24:18.277213 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72f3fc-b803-4a5d-bdcf-b3e95c083637 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:18.278593 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72f3fc-b803-4a5d-bdcf-b3e95c083637 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:18.290203 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 784/1569] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:24:18.290968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72f3fc-b803-4a5d-bdcf-b3e95c083637 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:18.300618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72f3fc-b803-4a5d-bdcf-b3e95c083637 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:18.304389 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 786/1570] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:24:18 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:18.305317 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf48502-dc5f-4e7d-b298-5342fce1aab1 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:18.308995 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f5438-ce98-446c-ba6d-9c520bd6c77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:18.311931 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f5438-ce98-446c-ba6d-9c520bd6c77f admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:18.312082 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:18.312192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f5438-ce98-446c-ba6d-9c520bd6c77f admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:18.312192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f5438-ce98-446c-ba6d-9c520bd6c77f admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:18.312192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f5438-ce98-446c-ba6d-9c520bd6c77f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:18.312553 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f5438-ce98-446c-ba6d-9c520bd6c77f admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:18.324570 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 785/1571] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:18.325385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f5438-ce98-446c-ba6d-9c520bd6c77f admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:18.335081 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f5438-ce98-446c-ba6d-9c520bd6c77f admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:18.370037 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf48502-dc5f-4e7d-b298-5342fce1aab1 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:18.374719 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6a594-c96c-4790-a702-d7473dc40fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:18.375327 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6a594-c96c-4790-a702-d7473dc40fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:18.375606 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6a594-c96c-4790-a702-d7473dc40fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:18.375880 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6a594-c96c-4790-a702-d7473dc40fe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:18.376532 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6a594-c96c-4790-a702-d7473dc40fe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:18.378157 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6a594-c96c-4790-a702-d7473dc40fe2 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:18.391868 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 787/1572] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:18.391868 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6a594-c96c-4790-a702-d7473dc40fe2 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:18.398063 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a401c1-372d-45ac-b13e-13f9260e2771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:18.398063 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a401c1-372d-45ac-b13e-13f9260e2771 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:18.398063 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a401c1-372d-45ac-b13e-13f9260e2771 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:18.398063 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a401c1-372d-45ac-b13e-13f9260e2771 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:18.398451 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a401c1-372d-45ac-b13e-13f9260e2771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:18.398451 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a401c1-372d-45ac-b13e-13f9260e2771 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:18.400571 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6a594-c96c-4790-a702-d7473dc40fe2 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:18.405537 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92fee1-399a-454a-b926-71de136369a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:18.406178 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92fee1-399a-454a-b926-71de136369a0 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:18.406462 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92fee1-399a-454a-b926-71de136369a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:18.406738 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92fee1-399a-454a-b926-71de136369a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:18.407468 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92fee1-399a-454a-b926-71de136369a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:18.409398 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92fee1-399a-454a-b926-71de136369a0 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:18.502278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 786/1573] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:24:18 2022] POST /identity/v3/projects => generated 383 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:18.503088 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a401c1-372d-45ac-b13e-13f9260e2771 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:18.515236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 788/1574] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:24:18 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:18.515236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92fee1-399a-454a-b926-71de136369a0 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:18.570560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a401c1-372d-45ac-b13e-13f9260e2771 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:18.581904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92fee1-399a-454a-b926-71de136369a0 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:18.582658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:18.586819 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ea1a2-ad7b-4bc0-94c2-fa30f1bf5c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:18.587427 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ea1a2-ad7b-4bc0-94c2-fa30f1bf5c0b admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:18.587709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ea1a2-ad7b-4bc0-94c2-fa30f1bf5c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:18.587975 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ea1a2-ad7b-4bc0-94c2-fa30f1bf5c0b admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:18.588603 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ea1a2-ad7b-4bc0-94c2-fa30f1bf5c0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:18.590652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ea1a2-ad7b-4bc0-94c2-fa30f1bf5c0b admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:18.627779 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72037c99-ae2c-484b-88ab-b8083eed7e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:18.628398 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72037c99-ae2c-484b-88ab-b8083eed7e0f admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:18.628689 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72037c99-ae2c-484b-88ab-b8083eed7e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:18.628963 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72037c99-ae2c-484b-88ab-b8083eed7e0f admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:18.629619 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72037c99-ae2c-484b-88ab-b8083eed7e0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:18.631523 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72037c99-ae2c-484b-88ab-b8083eed7e0f admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:18.674502 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 789/1575] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:24:18 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:18.675311 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ea1a2-ad7b-4bc0-94c2-fa30f1bf5c0b admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:18.736048 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ea1a2-ad7b-4bc0-94c2-fa30f1bf5c0b admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:18.737150 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 787/1576] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:24:18 2022] POST /identity/v3/projects => generated 379 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:18.737965 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72037c99-ae2c-484b-88ab-b8083eed7e0f admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:18.743854 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:18.794278 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd66f8-ef0f-4ee3-8034-0d3fd748a2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:18.794905 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd66f8-ef0f-4ee3-8034-0d3fd748a2ff admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:18.795188 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd66f8-ef0f-4ee3-8034-0d3fd748a2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:18.795461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd66f8-ef0f-4ee3-8034-0d3fd748a2ff admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:18.796148 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd66f8-ef0f-4ee3-8034-0d3fd748a2ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:18.798205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd66f8-ef0f-4ee3-8034-0d3fd748a2ff admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:18.801745 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72037c99-ae2c-484b-88ab-b8083eed7e0f admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:18.806489 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab12f5-da39-46cd-8ff5-e7f2a7a10469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:18.807104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab12f5-da39-46cd-8ff5-e7f2a7a10469 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:18.807388 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab12f5-da39-46cd-8ff5-e7f2a7a10469 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:18.807664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab12f5-da39-46cd-8ff5-e7f2a7a10469 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:18.808349 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab12f5-da39-46cd-8ff5-e7f2a7a10469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:18.810353 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab12f5-da39-46cd-8ff5-e7f2a7a10469 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:18.891414 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 790/1577] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:24:18 2022] POST /identity/v3/projects => generated 365 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:18.895982 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd66f8-ef0f-4ee3-8034-0d3fd748a2ff admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:18.904825 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 788/1578] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:24:18 2022] POST /identity/v3/users => generated 283 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:18.904825 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab12f5-da39-46cd-8ff5-e7f2a7a10469 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:18.912905 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab12f5-da39-46cd-8ff5-e7f2a7a10469 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:18.957765 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd66f8-ef0f-4ee3-8034-0d3fd748a2ff admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:18.963545 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d1377-c13e-4c60-8da2-8143c9f97f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:18.964221 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d1377-c13e-4c60-8da2-8143c9f97f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:18.964535 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d1377-c13e-4c60-8da2-8143c9f97f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:18.964811 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d1377-c13e-4c60-8da2-8143c9f97f5b admin admin] PATH_INFO: `/v3/projects/04f98c8ca13949afab24111662b0211e/users/1593ffd00886475494a971229d69264a/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:18.979998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19e731-60b9-4297-9f8f-c56b8390bed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:18.980377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d1377-c13e-4c60-8da2-8143c9f97f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=04f98c8ca13949afab24111662b0211e, user_id=1593ffd00886475494a971229d69264a, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:18.980676 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19e731-60b9-4297-9f8f-c56b8390bed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:18.980960 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19e731-60b9-4297-9f8f-c56b8390bed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:18.981272 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19e731-60b9-4297-9f8f-c56b8390bed9 admin admin] PATH_INFO: `/v3/projects/35752811e3744b2e8ede5cd06648a9cb/users/a42dcd2083e7477caeb79bedbcde3643/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:18.981447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: WARNING py.warnings [None req-374d1377-c13e-4c60-8da2-8143c9f97f5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 04:24:18.981447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: warnings.warn(msg) Aug 23 04:24:18.981447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: Aug 23 04:24:18.983426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d1377-c13e-4c60-8da2-8143c9f97f5b admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:18.996207 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19e731-60b9-4297-9f8f-c56b8390bed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35752811e3744b2e8ede5cd06648a9cb, user_id=a42dcd2083e7477caeb79bedbcde3643, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:18.999031 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19e731-60b9-4297-9f8f-c56b8390bed9 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:19.073029 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 791/1579] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:18 2022] PUT /identity/v3/projects/04f98c8ca13949afab24111662b0211e/users/1593ffd00886475494a971229d69264a/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:19.073863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d1377-c13e-4c60-8da2-8143c9f97f5b admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:19.113549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 789/1580] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:18 2022] PUT /identity/v3/projects/35752811e3744b2e8ede5cd06648a9cb/users/a42dcd2083e7477caeb79bedbcde3643/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:19.114473 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19e731-60b9-4297-9f8f-c56b8390bed9 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:19.133861 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:19.136239 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d1377-c13e-4c60-8da2-8143c9f97f5b admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:19.156456 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:19.178825 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19e731-60b9-4297-9f8f-c56b8390bed9 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:19.183468 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a17a51-e570-4de6-bab4-812a6a77219d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:19.184078 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a17a51-e570-4de6-bab4-812a6a77219d admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:19.184361 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a17a51-e570-4de6-bab4-812a6a77219d admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:19.184649 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a17a51-e570-4de6-bab4-812a6a77219d admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:19.185355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a17a51-e570-4de6-bab4-812a6a77219d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:19.187346 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a17a51-e570-4de6-bab4-812a6a77219d admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:19.194198 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fddb360-b30c-4b33-906b-01a8817f139c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:19.194821 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddb360-b30c-4b33-906b-01a8817f139c admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:19.195102 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddb360-b30c-4b33-906b-01a8817f139c admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:19.195373 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddb360-b30c-4b33-906b-01a8817f139c admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:19.196031 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fddb360-b30c-4b33-906b-01a8817f139c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:19.197979 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fddb360-b30c-4b33-906b-01a8817f139c admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:19.299157 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 790/1581] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:24:19 2022] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:19.299157 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a17a51-e570-4de6-bab4-812a6a77219d admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:19.306415 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a17a51-e570-4de6-bab4-812a6a77219d admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:19.310999 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b620d-9ec7-4e56-90d7-f5fe069de3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:19.311589 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b620d-9ec7-4e56-90d7-f5fe069de3e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:19.311853 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b620d-9ec7-4e56-90d7-f5fe069de3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:19.312127 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b620d-9ec7-4e56-90d7-f5fe069de3e6 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:19.312735 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b620d-9ec7-4e56-90d7-f5fe069de3e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:19.314883 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b620d-9ec7-4e56-90d7-f5fe069de3e6 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:19.326751 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 792/1582] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:24:19 2022] POST /identity/v3/users => generated 292 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:19.326751 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fddb360-b30c-4b33-906b-01a8817f139c admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:19.336882 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fddb360-b30c-4b33-906b-01a8817f139c admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:19.341809 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07475dd-badf-44c8-a13f-cdcf4f12bb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:19.342410 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07475dd-badf-44c8-a13f-cdcf4f12bb02 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:19.342691 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07475dd-badf-44c8-a13f-cdcf4f12bb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:19.342962 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07475dd-badf-44c8-a13f-cdcf4f12bb02 admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:19.343588 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07475dd-badf-44c8-a13f-cdcf4f12bb02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:19.345563 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07475dd-badf-44c8-a13f-cdcf4f12bb02 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:19.399935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 791/1583] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:24:19 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:19.400888 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b620d-9ec7-4e56-90d7-f5fe069de3e6 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:19.410656 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b620d-9ec7-4e56-90d7-f5fe069de3e6 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:19.415559 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afbcb1-644b-4e4c-b00b-52a9a6e27837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:19.417113 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afbcb1-644b-4e4c-b00b-52a9a6e27837 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:19.417219 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 793/1584] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:24:19 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:19.417306 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afbcb1-644b-4e4c-b00b-52a9a6e27837 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:19.417306 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afbcb1-644b-4e4c-b00b-52a9a6e27837 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:19.417504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07475dd-badf-44c8-a13f-cdcf4f12bb02 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:19.417692 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1afbcb1-644b-4e4c-b00b-52a9a6e27837 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:19.419601 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1afbcb1-644b-4e4c-b00b-52a9a6e27837 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:19.429138 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07475dd-badf-44c8-a13f-cdcf4f12bb02 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:19.433831 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18212e5-8649-4bd8-b6e7-f2dacd42660a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:19.434446 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18212e5-8649-4bd8-b6e7-f2dacd42660a admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:19.434721 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18212e5-8649-4bd8-b6e7-f2dacd42660a admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:19.435005 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18212e5-8649-4bd8-b6e7-f2dacd42660a admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:19.435645 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18212e5-8649-4bd8-b6e7-f2dacd42660a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:19.437288 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18212e5-8649-4bd8-b6e7-f2dacd42660a admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:19.448532 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 794/1585] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:19.449676 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0413b-5fe3-453a-b3a9-2ff750d317f4 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:19.449955 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0413b-5fe3-453a-b3a9-2ff750d317f4 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:19.450222 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0413b-5fe3-453a-b3a9-2ff750d317f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:19.476639 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-2aa0413b-5fe3-453a-b3a9-2ff750d317f4 None None] MFA Rules not processed for user `1593ffd00886475494a971229d69264a`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:19.478246 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-2aa0413b-5fe3-453a-b3a9-2ff750d317f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:19.496878 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 792/1586] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:24:19 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:19.500887 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bebe21-60ef-4d26-82f1-f191def87632 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:19.500887 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bebe21-60ef-4d26-82f1-f191def87632 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:19.500887 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bebe21-60ef-4d26-82f1-f191def87632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:19.517859 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-e0bebe21-60ef-4d26-82f1-f191def87632 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:19.519080 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-e0bebe21-60ef-4d26-82f1-f191def87632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:19.527679 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 793/1587] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:19.528583 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bebe21-60ef-4d26-82f1-f191def87632 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:19.538736 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bebe21-60ef-4d26-82f1-f191def87632 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:19.543677 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883245b7-b00e-4230-8f57-68bb6b166edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:19.544290 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883245b7-b00e-4230-8f57-68bb6b166edd admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:19.544567 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883245b7-b00e-4230-8f57-68bb6b166edd admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:19.544836 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883245b7-b00e-4230-8f57-68bb6b166edd admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:19.545516 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883245b7-b00e-4230-8f57-68bb6b166edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:19.547228 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883245b7-b00e-4230-8f57-68bb6b166edd admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:19.555078 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 795/1588] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:19.556125 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0413b-5fe3-453a-b3a9-2ff750d317f4 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:19.558505 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 794/1589] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:19.559224 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883245b7-b00e-4230-8f57-68bb6b166edd admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:19.571348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0413b-5fe3-453a-b3a9-2ff750d317f4 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:19.571531 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883245b7-b00e-4230-8f57-68bb6b166edd admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:19.576150 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603eb8b-a7b4-4509-98c2-f7d7dbeb2892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:19.576343 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f922f-60d7-4c01-ab00-c915d34abe7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:19.576764 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603eb8b-a7b4-4509-98c2-f7d7dbeb2892 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:19.576878 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f922f-60d7-4c01-ab00-c915d34abe7e admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:19.577046 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603eb8b-a7b4-4509-98c2-f7d7dbeb2892 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:19.577260 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f922f-60d7-4c01-ab00-c915d34abe7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:19.577420 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603eb8b-a7b4-4509-98c2-f7d7dbeb2892 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:19.577535 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f922f-60d7-4c01-ab00-c915d34abe7e admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:19.578077 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603eb8b-a7b4-4509-98c2-f7d7dbeb2892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:19.578192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f922f-60d7-4c01-ab00-c915d34abe7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:19.579681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603eb8b-a7b4-4509-98c2-f7d7dbeb2892 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:19.579831 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f922f-60d7-4c01-ab00-c915d34abe7e admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:19.592402 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 795/1590] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:19.597357 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 796/1591] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:19.597491 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603eb8b-a7b4-4509-98c2-f7d7dbeb2892 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:19.597580 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f922f-60d7-4c01-ab00-c915d34abe7e admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:19.605396 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f922f-60d7-4c01-ab00-c915d34abe7e admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:19.607051 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603eb8b-a7b4-4509-98c2-f7d7dbeb2892 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:19.610082 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b087c2-f783-45f2-9c7b-802a3625c9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:19.610685 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b087c2-f783-45f2-9c7b-802a3625c9c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:19.610968 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b087c2-f783-45f2-9c7b-802a3625c9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:19.611244 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b087c2-f783-45f2-9c7b-802a3625c9c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:19.611861 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e082eb-6b5d-4a41-b99d-5d08bd359958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:19.611983 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b087c2-f783-45f2-9c7b-802a3625c9c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:19.612455 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e082eb-6b5d-4a41-b99d-5d08bd359958 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:19.612736 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e082eb-6b5d-4a41-b99d-5d08bd359958 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:19.613011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e082eb-6b5d-4a41-b99d-5d08bd359958 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:19.613608 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b087c2-f783-45f2-9c7b-802a3625c9c4 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:19.613736 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e082eb-6b5d-4a41-b99d-5d08bd359958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:19.617148 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e082eb-6b5d-4a41-b99d-5d08bd359958 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:19.624540 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 797/1592] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:19.625380 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b087c2-f783-45f2-9c7b-802a3625c9c4 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:19.631635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 796/1593] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:19.631635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e082eb-6b5d-4a41-b99d-5d08bd359958 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:19.636033 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b087c2-f783-45f2-9c7b-802a3625c9c4 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:19.640899 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d79fc-f8f9-4965-9492-f9f6fd9c5ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:19.641576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d79fc-f8f9-4965-9492-f9f6fd9c5ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:19.641861 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d79fc-f8f9-4965-9492-f9f6fd9c5ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:19.642138 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d79fc-f8f9-4965-9492-f9f6fd9c5ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:19.642905 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d79fc-f8f9-4965-9492-f9f6fd9c5ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:19.644508 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d79fc-f8f9-4965-9492-f9f6fd9c5ac1 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:19.655563 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 798/1594] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:19.656779 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d79fc-f8f9-4965-9492-f9f6fd9c5ac1 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:19.666664 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d79fc-f8f9-4965-9492-f9f6fd9c5ac1 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:19.671122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dccd01c-bb7c-43bf-a838-1465b6036d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:19.671709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dccd01c-bb7c-43bf-a838-1465b6036d2d admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:19.671984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dccd01c-bb7c-43bf-a838-1465b6036d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:19.672256 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dccd01c-bb7c-43bf-a838-1465b6036d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:19.672891 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dccd01c-bb7c-43bf-a838-1465b6036d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:19.674481 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dccd01c-bb7c-43bf-a838-1465b6036d2d admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:19.685569 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 799/1595] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:19.686790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8bea1-3731-4abb-a858-9ffa1c0e1091 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:19.687077 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8bea1-3731-4abb-a858-9ffa1c0e1091 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:19.687349 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8bea1-3731-4abb-a858-9ffa1c0e1091 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:19.687726 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e082eb-6b5d-4a41-b99d-5d08bd359958 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:19.688645 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 800/1596] 10.222.0.42 () {54 vars in 962 bytes} [Tue Aug 23 04:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:24:19.689344 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8bea1-3731-4abb-a858-9ffa1c0e1091 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:19.691834 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b8648-40c3-44ce-bcf2-0cfa9ddbd7ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:19.693288 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b8648-40c3-44ce-bcf2-0cfa9ddbd7ea service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:19.694889 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b8648-40c3-44ce-bcf2-0cfa9ddbd7ea service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:19.694889 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b8648-40c3-44ce-bcf2-0cfa9ddbd7ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:19.702676 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8bea1-3731-4abb-a858-9ffa1c0e1091 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:19.703116 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b8648-40c3-44ce-bcf2-0cfa9ddbd7ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:19.704564 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b8648-40c3-44ce-bcf2-0cfa9ddbd7ea service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:19.707263 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c4a6b-4819-4b3e-8cda-aa67892c5b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:19.707858 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c4a6b-4819-4b3e-8cda-aa67892c5b1e admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:19.708637 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c4a6b-4819-4b3e-8cda-aa67892c5b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:19.708915 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c4a6b-4819-4b3e-8cda-aa67892c5b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:19.709617 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c4a6b-4819-4b3e-8cda-aa67892c5b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:19.711334 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c4a6b-4819-4b3e-8cda-aa67892c5b1e admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:19.714956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 797/1597] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:19.715702 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b8648-40c3-44ce-bcf2-0cfa9ddbd7ea service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:19.728055 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b8648-40c3-44ce-bcf2-0cfa9ddbd7ea service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:19.728243 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 801/1598] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:19.728243 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c4a6b-4819-4b3e-8cda-aa67892c5b1e admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:19.732712 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c959ec2-4c7c-4573-8219-4c3ff2837b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:19.733352 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c959ec2-4c7c-4573-8219-4c3ff2837b3c admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:19.733674 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c959ec2-4c7c-4573-8219-4c3ff2837b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:19.733915 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c959ec2-4c7c-4573-8219-4c3ff2837b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:19.734672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c959ec2-4c7c-4573-8219-4c3ff2837b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:19.736324 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c959ec2-4c7c-4573-8219-4c3ff2837b3c admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:19.738767 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c4a6b-4819-4b3e-8cda-aa67892c5b1e admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:19.744680 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156fac9-1c4d-4e52-a04e-d4aca0e67680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:19.745396 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156fac9-1c4d-4e52-a04e-d4aca0e67680 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:19.745678 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156fac9-1c4d-4e52-a04e-d4aca0e67680 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:19.746373 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156fac9-1c4d-4e52-a04e-d4aca0e67680 admin admin] PATH_INFO: `/v3/projects/66b8d823ff154fb3a3fd8d7b43aed30f/users/48d0bcae53794da791c8dfe05caaf030/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:19.749816 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 798/1599] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:19.752670 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c959ec2-4c7c-4573-8219-4c3ff2837b3c admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:19.763166 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c959ec2-4c7c-4573-8219-4c3ff2837b3c admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:19.763907 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8156fac9-1c4d-4e52-a04e-d4aca0e67680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66b8d823ff154fb3a3fd8d7b43aed30f, user_id=48d0bcae53794da791c8dfe05caaf030, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:19.766682 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8156fac9-1c4d-4e52-a04e-d4aca0e67680 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:19.767787 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7000e91-fd4b-4a42-938b-b59a818b1920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:19.768543 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7000e91-fd4b-4a42-938b-b59a818b1920 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:19.769122 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7000e91-fd4b-4a42-938b-b59a818b1920 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:19.769411 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7000e91-fd4b-4a42-938b-b59a818b1920 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:19.769885 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:19.770177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7000e91-fd4b-4a42-938b-b59a818b1920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:19.771787 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7000e91-fd4b-4a42-938b-b59a818b1920 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:19.781671 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 799/1600] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:19.782450 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7000e91-fd4b-4a42-938b-b59a818b1920 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:19.791516 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7000e91-fd4b-4a42-938b-b59a818b1920 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:19.795954 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d5223-42dd-4287-8d25-2140357873b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:19.798377 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d5223-42dd-4287-8d25-2140357873b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:19.798377 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d5223-42dd-4287-8d25-2140357873b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:19.798377 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d5223-42dd-4287-8d25-2140357873b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:19.798377 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d5223-42dd-4287-8d25-2140357873b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:19.799145 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d5223-42dd-4287-8d25-2140357873b5 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:19.804752 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:19.810269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 800/1601] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:19.811000 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d5223-42dd-4287-8d25-2140357873b5 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:19.820477 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d5223-42dd-4287-8d25-2140357873b5 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:19.824927 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a891e-47c0-4269-a9d5-5b10a876792f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:19.825557 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a891e-47c0-4269-a9d5-5b10a876792f admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:19.825837 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a891e-47c0-4269-a9d5-5b10a876792f admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:19.826110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a891e-47c0-4269-a9d5-5b10a876792f admin admin] PATH_INFO: `/v3/projects/8f8d93bde8ca491994ecae7eb1506ff1/users/0c2e8b2cb29542febfe09e6a33e094b6/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:19.842144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a891e-47c0-4269-a9d5-5b10a876792f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f8d93bde8ca491994ecae7eb1506ff1, user_id=0c2e8b2cb29542febfe09e6a33e094b6, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:19.844839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a891e-47c0-4269-a9d5-5b10a876792f admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:19.856190 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 802/1602] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:19 2022] PUT /identity/v3/projects/66b8d823ff154fb3a3fd8d7b43aed30f/users/48d0bcae53794da791c8dfe05caaf030/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:19.857548 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be610f00-6186-47da-b2a7-c4ec325a7895 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:19.857884 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be610f00-6186-47da-b2a7-c4ec325a7895 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:19.858153 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be610f00-6186-47da-b2a7-c4ec325a7895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:19.896769 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-be610f00-6186-47da-b2a7-c4ec325a7895 None None] MFA Rules not processed for user `1e0236a0acac4b87be977878b5186551`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:19.898257 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-be610f00-6186-47da-b2a7-c4ec325a7895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:19.907789 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 801/1603] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:19 2022] PUT /identity/v3/projects/8f8d93bde8ca491994ecae7eb1506ff1/users/0c2e8b2cb29542febfe09e6a33e094b6/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:19.909299 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a891e-47c0-4269-a9d5-5b10a876792f admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:19.976560 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 803/1604] 10.222.0.42 () {58 vars in 1059 bytes} [Tue Aug 23 04:24:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:19.977453 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be610f00-6186-47da-b2a7-c4ec325a7895 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:19.977958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a891e-47c0-4269-a9d5-5b10a876792f admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:19.984426 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a7d94-3436-49bb-915e-79c1c81fd195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:19.985125 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a7d94-3436-49bb-915e-79c1c81fd195 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:19.985400 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a7d94-3436-49bb-915e-79c1c81fd195 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:19.985684 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a7d94-3436-49bb-915e-79c1c81fd195 admin admin] PATH_INFO: `/v3/projects/e49b9d9c7b4b45a3a2650fe19c035fa9/users/0fcc41ae55b445d088bfcf03e402ac38/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:20.004089 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a7d94-3436-49bb-915e-79c1c81fd195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e49b9d9c7b4b45a3a2650fe19c035fa9, user_id=0fcc41ae55b445d088bfcf03e402ac38, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:20.008055 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a7d94-3436-49bb-915e-79c1c81fd195 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:20.045656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be610f00-6186-47da-b2a7-c4ec325a7895 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:20.050110 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97065bf6-11a0-4369-aaa3-bccf69a7f97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:20.050914 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97065bf6-11a0-4369-aaa3-bccf69a7f97e admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:20.051192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97065bf6-11a0-4369-aaa3-bccf69a7f97e admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:20.051460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97065bf6-11a0-4369-aaa3-bccf69a7f97e admin admin] PATH_INFO: `/v3/projects/3c88234720e043abbca3a4bcb2a7b626/users/ee78a25b0244465688508d7924a8e8ad/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:20.070527 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97065bf6-11a0-4369-aaa3-bccf69a7f97e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c88234720e043abbca3a4bcb2a7b626, user_id=ee78a25b0244465688508d7924a8e8ad, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:20.073533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97065bf6-11a0-4369-aaa3-bccf69a7f97e admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:20.119436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 802/1605] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:19 2022] PUT /identity/v3/projects/e49b9d9c7b4b45a3a2650fe19c035fa9/users/0fcc41ae55b445d088bfcf03e402ac38/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:20.130555 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a7d94-3436-49bb-915e-79c1c81fd195 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:20.148955 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 804/1606] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:19 2022] PUT /identity/v3/projects/3c88234720e043abbca3a4bcb2a7b626/users/ee78a25b0244465688508d7924a8e8ad/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:20.150199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97065bf6-11a0-4369-aaa3-bccf69a7f97e admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:20.193267 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a7d94-3436-49bb-915e-79c1c81fd195 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:20.219435 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:20.223868 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97065bf6-11a0-4369-aaa3-bccf69a7f97e admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:20.228887 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc9086-6507-4991-bc4d-96c6603e96b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:20.229683 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc9086-6507-4991-bc4d-96c6603e96b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:20.230065 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc9086-6507-4991-bc4d-96c6603e96b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:20.230439 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc9086-6507-4991-bc4d-96c6603e96b7 admin admin] PATH_INFO: `/v3/projects/df6bd64befa444cb8c1c905b336db30a/users/abf6c6aa1799464998c750e756b2318d/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:20.251189 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d655fc-da29-4f05-90ad-09a240bf3768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:20.251527 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc9086-6507-4991-bc4d-96c6603e96b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df6bd64befa444cb8c1c905b336db30a, user_id=abf6c6aa1799464998c750e756b2318d, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:20.251861 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d655fc-da29-4f05-90ad-09a240bf3768 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:20.252132 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d655fc-da29-4f05-90ad-09a240bf3768 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:20.252408 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d655fc-da29-4f05-90ad-09a240bf3768 admin admin] PATH_INFO: `/v3/projects/de80b544f7954532acafbbfd2b69bde6/users/ce7828f322174fe5b3ee7d252010ccf7/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:20.255259 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc9086-6507-4991-bc4d-96c6603e96b7 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:20.266469 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:20.270156 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d655fc-da29-4f05-90ad-09a240bf3768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de80b544f7954532acafbbfd2b69bde6, user_id=ce7828f322174fe5b3ee7d252010ccf7, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:20.272963 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d655fc-da29-4f05-90ad-09a240bf3768 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:20.339850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 805/1607] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:20 2022] PUT /identity/v3/projects/df6bd64befa444cb8c1c905b336db30a/users/abf6c6aa1799464998c750e756b2318d/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:20.339850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5a1c2-4916-46d5-9278-27316cac23bd None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:20.339850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5a1c2-4916-46d5-9278-27316cac23bd None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:20.339850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5a1c2-4916-46d5-9278-27316cac23bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:20.369727 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 803/1608] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:20 2022] PUT /identity/v3/projects/de80b544f7954532acafbbfd2b69bde6/users/ce7828f322174fe5b3ee7d252010ccf7/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:20.369727 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301e87e-4d35-4ff5-992f-beece40de3f0 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:20.369727 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301e87e-4d35-4ff5-992f-beece40de3f0 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:20.369727 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301e87e-4d35-4ff5-992f-beece40de3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:20.373337 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-10c5a1c2-4916-46d5-9278-27316cac23bd None None] MFA Rules not processed for user `48d0bcae53794da791c8dfe05caaf030`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:20.374888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-10c5a1c2-4916-46d5-9278-27316cac23bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:20.396672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-6301e87e-4d35-4ff5-992f-beece40de3f0 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:20.398386 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-6301e87e-4d35-4ff5-992f-beece40de3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:20.445594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 806/1609] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:20.446359 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5a1c2-4916-46d5-9278-27316cac23bd None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:20.463720 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 804/1610] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:20.464980 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512b3de-6b82-4ea6-9ea3-a264fbeaaf71 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:20.465300 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512b3de-6b82-4ea6-9ea3-a264fbeaaf71 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:20.465580 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512b3de-6b82-4ea6-9ea3-a264fbeaaf71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:20.498710 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-0512b3de-6b82-4ea6-9ea3-a264fbeaaf71 None None] MFA Rules not processed for user `0fcc41ae55b445d088bfcf03e402ac38`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:20.500291 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-0512b3de-6b82-4ea6-9ea3-a264fbeaaf71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:20.531566 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5a1c2-4916-46d5-9278-27316cac23bd None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:20.538411 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2e28e-5291-4e11-ae1e-ff384537e5bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:20.539032 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2e28e-5291-4e11-ae1e-ff384537e5bd service nova] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:20.539314 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2e28e-5291-4e11-ae1e-ff384537e5bd service nova] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:20.539583 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2e28e-5291-4e11-ae1e-ff384537e5bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:20.576661 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 805/1611] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:20.578292 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f4ba9-4f22-4468-8208-d0d9ad7ee931 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:20.578725 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f4ba9-4f22-4468-8208-d0d9ad7ee931 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:20.579156 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f4ba9-4f22-4468-8208-d0d9ad7ee931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:20.602166 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd2e28e-5291-4e11-ae1e-ff384537e5bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:20.604105 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd2e28e-5291-4e11-ae1e-ff384537e5bd service nova] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:20.616195 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 807/1612] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:20.618066 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297672dc-9258-49fe-bc95-6c3f30f87309 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:20.618360 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297672dc-9258-49fe-bc95-6c3f30f87309 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:20.618655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297672dc-9258-49fe-bc95-6c3f30f87309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:20.621234 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-bb4f4ba9-4f22-4468-8208-d0d9ad7ee931 None None] MFA Rules not processed for user `ee78a25b0244465688508d7924a8e8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:20.632589 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-bb4f4ba9-4f22-4468-8208-d0d9ad7ee931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:20.634124 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:20.652139 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-297672dc-9258-49fe-bc95-6c3f30f87309 None None] MFA Rules not processed for user `abf6c6aa1799464998c750e756b2318d`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:20.653502 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-297672dc-9258-49fe-bc95-6c3f30f87309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:20.699619 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 806/1613] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:20.704393 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b869818-f9a3-4356-8082-82074f298245 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:20.704741 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b869818-f9a3-4356-8082-82074f298245 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:20.705075 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b869818-f9a3-4356-8082-82074f298245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:20.727877 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-4b869818-f9a3-4356-8082-82074f298245 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:20.729341 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-4b869818-f9a3-4356-8082-82074f298245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:20.738223 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 807/1614] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:20.741449 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 808/1615] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:20.742259 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b869818-f9a3-4356-8082-82074f298245 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:20.743253 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297672dc-9258-49fe-bc95-6c3f30f87309 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:20.745253 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-297672dc-9258-49fe-bc95-6c3f30f87309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:20.748111 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:20.754139 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b869818-f9a3-4356-8082-82074f298245 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:20.760363 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f945f32-ec93-479e-81fa-8bf92cf15986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:20.761136 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f945f32-ec93-479e-81fa-8bf92cf15986 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:20.761524 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f945f32-ec93-479e-81fa-8bf92cf15986 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:20.761892 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f945f32-ec93-479e-81fa-8bf92cf15986 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:20.762626 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f945f32-ec93-479e-81fa-8bf92cf15986 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:20.764664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f945f32-ec93-479e-81fa-8bf92cf15986 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:20.814621 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297672dc-9258-49fe-bc95-6c3f30f87309 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:20.818980 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a2659-3b8b-4f79-994a-7ce3e5f815ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:20.819593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a2659-3b8b-4f79-994a-7ce3e5f815ae service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:20.819885 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a2659-3b8b-4f79-994a-7ce3e5f815ae service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:20.820177 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a2659-3b8b-4f79-994a-7ce3e5f815ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:20.829173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a2659-3b8b-4f79-994a-7ce3e5f815ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:20.830612 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a2659-3b8b-4f79-994a-7ce3e5f815ae service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:20.844139 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 808/1616] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:24:20 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:20.844339 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 809/1617] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:20.844339 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a2659-3b8b-4f79-994a-7ce3e5f815ae service neutron] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:20.844566 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f27d6-6078-4a42-b189-5e5a3c3a2248 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:20.844566 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f27d6-6078-4a42-b189-5e5a3c3a2248 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:20.844566 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f27d6-6078-4a42-b189-5e5a3c3a2248 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:20.845559 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 809/1618] 10.222.0.42 () {54 vars in 962 bytes} [Tue Aug 23 04:24:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:24:20.846270 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f27d6-6078-4a42-b189-5e5a3c3a2248 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:20.869485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a2659-3b8b-4f79-994a-7ce3e5f815ae service neutron] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:20.946582 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f27d6-6078-4a42-b189-5e5a3c3a2248 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:20.955227 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5958b97-ce27-4172-9a16-c98836b187ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:20.955834 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5958b97-ce27-4172-9a16-c98836b187ec admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:20.956119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5958b97-ce27-4172-9a16-c98836b187ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:20.956424 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5958b97-ce27-4172-9a16-c98836b187ec admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:20.957344 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5958b97-ce27-4172-9a16-c98836b187ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:20.960656 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5958b97-ce27-4172-9a16-c98836b187ec admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:20.969406 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f6f9c-0965-496b-8748-99a8c64ecd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:20.970285 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f6f9c-0965-496b-8748-99a8c64ecd4b admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:20.970756 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f6f9c-0965-496b-8748-99a8c64ecd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:20.971219 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f6f9c-0965-496b-8748-99a8c64ecd4b admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:20.972038 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f6f9c-0965-496b-8748-99a8c64ecd4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:20.974933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f6f9c-0965-496b-8748-99a8c64ecd4b admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:21.081470 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 810/1619] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:24:20 2022] POST /identity/v3/projects => generated 365 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:21.082555 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5958b97-ce27-4172-9a16-c98836b187ec admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:21.084869 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 810/1620] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:24:20 2022] POST /identity/v3/projects => generated 381 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:21.085958 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f6f9c-0965-496b-8748-99a8c64ecd4b admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:21.112541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:21.141417 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5958b97-ce27-4172-9a16-c98836b187ec admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:21.145231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33c532-3ce3-4842-9cf7-da839d94aade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:21.145894 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33c532-3ce3-4842-9cf7-da839d94aade service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:21.146178 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33c532-3ce3-4842-9cf7-da839d94aade service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:21.146440 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33c532-3ce3-4842-9cf7-da839d94aade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:21.147691 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f6f9c-0965-496b-8748-99a8c64ecd4b admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:21.228348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d150a8-b6ac-4d10-b5fa-e026a9e713d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:21.229670 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d150a8-b6ac-4d10-b5fa-e026a9e713d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:21.230465 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d150a8-b6ac-4d10-b5fa-e026a9e713d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:21.231630 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d150a8-b6ac-4d10-b5fa-e026a9e713d2 admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:21.232556 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d150a8-b6ac-4d10-b5fa-e026a9e713d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:21.234959 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d150a8-b6ac-4d10-b5fa-e026a9e713d2 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:21.240758 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a33c532-3ce3-4842-9cf7-da839d94aade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:21.242291 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a33c532-3ce3-4842-9cf7-da839d94aade service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:21.257346 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 811/1621] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:21.258753 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcbe50-232a-4f67-a51c-3de281c41895 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:21.259164 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcbe50-232a-4f67-a51c-3de281c41895 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:21.259571 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcbe50-232a-4f67-a51c-3de281c41895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:21.304431 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 811/1622] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:24:21 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:21.305947 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cc645-0f85-4c14-95dd-def06ba97f33 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:21.306783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cc645-0f85-4c14-95dd-def06ba97f33 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:21.307733 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cc645-0f85-4c14-95dd-def06ba97f33 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:21.309553 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-1ddcbe50-232a-4f67-a51c-3de281c41895 None None] MFA Rules not processed for user `1e0236a0acac4b87be977878b5186551`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:21.311233 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 812/1623] 10.222.0.42 () {54 vars in 912 bytes} [Tue Aug 23 04:24:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:24:21.311372 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-1ddcbe50-232a-4f67-a51c-3de281c41895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:21.317897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cc645-0f85-4c14-95dd-def06ba97f33 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:21.333255 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:21.336871 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cc645-0f85-4c14-95dd-def06ba97f33 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:21.341738 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540db6f6-4112-4d37-a7cf-1b2d4332e521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:21.342465 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540db6f6-4112-4d37-a7cf-1b2d4332e521 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:21.342837 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540db6f6-4112-4d37-a7cf-1b2d4332e521 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:21.343209 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540db6f6-4112-4d37-a7cf-1b2d4332e521 admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:21.343942 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540db6f6-4112-4d37-a7cf-1b2d4332e521 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:21.346129 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540db6f6-4112-4d37-a7cf-1b2d4332e521 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:21.435913 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 812/1624] 10.222.0.42 () {58 vars in 1059 bytes} [Tue Aug 23 04:24:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:21.436973 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddcbe50-232a-4f67-a51c-3de281c41895 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:21.450953 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddcbe50-232a-4f67-a51c-3de281c41895 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:21.464533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 813/1625] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:24:21 2022] POST /identity/v3/users => generated 297 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:21.465948 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540db6f6-4112-4d37-a7cf-1b2d4332e521 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:21.474547 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc80f7-5545-4c97-8208-db1517a2fe9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:21.475320 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc80f7-5545-4c97-8208-db1517a2fe9f admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:21.475607 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc80f7-5545-4c97-8208-db1517a2fe9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:21.475878 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc80f7-5545-4c97-8208-db1517a2fe9f admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:21.479988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc80f7-5545-4c97-8208-db1517a2fe9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:21.484562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc80f7-5545-4c97-8208-db1517a2fe9f admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:21.490696 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540db6f6-4112-4d37-a7cf-1b2d4332e521 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:21.506417 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12aa310-37da-45ed-97f1-0dd95356cc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:21.507731 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12aa310-37da-45ed-97f1-0dd95356cc5d admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:21.508021 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12aa310-37da-45ed-97f1-0dd95356cc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:21.508457 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12aa310-37da-45ed-97f1-0dd95356cc5d admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:21.509680 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12aa310-37da-45ed-97f1-0dd95356cc5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:21.513726 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12aa310-37da-45ed-97f1-0dd95356cc5d admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:21.531379 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 814/1626] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:21.531379 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e40341-3225-4f02-9c0e-5688357ecd5c None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:21.531379 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e40341-3225-4f02-9c0e-5688357ecd5c None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:21.531379 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e40341-3225-4f02-9c0e-5688357ecd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:21.553820 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-a3e40341-3225-4f02-9c0e-5688357ecd5c None None] MFA Rules not processed for user `1e0236a0acac4b87be977878b5186551`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:21.557902 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-a3e40341-3225-4f02-9c0e-5688357ecd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:21.571701 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 815/1627] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 23 04:24:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:21.578320 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e40341-3225-4f02-9c0e-5688357ecd5c None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:21.591545 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e40341-3225-4f02-9c0e-5688357ecd5c None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:21.599445 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d8d99-f754-4d73-a653-1ab382305604 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:21.600390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d8d99-f754-4d73-a653-1ab382305604 service nova] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:21.600880 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d8d99-f754-4d73-a653-1ab382305604 service nova] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:21.601393 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d8d99-f754-4d73-a653-1ab382305604 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:21.610927 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 813/1628] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:24:21 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:21.612018 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc80f7-5545-4c97-8208-db1517a2fe9f admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:21.623904 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc80f7-5545-4c97-8208-db1517a2fe9f admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:21.630406 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb6599-054f-4ec3-a726-277076e3c9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:21.632013 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb6599-054f-4ec3-a726-277076e3c9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:21.632445 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb6599-054f-4ec3-a726-277076e3c9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:21.632818 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb6599-054f-4ec3-a726-277076e3c9b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:21.633668 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb6599-054f-4ec3-a726-277076e3c9b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:21.635594 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb6599-054f-4ec3-a726-277076e3c9b8 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:21.648523 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 814/1629] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:21.649523 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb6599-054f-4ec3-a726-277076e3c9b8 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:21.661553 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb6599-054f-4ec3-a726-277076e3c9b8 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:21.667436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c99e9-46ae-495b-8f8c-dd68b233091a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:21.672964 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c99e9-46ae-495b-8f8c-dd68b233091a admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:21.672964 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c99e9-46ae-495b-8f8c-dd68b233091a admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:21.672964 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c99e9-46ae-495b-8f8c-dd68b233091a admin admin] PATH_INFO: `/v3/projects/227590ea391840a087e8acf327aff8d5/users/17f21e4ab1f2457b9b81449d0d877951/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:21.686933 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c99e9-46ae-495b-8f8c-dd68b233091a admin admin] RBAC: Authorizing `identity:create_grant(project_id=227590ea391840a087e8acf327aff8d5, user_id=17f21e4ab1f2457b9b81449d0d877951, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:21.690313 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c99e9-46ae-495b-8f8c-dd68b233091a admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:21.745528 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d8d99-f754-4d73-a653-1ab382305604 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:21.746799 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d8d99-f754-4d73-a653-1ab382305604 service nova] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:21.757268 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 816/1630] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:21.759607 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d8d99-f754-4d73-a653-1ab382305604 service nova] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:21.788440 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 815/1631] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:21 2022] PUT /identity/v3/projects/227590ea391840a087e8acf327aff8d5/users/17f21e4ab1f2457b9b81449d0d877951/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:21.793179 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c99e9-46ae-495b-8f8c-dd68b233091a admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:21.799975 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:21.855556 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d8d99-f754-4d73-a653-1ab382305604 service nova] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:21.943981 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c99e9-46ae-495b-8f8c-dd68b233091a admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:21.963157 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b001643-126a-4c53-b6d8-0e23a64b956f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:21.963865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b001643-126a-4c53-b6d8-0e23a64b956f service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:21.968438 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a82af1-8bc4-446b-b33f-d5c4faa0c4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:21.969147 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a82af1-8bc4-446b-b33f-d5c4faa0c4db admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:21.969672 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b001643-126a-4c53-b6d8-0e23a64b956f service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:21.972176 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a82af1-8bc4-446b-b33f-d5c4faa0c4db admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:21.972273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b001643-126a-4c53-b6d8-0e23a64b956f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:21.972360 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a82af1-8bc4-446b-b33f-d5c4faa0c4db admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:21.972360 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a82af1-8bc4-446b-b33f-d5c4faa0c4db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:21.985025 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a82af1-8bc4-446b-b33f-d5c4faa0c4db admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:22.015327 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 816/1632] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:22.018153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a82af1-8bc4-446b-b33f-d5c4faa0c4db admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:22.062014 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a82af1-8bc4-446b-b33f-d5c4faa0c4db admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:22.072733 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f89639-74b8-4dc5-8afa-37059d9f16f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:22.075945 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f89639-74b8-4dc5-8afa-37059d9f16f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:22.075945 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f89639-74b8-4dc5-8afa-37059d9f16f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:22.076217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f89639-74b8-4dc5-8afa-37059d9f16f5 admin admin] PATH_INFO: `/v3/projects/dc5c78b722ee4aedb7f4ef3422e314ae/users/c60719c17a144357bda35ea4290266e5/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:22.105237 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b001643-126a-4c53-b6d8-0e23a64b956f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:22.106766 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b001643-126a-4c53-b6d8-0e23a64b956f service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:22.118031 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f89639-74b8-4dc5-8afa-37059d9f16f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc5c78b722ee4aedb7f4ef3422e314ae, user_id=c60719c17a144357bda35ea4290266e5, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:22.120744 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f89639-74b8-4dc5-8afa-37059d9f16f5 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:22.143077 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 817/1633] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:22.144226 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b001643-126a-4c53-b6d8-0e23a64b956f service cinder] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:22.171122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b001643-126a-4c53-b6d8-0e23a64b956f service cinder] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:22.182526 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7979c7-50e1-4e6a-946e-a4aba82f0518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:22.183163 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7979c7-50e1-4e6a-946e-a4aba82f0518 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:22.183444 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7979c7-50e1-4e6a-946e-a4aba82f0518 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:22.183715 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7979c7-50e1-4e6a-946e-a4aba82f0518 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:22.184432 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7979c7-50e1-4e6a-946e-a4aba82f0518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:22.186085 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7979c7-50e1-4e6a-946e-a4aba82f0518 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:22.210386 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 818/1634] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:22.211479 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7979c7-50e1-4e6a-946e-a4aba82f0518 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:22.230040 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7979c7-50e1-4e6a-946e-a4aba82f0518 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:22.234863 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 817/1635] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:22 2022] PUT /identity/v3/projects/dc5c78b722ee4aedb7f4ef3422e314ae/users/c60719c17a144357bda35ea4290266e5/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:22.236606 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3119d0-14ec-4689-94cc-75bf3f80c604 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:22.236943 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3119d0-14ec-4689-94cc-75bf3f80c604 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:22.237347 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3119d0-14ec-4689-94cc-75bf3f80c604 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:22.238724 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 818/1636] 10.222.0.42 () {54 vars in 912 bytes} [Tue Aug 23 04:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:24:22.244570 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3119d0-14ec-4689-94cc-75bf3f80c604 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:22.294843 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:22.352790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b0525-e50a-48a8-b440-a79c573fe600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:22.353550 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b0525-e50a-48a8-b440-a79c573fe600 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:22.353816 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b0525-e50a-48a8-b440-a79c573fe600 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:22.354057 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b0525-e50a-48a8-b440-a79c573fe600 admin admin] PATH_INFO: `/v3/projects/1ef55cb531df498c86c8528b27809a5a/users/ee1a8ee72eaf46078fefefcbeb38c87d/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:22.388386 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3119d0-14ec-4689-94cc-75bf3f80c604 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:22.394665 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b0525-e50a-48a8-b440-a79c573fe600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef55cb531df498c86c8528b27809a5a, user_id=ee1a8ee72eaf46078fefefcbeb38c87d, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:22.397494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a055e-9d2e-46f5-b9c0-6e7cc3d681bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:22.398340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b0525-e50a-48a8-b440-a79c573fe600 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:22.398865 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a055e-9d2e-46f5-b9c0-6e7cc3d681bc admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:22.399424 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a055e-9d2e-46f5-b9c0-6e7cc3d681bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:22.399906 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a055e-9d2e-46f5-b9c0-6e7cc3d681bc admin admin] PATH_INFO: `/v3/projects/227590ea391840a087e8acf327aff8d5/users/17f21e4ab1f2457b9b81449d0d877951/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:22.402583 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a055e-9d2e-46f5-b9c0-6e7cc3d681bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=227590ea391840a087e8acf327aff8d5, user_id=17f21e4ab1f2457b9b81449d0d877951, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:22.407832 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a055e-9d2e-46f5-b9c0-6e7cc3d681bc admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:22.422250 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:22.427887 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 819/1637] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:22 2022] PUT /identity/v3/projects/227590ea391840a087e8acf327aff8d5/users/17f21e4ab1f2457b9b81449d0d877951/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:22.433980 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a055e-9d2e-46f5-b9c0-6e7cc3d681bc admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:22.487687 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 819/1638] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:22 2022] PUT /identity/v3/projects/1ef55cb531df498c86c8528b27809a5a/users/ee1a8ee72eaf46078fefefcbeb38c87d/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:22.490349 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551b2b4-aabd-4ac1-bb0b-414082a1cb56 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:22.490349 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551b2b4-aabd-4ac1-bb0b-414082a1cb56 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:22.490349 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551b2b4-aabd-4ac1-bb0b-414082a1cb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:22.528823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-8551b2b4-aabd-4ac1-bb0b-414082a1cb56 None None] MFA Rules not processed for user `1e0236a0acac4b87be977878b5186551`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:22.530219 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-8551b2b4-aabd-4ac1-bb0b-414082a1cb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:22.576710 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a055e-9d2e-46f5-b9c0-6e7cc3d681bc admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:22.688265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 820/1639] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 23 04:24:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:22.699958 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc43168-e525-43ec-a0e1-b1964e85a804 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:22.699958 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc43168-e525-43ec-a0e1-b1964e85a804 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:22.699958 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc43168-e525-43ec-a0e1-b1964e85a804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:22.854213 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2a21f-3ba7-40ac-a516-3f0d9d0ba0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:22.854213 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2a21f-3ba7-40ac-a516-3f0d9d0ba0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:22.854213 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2a21f-3ba7-40ac-a516-3f0d9d0ba0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:22.854213 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2a21f-3ba7-40ac-a516-3f0d9d0ba0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:23.152074 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2a21f-3ba7-40ac-a516-3f0d9d0ba0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:23.152074 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2a21f-3ba7-40ac-a516-3f0d9d0ba0a3 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:23.156635 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-fdc43168-e525-43ec-a0e1-b1964e85a804 None None] MFA Rules not processed for user `17f21e4ab1f2457b9b81449d0d877951`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:23.156635 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-fdc43168-e525-43ec-a0e1-b1964e85a804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:23.157542 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 820/1640] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:23.157542 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2a21f-3ba7-40ac-a516-3f0d9d0ba0a3 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:23.157542 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2a21f-3ba7-40ac-a516-3f0d9d0ba0a3 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:23.157542 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a529624-85e1-4c55-8e77-ff1e51ebee29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:23.158464 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a529624-85e1-4c55-8e77-ff1e51ebee29 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:23.158464 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a529624-85e1-4c55-8e77-ff1e51ebee29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:23.158464 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a529624-85e1-4c55-8e77-ff1e51ebee29 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:23.158464 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a529624-85e1-4c55-8e77-ff1e51ebee29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:23.158464 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a529624-85e1-4c55-8e77-ff1e51ebee29 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:23.158464 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 821/1641] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:23.158955 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a529624-85e1-4c55-8e77-ff1e51ebee29 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:23.158955 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a529624-85e1-4c55-8e77-ff1e51ebee29 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:23.158955 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b75fb-fcda-4794-8261-c09c8257f9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:23.158955 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b75fb-fcda-4794-8261-c09c8257f9c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:23.159300 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b75fb-fcda-4794-8261-c09c8257f9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:23.159300 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b75fb-fcda-4794-8261-c09c8257f9c9 admin admin] PATH_INFO: `/v3/users/1593ffd00886475494a971229d69264a` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:23.159300 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b75fb-fcda-4794-8261-c09c8257f9c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1593ffd00886475494a971229d69264a)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:23.159300 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b75fb-fcda-4794-8261-c09c8257f9c9 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:23.159721 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 821/1642] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:22 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:23.159721 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc43168-e525-43ec-a0e1-b1964e85a804 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:23.159721 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc43168-e525-43ec-a0e1-b1964e85a804 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:23.159721 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aaed2b-df56-41bd-b937-164fa94fd744 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:23.160059 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aaed2b-df56-41bd-b937-164fa94fd744 service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:23.160059 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aaed2b-df56-41bd-b937-164fa94fd744 service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:23.160059 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aaed2b-df56-41bd-b937-164fa94fd744 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:23.160059 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aaed2b-df56-41bd-b937-164fa94fd744 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:23.160059 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aaed2b-df56-41bd-b937-164fa94fd744 service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:23.160059 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 822/1643] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:23.161169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aaed2b-df56-41bd-b937-164fa94fd744 service cinder] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:23.161169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aaed2b-df56-41bd-b937-164fa94fd744 service cinder] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:23.161169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1183abb-2400-4861-ac5f-545da34576ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:23.161169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1183abb-2400-4861-ac5f-545da34576ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:23.161567 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1183abb-2400-4861-ac5f-545da34576ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:23.161567 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1183abb-2400-4861-ac5f-545da34576ad admin admin] PATH_INFO: `/v3/projects/dc5c78b722ee4aedb7f4ef3422e314ae/users/c60719c17a144357bda35ea4290266e5/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:23.161567 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1183abb-2400-4861-ac5f-545da34576ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc5c78b722ee4aedb7f4ef3422e314ae, user_id=c60719c17a144357bda35ea4290266e5, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:23.161567 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1183abb-2400-4861-ac5f-545da34576ad admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:23.161567 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:23.161955 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 823/1644] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:23 2022] PUT /identity/v3/projects/dc5c78b722ee4aedb7f4ef3422e314ae/users/c60719c17a144357bda35ea4290266e5/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:23.161955 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1183abb-2400-4861-ac5f-545da34576ad admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:23.215238 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1183abb-2400-4861-ac5f-545da34576ad admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:23.220692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c60118-b2d5-4207-94f3-a376156f2187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:23.221791 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c60118-b2d5-4207-94f3-a376156f2187 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:23.222154 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c60118-b2d5-4207-94f3-a376156f2187 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:23.222508 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c60118-b2d5-4207-94f3-a376156f2187 admin admin] PATH_INFO: `/v3/projects/1ef55cb531df498c86c8528b27809a5a/users/ee1a8ee72eaf46078fefefcbeb38c87d/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:23.225277 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c60118-b2d5-4207-94f3-a376156f2187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef55cb531df498c86c8528b27809a5a, user_id=ee1a8ee72eaf46078fefefcbeb38c87d, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:23.228116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c60118-b2d5-4207-94f3-a376156f2187 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:23.241999 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 824/1645] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:23 2022] PUT /identity/v3/projects/1ef55cb531df498c86c8528b27809a5a/users/ee1a8ee72eaf46078fefefcbeb38c87d/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:23.242666 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c60118-b2d5-4207-94f3-a376156f2187 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:23.298958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-db8b75fb-fcda-4794-8261-c09c8257f9c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1593ffd00886475494a971229d69264a'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:23.390518 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c60118-b2d5-4207-94f3-a376156f2187 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:23.392806 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-db8b75fb-fcda-4794-8261-c09c8257f9c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1593ffd00886475494a971229d69264a'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:23.399928 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd7b1b-6821-40c8-97de-3ad4fc13fab2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:23.400663 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd7b1b-6821-40c8-97de-3ad4fc13fab2 service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:23.400991 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd7b1b-6821-40c8-97de-3ad4fc13fab2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:23.401653 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd7b1b-6821-40c8-97de-3ad4fc13fab2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:23.407853 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:23.410650 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-db8b75fb-fcda-4794-8261-c09c8257f9c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1593ffd00886475494a971229d69264a'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:23.439292 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-db8b75fb-fcda-4794-8261-c09c8257f9c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1593ffd00886475494a971229d69264a'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:23.441244 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-db8b75fb-fcda-4794-8261-c09c8257f9c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1593ffd00886475494a971229d69264a'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:23.455173 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 822/1646] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:24:22 2022] DELETE /identity/v3/users/1593ffd00886475494a971229d69264a => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:23.461464 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8144f-2e5a-43c8-854b-e86ba9953285 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:23.461844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8144f-2e5a-43c8-854b-e86ba9953285 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:23.462192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8144f-2e5a-43c8-854b-e86ba9953285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:23.531676 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-78a8144f-2e5a-43c8-854b-e86ba9953285 None None] MFA Rules not processed for user `c60719c17a144357bda35ea4290266e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:23.532912 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-78a8144f-2e5a-43c8-854b-e86ba9953285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:23.569700 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd7b1b-6821-40c8-97de-3ad4fc13fab2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:23.571865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd7b1b-6821-40c8-97de-3ad4fc13fab2 service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:23.606826 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 825/1647] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:23 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:23.618933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57114d4-7a3e-4cd1-9b5a-13e07053cf58 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:23.621454 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57114d4-7a3e-4cd1-9b5a-13e07053cf58 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:23.622626 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57114d4-7a3e-4cd1-9b5a-13e07053cf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:23.706903 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 823/1648] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:23.715146 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a869ba-54ef-4254-9471-fc65ae99dff1 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:23.715390 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a869ba-54ef-4254-9471-fc65ae99dff1 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:23.715665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a869ba-54ef-4254-9471-fc65ae99dff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:23.719347 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-d57114d4-7a3e-4cd1-9b5a-13e07053cf58 None None] MFA Rules not processed for user `ee1a8ee72eaf46078fefefcbeb38c87d`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:23.721013 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-d57114d4-7a3e-4cd1-9b5a-13e07053cf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:23.785947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-d0a869ba-54ef-4254-9471-fc65ae99dff1 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:23.787221 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-d0a869ba-54ef-4254-9471-fc65ae99dff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:23.875760 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:23.882621 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 826/1649] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:23.910994 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 824/1650] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:23.926971 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57114d4-7a3e-4cd1-9b5a-13e07053cf58 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:23.928742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-d57114d4-7a3e-4cd1-9b5a-13e07053cf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:24.006229 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a869ba-54ef-4254-9471-fc65ae99dff1 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:24.009621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-d0a869ba-54ef-4254-9471-fc65ae99dff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:24.046225 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57114d4-7a3e-4cd1-9b5a-13e07053cf58 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:24.056258 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd6a31-2d02-495e-a9b0-d47289d216fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:24.057262 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd6a31-2d02-495e-a9b0-d47289d216fa service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:24.058536 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd6a31-2d02-495e-a9b0-d47289d216fa service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:24.059402 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd6a31-2d02-495e-a9b0-d47289d216fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:24.081640 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd6a31-2d02-495e-a9b0-d47289d216fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:24.084368 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd6a31-2d02-495e-a9b0-d47289d216fa service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:24.126678 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 827/1651] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:24.163105 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a869ba-54ef-4254-9471-fc65ae99dff1 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:24.168383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd6a31-2d02-495e-a9b0-d47289d216fa service cinder] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:24.168526 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5658cf-dfac-4412-b5c0-3736a84fe2e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:24.168851 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5658cf-dfac-4412-b5c0-3736a84fe2e7 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:24.169172 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5658cf-dfac-4412-b5c0-3736a84fe2e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:24.169459 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5658cf-dfac-4412-b5c0-3736a84fe2e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:24.169921 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-a1cd6a31-2d02-495e-a9b0-d47289d216fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:24.183845 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5658cf-dfac-4412-b5c0-3736a84fe2e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:24.184703 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5658cf-dfac-4412-b5c0-3736a84fe2e7 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:24.189441 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd6a31-2d02-495e-a9b0-d47289d216fa service cinder] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:24.199889 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 825/1652] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:24.203420 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00292441-fea3-4a26-8522-f58c8cfb2f83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:24.204062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00292441-fea3-4a26-8522-f58c8cfb2f83 service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:24.204346 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00292441-fea3-4a26-8522-f58c8cfb2f83 service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:24.206746 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00292441-fea3-4a26-8522-f58c8cfb2f83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:24.217682 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00292441-fea3-4a26-8522-f58c8cfb2f83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:24.219713 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00292441-fea3-4a26-8522-f58c8cfb2f83 service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:24.244532 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5658cf-dfac-4412-b5c0-3736a84fe2e7 service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:24.251413 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 828/1653] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:24 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:24:24.271445 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5658cf-dfac-4412-b5c0-3736a84fe2e7 service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:24.285591 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8e66a-dfdb-4ab2-9363-d51953d265be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:24.286824 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8e66a-dfdb-4ab2-9363-d51953d265be service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:24.287864 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8e66a-dfdb-4ab2-9363-d51953d265be service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:24.289508 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8e66a-dfdb-4ab2-9363-d51953d265be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:24.295246 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-13f8e66a-dfdb-4ab2-9363-d51953d265be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:24.457954 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8e66a-dfdb-4ab2-9363-d51953d265be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:24.459390 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8e66a-dfdb-4ab2-9363-d51953d265be service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:24.482911 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 826/1654] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:24.530044 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:24.972205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00292441-fea3-4a26-8522-f58c8cfb2f83 service cinder] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:24.997305 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00292441-fea3-4a26-8522-f58c8cfb2f83 service cinder] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:25.019485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8a6c2-2c91-4c2f-b93c-1e3a827004f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:25.020663 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8a6c2-2c91-4c2f-b93c-1e3a827004f7 service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:25.022962 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8a6c2-2c91-4c2f-b93c-1e3a827004f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:25.023260 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8a6c2-2c91-4c2f-b93c-1e3a827004f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:25.031637 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-13b8a6c2-2c91-4c2f-b93c-1e3a827004f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:25.114680 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8a6c2-2c91-4c2f-b93c-1e3a827004f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:25.116598 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8a6c2-2c91-4c2f-b93c-1e3a827004f7 service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:25.143054 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 829/1655] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:24:25.408907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8e66a-dfdb-4ab2-9363-d51953d265be service cinder] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:25.411209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-13f8e66a-dfdb-4ab2-9363-d51953d265be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:25.459782 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8e66a-dfdb-4ab2-9363-d51953d265be service cinder] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:25.485467 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1a900-cef8-406f-9a5e-522ac5a6f525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:25.486275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1a900-cef8-406f-9a5e-522ac5a6f525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:25.486659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1a900-cef8-406f-9a5e-522ac5a6f525 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:25.487038 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1a900-cef8-406f-9a5e-522ac5a6f525 admin admin] PATH_INFO: `/v3/projects/04f98c8ca13949afab24111662b0211e` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:25.490293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1a900-cef8-406f-9a5e-522ac5a6f525 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04f98c8ca13949afab24111662b0211e)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:25.492370 dv-cinder-854070-1-smb devstack@keystone.service[82354]: WARNING py.warnings [None req-d2e1a900-cef8-406f-9a5e-522ac5a6f525 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 04:24:25.492370 dv-cinder-854070-1-smb devstack@keystone.service[82354]: warnings.warn(msg) Aug 23 04:24:25.492370 dv-cinder-854070-1-smb devstack@keystone.service[82354]: Aug 23 04:24:25.502064 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1a900-cef8-406f-9a5e-522ac5a6f525 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:25.730829 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-d2e1a900-cef8-406f-9a5e-522ac5a6f525 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04f98c8ca13949afab24111662b0211e', 'request_id': 'req-d2e1a900-cef8-406f-9a5e-522ac5a6f525'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:25.762254 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-d2e1a900-cef8-406f-9a5e-522ac5a6f525 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04f98c8ca13949afab24111662b0211e', 'request_id': 'req-d2e1a900-cef8-406f-9a5e-522ac5a6f525'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:25.784754 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-d2e1a900-cef8-406f-9a5e-522ac5a6f525 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04f98c8ca13949afab24111662b0211e', 'request_id': 'req-d2e1a900-cef8-406f-9a5e-522ac5a6f525'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:25.880339 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-d2e1a900-cef8-406f-9a5e-522ac5a6f525 admin admin] The token cache is being invalidate because project 04f98c8ca13949afab24111662b0211e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:24:25.880692 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-d2e1a900-cef8-406f-9a5e-522ac5a6f525 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:25.882187 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-d2e1a900-cef8-406f-9a5e-522ac5a6f525 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:25.888351 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 827/1656] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:24:25 2022] DELETE /identity/v3/projects/04f98c8ca13949afab24111662b0211e => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:25.891028 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21921cb8-282c-4bee-a0af-bfbb861f5612 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:25.891389 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21921cb8-282c-4bee-a0af-bfbb861f5612 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:25.891757 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21921cb8-282c-4bee-a0af-bfbb861f5612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:25.926842 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-21921cb8-282c-4bee-a0af-bfbb861f5612 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:25.928645 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-21921cb8-282c-4bee-a0af-bfbb861f5612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:26.015917 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:26.027800 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 830/1657] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:26.037588 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b2f4d-c4af-4b5a-8082-641612b5a420 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:26.037885 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b2f4d-c4af-4b5a-8082-641612b5a420 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:26.038155 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b2f4d-c4af-4b5a-8082-641612b5a420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:26.105611 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-984b2f4d-c4af-4b5a-8082-641612b5a420 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:26.106995 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-984b2f4d-c4af-4b5a-8082-641612b5a420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:26.140802 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21921cb8-282c-4bee-a0af-bfbb861f5612 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:26.146235 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 828/1658] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:26.160952 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21921cb8-282c-4bee-a0af-bfbb861f5612 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:26.174062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3153e9-e1ee-40e5-81f5-54da61c2c547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:26.174916 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3153e9-e1ee-40e5-81f5-54da61c2c547 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:26.175298 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3153e9-e1ee-40e5-81f5-54da61c2c547 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:26.175755 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3153e9-e1ee-40e5-81f5-54da61c2c547 admin admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:26.176835 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3153e9-e1ee-40e5-81f5-54da61c2c547 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:24:26.178230 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3153e9-e1ee-40e5-81f5-54da61c2c547 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:26.185216 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3153e9-e1ee-40e5-81f5-54da61c2c547 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:26.217959 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 831/1659] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:24:26.225636 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b2f4d-c4af-4b5a-8082-641612b5a420 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:26.238310 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b2f4d-c4af-4b5a-8082-641612b5a420 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:26.267093 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cba567-fc04-4e21-a00b-cb8a62d40b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:26.272483 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cba567-fc04-4e21-a00b-cb8a62d40b02 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:26.276631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cba567-fc04-4e21-a00b-cb8a62d40b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:26.276631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cba567-fc04-4e21-a00b-cb8a62d40b02 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:26.276631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cba567-fc04-4e21-a00b-cb8a62d40b02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:26.278588 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cba567-fc04-4e21-a00b-cb8a62d40b02 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:26.435539 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 829/1660] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:24:26 2022] POST /identity/v3/projects => generated 375 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:26.436388 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3153e9-e1ee-40e5-81f5-54da61c2c547 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:26.450229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3153e9-e1ee-40e5-81f5-54da61c2c547 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:26.547262 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5dec1-f6bf-4066-8ae5-490060dab04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:26.547908 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5dec1-f6bf-4066-8ae5-490060dab04f admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:26.548194 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5dec1-f6bf-4066-8ae5-490060dab04f admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:26.548464 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5dec1-f6bf-4066-8ae5-490060dab04f admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:26.549219 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5dec1-f6bf-4066-8ae5-490060dab04f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:26.552317 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5dec1-f6bf-4066-8ae5-490060dab04f admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:26.599231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cba567-fc04-4e21-a00b-cb8a62d40b02 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:26.601544 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-23cba567-fc04-4e21-a00b-cb8a62d40b02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:26.616267 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cba567-fc04-4e21-a00b-cb8a62d40b02 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:26.637753 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326357bb-eb43-4112-88a4-803f8ff2b9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:26.638404 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326357bb-eb43-4112-88a4-803f8ff2b9e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:26.638768 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326357bb-eb43-4112-88a4-803f8ff2b9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:26.639013 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326357bb-eb43-4112-88a4-803f8ff2b9e8 admin admin] PATH_INFO: `/v3/users/abf6c6aa1799464998c750e756b2318d` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:26.644298 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326357bb-eb43-4112-88a4-803f8ff2b9e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abf6c6aa1799464998c750e756b2318d)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:26.648170 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326357bb-eb43-4112-88a4-803f8ff2b9e8 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:26.690060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 832/1661] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:24:26 2022] POST /identity/v3/users => generated 288 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:24:26.693878 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5dec1-f6bf-4066-8ae5-490060dab04f admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:26.709267 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5dec1-f6bf-4066-8ae5-490060dab04f admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:26.717811 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20155cf-e49c-4d78-b93f-35183a31dd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:26.718882 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20155cf-e49c-4d78-b93f-35183a31dd3f admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:26.719158 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20155cf-e49c-4d78-b93f-35183a31dd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:26.719439 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20155cf-e49c-4d78-b93f-35183a31dd3f admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:26.722352 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20155cf-e49c-4d78-b93f-35183a31dd3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:26.724599 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20155cf-e49c-4d78-b93f-35183a31dd3f admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:26.742534 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 833/1662] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:26.745950 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20155cf-e49c-4d78-b93f-35183a31dd3f admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:26.762912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20155cf-e49c-4d78-b93f-35183a31dd3f admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:26.770050 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08129f99-a6a1-4acf-a356-70fd95c2455c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:26.770769 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08129f99-a6a1-4acf-a356-70fd95c2455c admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:26.771123 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08129f99-a6a1-4acf-a356-70fd95c2455c admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:26.771472 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08129f99-a6a1-4acf-a356-70fd95c2455c admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:26.772208 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08129f99-a6a1-4acf-a356-70fd95c2455c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:26.774567 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08129f99-a6a1-4acf-a356-70fd95c2455c admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:26.795235 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 834/1663] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:26.797115 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08129f99-a6a1-4acf-a356-70fd95c2455c admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:26.813100 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08129f99-a6a1-4acf-a356-70fd95c2455c admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:26.823050 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450a723-76bf-4b0d-b570-387531e38651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:26.825136 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450a723-76bf-4b0d-b570-387531e38651 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:26.826052 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450a723-76bf-4b0d-b570-387531e38651 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:26.826524 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450a723-76bf-4b0d-b570-387531e38651 admin admin] PATH_INFO: `/v3/projects/d997518cf59347fc8f103b696ca8b0ba/users/6a11a98453464583a7600bd43d791aeb/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:26.837431 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:26.851997 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-326357bb-eb43-4112-88a4-803f8ff2b9e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abf6c6aa1799464998c750e756b2318d'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:26.868857 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1450a723-76bf-4b0d-b570-387531e38651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d997518cf59347fc8f103b696ca8b0ba, user_id=6a11a98453464583a7600bd43d791aeb, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:26.874964 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1450a723-76bf-4b0d-b570-387531e38651 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:27.000648 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-326357bb-eb43-4112-88a4-803f8ff2b9e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abf6c6aa1799464998c750e756b2318d'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:27.012095 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-326357bb-eb43-4112-88a4-803f8ff2b9e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abf6c6aa1799464998c750e756b2318d'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:27.029515 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 835/1664] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:26 2022] PUT /identity/v3/projects/d997518cf59347fc8f103b696ca8b0ba/users/6a11a98453464583a7600bd43d791aeb/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:27.030862 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44330879-b151-424a-ac52-3ca08f7290f9 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:27.033985 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44330879-b151-424a-ac52-3ca08f7290f9 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:27.034529 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44330879-b151-424a-ac52-3ca08f7290f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:27.059645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-326357bb-eb43-4112-88a4-803f8ff2b9e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abf6c6aa1799464998c750e756b2318d'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:27.061893 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-326357bb-eb43-4112-88a4-803f8ff2b9e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abf6c6aa1799464998c750e756b2318d'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:27.086461 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 830/1665] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:24:26 2022] DELETE /identity/v3/users/abf6c6aa1799464998c750e756b2318d => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:24:27.088005 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecf6f1-7a8f-4bda-8a2e-d4f537d1bf53 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:27.088406 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecf6f1-7a8f-4bda-8a2e-d4f537d1bf53 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:27.088692 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecf6f1-7a8f-4bda-8a2e-d4f537d1bf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:27.142579 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-44330879-b151-424a-ac52-3ca08f7290f9 None None] MFA Rules not processed for user `6a11a98453464583a7600bd43d791aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:27.143875 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-44330879-b151-424a-ac52-3ca08f7290f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:27.156446 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-d1ecf6f1-7a8f-4bda-8a2e-d4f537d1bf53 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:27.157737 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-d1ecf6f1-7a8f-4bda-8a2e-d4f537d1bf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:27.327432 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 836/1666] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:27.337958 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44330879-b151-424a-ac52-3ca08f7290f9 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:27.342494 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-44330879-b151-424a-ac52-3ca08f7290f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:27.361532 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 831/1667] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:27.362596 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ecf6f1-7a8f-4bda-8a2e-d4f537d1bf53 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:27.367949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-d1ecf6f1-7a8f-4bda-8a2e-d4f537d1bf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:27.416582 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44330879-b151-424a-ac52-3ca08f7290f9 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:27.438355 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012484bd-88dd-4c6b-b9a7-1f8b15f7a5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:27.443131 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012484bd-88dd-4c6b-b9a7-1f8b15f7a5a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:27.443131 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012484bd-88dd-4c6b-b9a7-1f8b15f7a5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:27.443131 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012484bd-88dd-4c6b-b9a7-1f8b15f7a5a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:27.445308 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012484bd-88dd-4c6b-b9a7-1f8b15f7a5a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:27.459336 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012484bd-88dd-4c6b-b9a7-1f8b15f7a5a3 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:27.514320 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:27.533206 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ecf6f1-7a8f-4bda-8a2e-d4f537d1bf53 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:27.544718 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9c55f-b60a-4949-9adb-6989b33bb82a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:27.545505 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9c55f-b60a-4949-9adb-6989b33bb82a service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:27.546277 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9c55f-b60a-4949-9adb-6989b33bb82a service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:27.547477 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9c55f-b60a-4949-9adb-6989b33bb82a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:27.569626 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9c55f-b60a-4949-9adb-6989b33bb82a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:27.572804 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9c55f-b60a-4949-9adb-6989b33bb82a service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:27.594952 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 837/1668] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:24:27 2022] POST /identity/v3/projects => generated 379 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:27.596172 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012484bd-88dd-4c6b-b9a7-1f8b15f7a5a3 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:27.610424 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 832/1669] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:27.757558 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012484bd-88dd-4c6b-b9a7-1f8b15f7a5a3 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:27.804511 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a17197-3b2f-4195-971d-69ede88c444f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:27.805534 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a17197-3b2f-4195-971d-69ede88c444f admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:27.805881 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a17197-3b2f-4195-971d-69ede88c444f admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:27.806556 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a17197-3b2f-4195-971d-69ede88c444f admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:27.807367 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a17197-3b2f-4195-971d-69ede88c444f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:27.811944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a17197-3b2f-4195-971d-69ede88c444f admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:27.978411 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9c55f-b60a-4949-9adb-6989b33bb82a service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:27.979106 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 838/1670] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:24:27 2022] POST /identity/v3/users => generated 296 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:27.990545 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9c55f-b60a-4949-9adb-6989b33bb82a service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:28.010749 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90590189-03a7-42f9-93e1-842e07a90379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:28.011389 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90590189-03a7-42f9-93e1-842e07a90379 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:28.012897 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90590189-03a7-42f9-93e1-842e07a90379 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:28.014239 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90590189-03a7-42f9-93e1-842e07a90379 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:28.017132 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90590189-03a7-42f9-93e1-842e07a90379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:28.018845 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90590189-03a7-42f9-93e1-842e07a90379 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:28.052634 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 833/1671] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:24:28.067627 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a17197-3b2f-4195-971d-69ede88c444f admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:28.093342 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a17197-3b2f-4195-971d-69ede88c444f admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:28.118518 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e790fe3-3830-45d6-8fc4-1b2b44a9d118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:28.119844 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e790fe3-3830-45d6-8fc4-1b2b44a9d118 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:28.120146 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e790fe3-3830-45d6-8fc4-1b2b44a9d118 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:28.120625 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e790fe3-3830-45d6-8fc4-1b2b44a9d118 admin admin] PATH_INFO: `/v3/projects/36ab60524d324a95959ffea35e54c31d/users/6cd77d9634ce4173aa0afc5697531a2c/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:28.171515 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e790fe3-3830-45d6-8fc4-1b2b44a9d118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36ab60524d324a95959ffea35e54c31d, user_id=6cd77d9634ce4173aa0afc5697531a2c, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:28.176071 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e790fe3-3830-45d6-8fc4-1b2b44a9d118 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:28.342843 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 839/1672] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:28 2022] PUT /identity/v3/projects/36ab60524d324a95959ffea35e54c31d/users/6cd77d9634ce4173aa0afc5697531a2c/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:28.346703 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90590189-03a7-42f9-93e1-842e07a90379 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:28.363137 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90590189-03a7-42f9-93e1-842e07a90379 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:28.445993 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:28.458563 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59524d2d-67cd-4438-a4a4-76f29587b751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:28.459718 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59524d2d-67cd-4438-a4a4-76f29587b751 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:28.460725 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59524d2d-67cd-4438-a4a4-76f29587b751 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:28.461265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59524d2d-67cd-4438-a4a4-76f29587b751 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:28.462109 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59524d2d-67cd-4438-a4a4-76f29587b751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:28.464290 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59524d2d-67cd-4438-a4a4-76f29587b751 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:28.477021 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e790fe3-3830-45d6-8fc4-1b2b44a9d118 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:28.478791 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-5e790fe3-3830-45d6-8fc4-1b2b44a9d118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:28.510458 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e790fe3-3830-45d6-8fc4-1b2b44a9d118 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:28.515047 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 834/1673] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:28.520200 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59524d2d-67cd-4438-a4a4-76f29587b751 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:28.536392 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59524d2d-67cd-4438-a4a4-76f29587b751 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:28.538688 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1491f99-ae7e-403a-8351-1569323006e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:28.539386 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1491f99-ae7e-403a-8351-1569323006e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:28.539655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1491f99-ae7e-403a-8351-1569323006e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:28.539928 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1491f99-ae7e-403a-8351-1569323006e7 admin admin] PATH_INFO: `/v3/projects/df6bd64befa444cb8c1c905b336db30a` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:28.545827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1491f99-ae7e-403a-8351-1569323006e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df6bd64befa444cb8c1c905b336db30a)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:28.547108 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8f537-cd84-4340-a1c1-7063a3c8189f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:28.547847 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1491f99-ae7e-403a-8351-1569323006e7 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:28.548792 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8f537-cd84-4340-a1c1-7063a3c8189f admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:28.549337 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8f537-cd84-4340-a1c1-7063a3c8189f admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:28.573586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8f537-cd84-4340-a1c1-7063a3c8189f admin admin] PATH_INFO: `/v3/projects/36ab60524d324a95959ffea35e54c31d/users/6cd77d9634ce4173aa0afc5697531a2c/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:28.573586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8f537-cd84-4340-a1c1-7063a3c8189f admin admin] RBAC: Authorizing `identity:create_grant(project_id=36ab60524d324a95959ffea35e54c31d, user_id=6cd77d9634ce4173aa0afc5697531a2c, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:28.588403 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8f537-cd84-4340-a1c1-7063a3c8189f admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:28.619540 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 835/1674] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:28 2022] PUT /identity/v3/projects/36ab60524d324a95959ffea35e54c31d/users/6cd77d9634ce4173aa0afc5697531a2c/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:28.634493 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15be24-6111-45ba-ae88-4580c3c502c1 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:28.634993 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15be24-6111-45ba-ae88-4580c3c502c1 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:28.635579 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15be24-6111-45ba-ae88-4580c3c502c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:28.705750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-5a15be24-6111-45ba-ae88-4580c3c502c1 None None] MFA Rules not processed for user `6cd77d9634ce4173aa0afc5697531a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:28.707042 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-5a15be24-6111-45ba-ae88-4580c3c502c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:28.758483 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c1491f99-ae7e-403a-8351-1569323006e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df6bd64befa444cb8c1c905b336db30a', 'request_id': 'req-c1491f99-ae7e-403a-8351-1569323006e7'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:28.773132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c1491f99-ae7e-403a-8351-1569323006e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df6bd64befa444cb8c1c905b336db30a', 'request_id': 'req-c1491f99-ae7e-403a-8351-1569323006e7'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:28.783136 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c1491f99-ae7e-403a-8351-1569323006e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df6bd64befa444cb8c1c905b336db30a', 'request_id': 'req-c1491f99-ae7e-403a-8351-1569323006e7'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:28.841280 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 836/1675] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:28 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:28.863294 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15be24-6111-45ba-ae88-4580c3c502c1 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:28.865313 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-5a15be24-6111-45ba-ae88-4580c3c502c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:28.870071 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c1491f99-ae7e-403a-8351-1569323006e7 admin admin] The token cache is being invalidate because project df6bd64befa444cb8c1c905b336db30a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:24:28.870706 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c1491f99-ae7e-403a-8351-1569323006e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:28.871798 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c1491f99-ae7e-403a-8351-1569323006e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:28.874291 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 840/1676] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:24:28 2022] DELETE /identity/v3/projects/df6bd64befa444cb8c1c905b336db30a => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:24:28.878658 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1491f99-ae7e-403a-8351-1569323006e7 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:28.880510 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-c1491f99-ae7e-403a-8351-1569323006e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:28.955170 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15be24-6111-45ba-ae88-4580c3c502c1 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:29.018064 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:29.053892 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019f947-79fb-485a-a813-d70068db84b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:29.054542 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019f947-79fb-485a-a813-d70068db84b6 service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:29.054868 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019f947-79fb-485a-a813-d70068db84b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:29.055162 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019f947-79fb-485a-a813-d70068db84b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:29.062447 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c019f947-79fb-485a-a813-d70068db84b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:29.067335 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1491f99-ae7e-403a-8351-1569323006e7 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:29.073470 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a265957-1247-4f43-b634-00f5a51ab354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:29.074290 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a265957-1247-4f43-b634-00f5a51ab354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:29.074290 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a265957-1247-4f43-b634-00f5a51ab354 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:29.074423 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a265957-1247-4f43-b634-00f5a51ab354 admin admin] PATH_INFO: `/v3/users/ee1a8ee72eaf46078fefefcbeb38c87d` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:29.075471 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a265957-1247-4f43-b634-00f5a51ab354 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee1a8ee72eaf46078fefefcbeb38c87d)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:29.077713 dv-cinder-854070-1-smb devstack@keystone.service[82355]: WARNING py.warnings [None req-4a265957-1247-4f43-b634-00f5a51ab354 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 04:24:29.077713 dv-cinder-854070-1-smb devstack@keystone.service[82355]: warnings.warn(msg) Aug 23 04:24:29.077713 dv-cinder-854070-1-smb devstack@keystone.service[82355]: Aug 23 04:24:29.078965 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a265957-1247-4f43-b634-00f5a51ab354 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:29.147069 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019f947-79fb-485a-a813-d70068db84b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:29.148770 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019f947-79fb-485a-a813-d70068db84b6 service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:29.166221 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 837/1677] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:24:29.305445 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-4a265957-1247-4f43-b634-00f5a51ab354 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee1a8ee72eaf46078fefefcbeb38c87d'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:29.306619 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-4a265957-1247-4f43-b634-00f5a51ab354 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee1a8ee72eaf46078fefefcbeb38c87d'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:29.325771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-4a265957-1247-4f43-b634-00f5a51ab354 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee1a8ee72eaf46078fefefcbeb38c87d'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:29.326949 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-4a265957-1247-4f43-b634-00f5a51ab354 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee1a8ee72eaf46078fefefcbeb38c87d'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:29.371813 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-4a265957-1247-4f43-b634-00f5a51ab354 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee1a8ee72eaf46078fefefcbeb38c87d'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:29.455038 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 841/1678] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:24:28 2022] DELETE /identity/v3/users/ee1a8ee72eaf46078fefefcbeb38c87d => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:29.947313 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:31.307052 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019f947-79fb-485a-a813-d70068db84b6 service cinder] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:31.326494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019f947-79fb-485a-a813-d70068db84b6 service cinder] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:31.483595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a265957-1247-4f43-b634-00f5a51ab354 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:31.485706 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-4a265957-1247-4f43-b634-00f5a51ab354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:31.507681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72099c-30ba-4fd2-91b7-73ddf236e3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:31.508355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72099c-30ba-4fd2-91b7-73ddf236e3a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:31.508642 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72099c-30ba-4fd2-91b7-73ddf236e3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:31.508916 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72099c-30ba-4fd2-91b7-73ddf236e3a1 admin admin] PATH_INFO: `/v3/projects/1ef55cb531df498c86c8528b27809a5a` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:31.518285 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72099c-30ba-4fd2-91b7-73ddf236e3a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ef55cb531df498c86c8528b27809a5a)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:31.526985 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72099c-30ba-4fd2-91b7-73ddf236e3a1 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:31.683111 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a265957-1247-4f43-b634-00f5a51ab354 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:31.694926 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ddaaa-52bf-4d6a-bd48-d539b94a574b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:31.695565 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ddaaa-52bf-4d6a-bd48-d539b94a574b service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:31.696128 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ddaaa-52bf-4d6a-bd48-d539b94a574b service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:31.696404 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ddaaa-52bf-4d6a-bd48-d539b94a574b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:31.702287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-e70ddaaa-52bf-4d6a-bd48-d539b94a574b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:31.756421 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-4c72099c-30ba-4fd2-91b7-73ddf236e3a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ef55cb531df498c86c8528b27809a5a', 'request_id': 'req-4c72099c-30ba-4fd2-91b7-73ddf236e3a1'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:31.768776 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-4c72099c-30ba-4fd2-91b7-73ddf236e3a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ef55cb531df498c86c8528b27809a5a', 'request_id': 'req-4c72099c-30ba-4fd2-91b7-73ddf236e3a1'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:31.786067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-4c72099c-30ba-4fd2-91b7-73ddf236e3a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ef55cb531df498c86c8528b27809a5a', 'request_id': 'req-4c72099c-30ba-4fd2-91b7-73ddf236e3a1'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:31.851355 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ddaaa-52bf-4d6a-bd48-d539b94a574b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:31.853025 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ddaaa-52bf-4d6a-bd48-d539b94a574b service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:31.865987 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 842/1679] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:31 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:31.904946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-4c72099c-30ba-4fd2-91b7-73ddf236e3a1 admin admin] The token cache is being invalidate because project 1ef55cb531df498c86c8528b27809a5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:24:31.904946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-4c72099c-30ba-4fd2-91b7-73ddf236e3a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:31.904946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-4c72099c-30ba-4fd2-91b7-73ddf236e3a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:31.907410 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 838/1680] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:24:31 2022] DELETE /identity/v3/projects/1ef55cb531df498c86c8528b27809a5a => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:31.913067 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae523e16-2593-48ad-b6a1-790950c8b088 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:31.913385 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae523e16-2593-48ad-b6a1-790950c8b088 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:31.914273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae523e16-2593-48ad-b6a1-790950c8b088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:31.948552 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-ae523e16-2593-48ad-b6a1-790950c8b088 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:31.950985 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-ae523e16-2593-48ad-b6a1-790950c8b088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:31.973044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:32.139410 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 843/1681] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:32.140273 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927f8c2-e05d-4186-848d-39d2d9fe3c8a None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:32.140687 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927f8c2-e05d-4186-848d-39d2d9fe3c8a None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:32.141237 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927f8c2-e05d-4186-848d-39d2d9fe3c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:32.177812 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-a927f8c2-e05d-4186-848d-39d2d9fe3c8a None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:32.182286 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-a927f8c2-e05d-4186-848d-39d2d9fe3c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:32.199647 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 839/1682] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:32.204439 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae523e16-2593-48ad-b6a1-790950c8b088 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:32.217635 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae523e16-2593-48ad-b6a1-790950c8b088 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:32.231823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c186ff-626b-44fa-9b65-8dd8416b0537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:32.233438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c186ff-626b-44fa-9b65-8dd8416b0537 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:32.233438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c186ff-626b-44fa-9b65-8dd8416b0537 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:32.233438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c186ff-626b-44fa-9b65-8dd8416b0537 admin admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:32.234271 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c186ff-626b-44fa-9b65-8dd8416b0537 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:24:32.234586 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c186ff-626b-44fa-9b65-8dd8416b0537 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:32.236577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c186ff-626b-44fa-9b65-8dd8416b0537 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:32.269129 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 844/1683] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:24:32.270446 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927f8c2-e05d-4186-848d-39d2d9fe3c8a None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:32.286944 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927f8c2-e05d-4186-848d-39d2d9fe3c8a None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:32.300392 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7a5a2-5903-4a30-aaeb-6484a6b1e27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:32.302556 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7a5a2-5903-4a30-aaeb-6484a6b1e27f admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:32.302556 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7a5a2-5903-4a30-aaeb-6484a6b1e27f admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:32.303034 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7a5a2-5903-4a30-aaeb-6484a6b1e27f admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:32.303848 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7a5a2-5903-4a30-aaeb-6484a6b1e27f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:32.306096 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7a5a2-5903-4a30-aaeb-6484a6b1e27f admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:32.335097 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2562094-a95c-4146-bf45-d1ea4f9a305b None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:32.335384 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2562094-a95c-4146-bf45-d1ea4f9a305b None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:32.336959 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2562094-a95c-4146-bf45-d1ea4f9a305b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:32.395925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-a2562094-a95c-4146-bf45-d1ea4f9a305b None None] MFA Rules not processed for user `a42dcd2083e7477caeb79bedbcde3643`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:32.400222 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-a2562094-a95c-4146-bf45-d1ea4f9a305b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:32.484158 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 840/1684] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:24:32 2022] POST /identity/v3/projects => generated 367 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:24:32.492488 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7a5a2-5903-4a30-aaeb-6484a6b1e27f admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:32.502804 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-aab7a5a2-5903-4a30-aaeb-6484a6b1e27f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:32.554830 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 845/1685] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:24:32.556031 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2562094-a95c-4146-bf45-d1ea4f9a305b None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:32.577263 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2562094-a95c-4146-bf45-d1ea4f9a305b None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:32.581250 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:32.663640 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7a5a2-5903-4a30-aaeb-6484a6b1e27f admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:32.675333 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e076c-55b2-4f06-848e-77ed56b8efc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:32.678058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e076c-55b2-4f06-848e-77ed56b8efc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:32.678350 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e076c-55b2-4f06-848e-77ed56b8efc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:32.678633 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e076c-55b2-4f06-848e-77ed56b8efc3 admin admin] PATH_INFO: `/v3/users/0fcc41ae55b445d088bfcf03e402ac38` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:32.681022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e076c-55b2-4f06-848e-77ed56b8efc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fcc41ae55b445d088bfcf03e402ac38)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:32.690349 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e076c-55b2-4f06-848e-77ed56b8efc3 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:32.700232 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbcd1be-3426-4b00-b34f-4f2fc2ec041a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:32.700893 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcd1be-3426-4b00-b34f-4f2fc2ec041a admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:32.701201 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcd1be-3426-4b00-b34f-4f2fc2ec041a admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:32.701478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcd1be-3426-4b00-b34f-4f2fc2ec041a admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:32.702802 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbcd1be-3426-4b00-b34f-4f2fc2ec041a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:32.715151 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbcd1be-3426-4b00-b34f-4f2fc2ec041a admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:32.863362 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 846/1686] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:24:32 2022] POST /identity/v3/users => generated 284 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:32.868704 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5789dac-b52b-4721-8897-ec49726310f8 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:32.868704 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5789dac-b52b-4721-8897-ec49726310f8 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:32.868704 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5789dac-b52b-4721-8897-ec49726310f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:32.915671 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6c7e076c-55b2-4f06-848e-77ed56b8efc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fcc41ae55b445d088bfcf03e402ac38'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:32.916651 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-c5789dac-b52b-4721-8897-ec49726310f8 None None] MFA Rules not processed for user `a42dcd2083e7477caeb79bedbcde3643`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:32.918136 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-c5789dac-b52b-4721-8897-ec49726310f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:33.039066 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6c7e076c-55b2-4f06-848e-77ed56b8efc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fcc41ae55b445d088bfcf03e402ac38'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:33.050658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6c7e076c-55b2-4f06-848e-77ed56b8efc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fcc41ae55b445d088bfcf03e402ac38'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:33.074765 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 847/1687] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:33.075585 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5789dac-b52b-4721-8897-ec49726310f8 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:33.092413 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6c7e076c-55b2-4f06-848e-77ed56b8efc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fcc41ae55b445d088bfcf03e402ac38'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:33.096021 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6c7e076c-55b2-4f06-848e-77ed56b8efc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fcc41ae55b445d088bfcf03e402ac38'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:33.118206 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 841/1688] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:24:32 2022] DELETE /identity/v3/users/0fcc41ae55b445d088bfcf03e402ac38 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:33.123577 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e076c-55b2-4f06-848e-77ed56b8efc3 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:33.123577 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-6c7e076c-55b2-4f06-848e-77ed56b8efc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:33.130106 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5789dac-b52b-4721-8897-ec49726310f8 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:33.337150 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4077036-9dde-42bb-b52b-2f9340b0580d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:33.337898 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4077036-9dde-42bb-b52b-2f9340b0580d admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:33.338247 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4077036-9dde-42bb-b52b-2f9340b0580d admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:33.338601 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4077036-9dde-42bb-b52b-2f9340b0580d admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:33.339451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4077036-9dde-42bb-b52b-2f9340b0580d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:33.341164 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4077036-9dde-42bb-b52b-2f9340b0580d admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:33.354755 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e076c-55b2-4f06-848e-77ed56b8efc3 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:33.355003 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 848/1689] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:33.356014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bc77f-95c9-4dab-ba8e-4f57a0f30c19 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:33.356397 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bc77f-95c9-4dab-ba8e-4f57a0f30c19 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:33.356767 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bc77f-95c9-4dab-ba8e-4f57a0f30c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:33.365853 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfceb6-54f3-4743-96cd-971fbf33e7bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:33.366517 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfceb6-54f3-4743-96cd-971fbf33e7bd service nova] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:33.366842 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfceb6-54f3-4743-96cd-971fbf33e7bd service nova] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:33.367072 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfceb6-54f3-4743-96cd-971fbf33e7bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:33.368981 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-a7cfceb6-54f3-4743-96cd-971fbf33e7bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:33.401199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-e10bc77f-95c9-4dab-ba8e-4f57a0f30c19 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:33.405980 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-e10bc77f-95c9-4dab-ba8e-4f57a0f30c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:33.426883 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 849/1690] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:33.427745 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10bc77f-95c9-4dab-ba8e-4f57a0f30c19 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:33.434880 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-e10bc77f-95c9-4dab-ba8e-4f57a0f30c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:33.479171 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10bc77f-95c9-4dab-ba8e-4f57a0f30c19 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:33.500941 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e579d6-fb54-4710-a0ae-8e7e388a32ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:33.507255 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e579d6-fb54-4710-a0ae-8e7e388a32ca admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:33.507255 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e579d6-fb54-4710-a0ae-8e7e388a32ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:33.507255 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e579d6-fb54-4710-a0ae-8e7e388a32ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:33.510350 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e579d6-fb54-4710-a0ae-8e7e388a32ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:33.512151 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e579d6-fb54-4710-a0ae-8e7e388a32ca admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:33.558040 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 850/1691] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:33.559842 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e579d6-fb54-4710-a0ae-8e7e388a32ca admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:33.564435 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-95e579d6-fb54-4710-a0ae-8e7e388a32ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:33.631330 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cfceb6-54f3-4743-96cd-971fbf33e7bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:33.633847 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cfceb6-54f3-4743-96cd-971fbf33e7bd service nova] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:33.678952 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 842/1692] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:33 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:33.680647 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfceb6-54f3-4743-96cd-971fbf33e7bd service nova] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:33.708665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfceb6-54f3-4743-96cd-971fbf33e7bd service nova] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:33.723921 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02d192-387a-410c-82c3-36fddc00c3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:33.724709 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02d192-387a-410c-82c3-36fddc00c3ba admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:33.725148 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02d192-387a-410c-82c3-36fddc00c3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:33.725437 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02d192-387a-410c-82c3-36fddc00c3ba admin admin] PATH_INFO: `/v3/projects/db9057cc06734c62a988e7dd598d1c13/users/327bb928f67d4c9888f38984e79dd7f1/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:33.754898 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e579d6-fb54-4710-a0ae-8e7e388a32ca admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:33.782168 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c0498-4ba2-426f-8dcf-396d9cccf8cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:33.782168 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c0498-4ba2-426f-8dcf-396d9cccf8cd service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:33.782168 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c0498-4ba2-426f-8dcf-396d9cccf8cd service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:33.782168 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c0498-4ba2-426f-8dcf-396d9cccf8cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:33.787651 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02d192-387a-410c-82c3-36fddc00c3ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=db9057cc06734c62a988e7dd598d1c13, user_id=327bb928f67d4c9888f38984e79dd7f1, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:33.803940 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:33.810947 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c0498-4ba2-426f-8dcf-396d9cccf8cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:33.810947 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c0498-4ba2-426f-8dcf-396d9cccf8cd service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:33.818092 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02d192-387a-410c-82c3-36fddc00c3ba admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:33.835543 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 851/1693] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:33.903932 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 843/1694] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:33 2022] PUT /identity/v3/projects/db9057cc06734c62a988e7dd598d1c13/users/327bb928f67d4c9888f38984e79dd7f1/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:33.904927 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313ccb9-95f0-4ec8-8138-d79fcdc99d2c None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:33.905263 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313ccb9-95f0-4ec8-8138-d79fcdc99d2c None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:33.905543 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313ccb9-95f0-4ec8-8138-d79fcdc99d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:34.013287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-7313ccb9-95f0-4ec8-8138-d79fcdc99d2c None None] MFA Rules not processed for user `327bb928f67d4c9888f38984e79dd7f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:34.014745 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-7313ccb9-95f0-4ec8-8138-d79fcdc99d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:34.124444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:34.140769 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e7528-810a-47e4-a771-62701d84afbf None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:34.140769 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e7528-810a-47e4-a771-62701d84afbf None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:34.141395 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e7528-810a-47e4-a771-62701d84afbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:34.188319 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 852/1695] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:24:34.200279 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313ccb9-95f0-4ec8-8138-d79fcdc99d2c None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:34.215346 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-fa3e7528-810a-47e4-a771-62701d84afbf None None] MFA Rules not processed for user `0c2e8b2cb29542febfe09e6a33e094b6`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:34.216997 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-fa3e7528-810a-47e4-a771-62701d84afbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:34.351028 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313ccb9-95f0-4ec8-8138-d79fcdc99d2c None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:34.364199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0467a-1a82-44e3-9414-fe5930684f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:34.366120 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0467a-1a82-44e3-9414-fe5930684f0b admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:34.366505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0467a-1a82-44e3-9414-fe5930684f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:34.368487 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0467a-1a82-44e3-9414-fe5930684f0b admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:34.369399 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0467a-1a82-44e3-9414-fe5930684f0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:34.374397 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0467a-1a82-44e3-9414-fe5930684f0b admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:34.381565 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 844/1696] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:34.404702 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e7528-810a-47e4-a771-62701d84afbf None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:34.411725 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-fa3e7528-810a-47e4-a771-62701d84afbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:34.555844 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 853/1697] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:24:34 2022] POST /identity/v3/projects => generated 367 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:34.560062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0467a-1a82-44e3-9414-fe5930684f0b admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:34.584276 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e7528-810a-47e4-a771-62701d84afbf None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:34.744133 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0467a-1a82-44e3-9414-fe5930684f0b admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:34.752968 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43201bfa-2261-4087-8dc6-43e3822a971b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:34.754245 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43201bfa-2261-4087-8dc6-43e3822a971b admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:34.754753 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43201bfa-2261-4087-8dc6-43e3822a971b admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:34.755365 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43201bfa-2261-4087-8dc6-43e3822a971b admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:34.756385 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43201bfa-2261-4087-8dc6-43e3822a971b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:34.759045 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43201bfa-2261-4087-8dc6-43e3822a971b admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:34.771856 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960fec9-249a-4f88-bc9e-cfbdbf01f24f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:34.772321 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960fec9-249a-4f88-bc9e-cfbdbf01f24f service nova] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:34.772730 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960fec9-249a-4f88-bc9e-cfbdbf01f24f service nova] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:34.773183 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960fec9-249a-4f88-bc9e-cfbdbf01f24f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:34.794404 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:34.878167 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 854/1698] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:24:34 2022] POST /identity/v3/users => generated 290 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:34.890343 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12deed-cc25-432e-9f02-9e1b62700ede None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:34.894739 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12deed-cc25-432e-9f02-9e1b62700ede None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:34.896943 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12deed-cc25-432e-9f02-9e1b62700ede None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:34.906880 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 855/1699] 10.222.0.42 () {54 vars in 912 bytes} [Tue Aug 23 04:24:34 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:24:34.906880 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12deed-cc25-432e-9f02-9e1b62700ede None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:34.977447 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960fec9-249a-4f88-bc9e-cfbdbf01f24f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:34.981048 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12deed-cc25-432e-9f02-9e1b62700ede None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:34.981724 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960fec9-249a-4f88-bc9e-cfbdbf01f24f service nova] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:34.988175 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c269c6-f60b-4775-b767-f41b11554652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:34.988855 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c269c6-f60b-4775-b767-f41b11554652 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:34.989174 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c269c6-f60b-4775-b767-f41b11554652 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:34.989454 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c269c6-f60b-4775-b767-f41b11554652 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:34.990187 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c269c6-f60b-4775-b767-f41b11554652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:34.991811 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c269c6-f60b-4775-b767-f41b11554652 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:34.996500 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 845/1700] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:34.998349 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe4306-e8b3-48e6-97f5-6b93f2324c16 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:34.998791 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe4306-e8b3-48e6-97f5-6b93f2324c16 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:34.999140 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe4306-e8b3-48e6-97f5-6b93f2324c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:35.027289 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 856/1701] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:35.031692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c269c6-f60b-4775-b767-f41b11554652 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:35.052071 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c269c6-f60b-4775-b767-f41b11554652 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:35.053551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-8ebe4306-e8b3-48e6-97f5-6b93f2324c16 None None] MFA Rules not processed for user `8304ca06f82742ef8ce74396884e90b4`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:35.054902 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-8ebe4306-e8b3-48e6-97f5-6b93f2324c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:35.067005 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e35af4-4f6f-4d02-9999-d47f06c2a2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:35.067669 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e35af4-4f6f-4d02-9999-d47f06c2a2ec admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:35.067951 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e35af4-4f6f-4d02-9999-d47f06c2a2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:35.068223 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e35af4-4f6f-4d02-9999-d47f06c2a2ec admin admin] PATH_INFO: `/v3/projects/edb89d85913b4b6fa7b98e5234b579e4/users/519ba394af9e43e18438b8bdf609ee66/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:35.129591 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e35af4-4f6f-4d02-9999-d47f06c2a2ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=edb89d85913b4b6fa7b98e5234b579e4, user_id=519ba394af9e43e18438b8bdf609ee66, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:35.134477 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e35af4-4f6f-4d02-9999-d47f06c2a2ec admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:35.160370 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 846/1702] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 23 04:24:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:35.262347 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 857/1703] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:35 2022] PUT /identity/v3/projects/edb89d85913b4b6fa7b98e5234b579e4/users/519ba394af9e43e18438b8bdf609ee66/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:35.266314 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe4306-e8b3-48e6-97f5-6b93f2324c16 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:35.287917 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe4306-e8b3-48e6-97f5-6b93f2324c16 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:35.319675 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e35af4-4f6f-4d02-9999-d47f06c2a2ec admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:35.388143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:35.419249 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be457f-f7ab-4d7a-92c8-ca30d72d76d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:35.420003 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be457f-f7ab-4d7a-92c8-ca30d72d76d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:35.420298 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be457f-f7ab-4d7a-92c8-ca30d72d76d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:35.420575 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be457f-f7ab-4d7a-92c8-ca30d72d76d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:35.423050 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be457f-f7ab-4d7a-92c8-ca30d72d76d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:35.426964 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be457f-f7ab-4d7a-92c8-ca30d72d76d2 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:35.448080 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e35af4-4f6f-4d02-9999-d47f06c2a2ec admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:35.455910 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 847/1704] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:35.459534 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa70eef-b8ef-498d-b6b9-31c4cdff3510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:35.460351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa70eef-b8ef-498d-b6b9-31c4cdff3510 service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:35.461885 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa70eef-b8ef-498d-b6b9-31c4cdff3510 service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:35.462172 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa70eef-b8ef-498d-b6b9-31c4cdff3510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:35.463898 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be457f-f7ab-4d7a-92c8-ca30d72d76d2 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:35.478014 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-97be457f-f7ab-4d7a-92c8-ca30d72d76d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:35.496082 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be457f-f7ab-4d7a-92c8-ca30d72d76d2 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:35.499297 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa70eef-b8ef-498d-b6b9-31c4cdff3510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:35.501070 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa70eef-b8ef-498d-b6b9-31c4cdff3510 service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:35.501736 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e83af-fbf2-4803-a76e-1c2fe5df4906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:35.503237 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e83af-fbf2-4803-a76e-1c2fe5df4906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:35.504243 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e83af-fbf2-4803-a76e-1c2fe5df4906 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:35.504733 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e83af-fbf2-4803-a76e-1c2fe5df4906 admin admin] PATH_INFO: `/v3/projects/e49b9d9c7b4b45a3a2650fe19c035fa9` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:35.506175 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e83af-fbf2-4803-a76e-1c2fe5df4906 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e49b9d9c7b4b45a3a2650fe19c035fa9)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:35.508750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e83af-fbf2-4803-a76e-1c2fe5df4906 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:35.519476 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 858/1705] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:24:35.529258 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d1d01-7ef3-4830-b775-4a0754aaffeb None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:35.529258 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d1d01-7ef3-4830-b775-4a0754aaffeb None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:35.529258 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d1d01-7ef3-4830-b775-4a0754aaffeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:35.592294 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-703d1d01-7ef3-4830-b775-4a0754aaffeb None None] MFA Rules not processed for user `ce7828f322174fe5b3ee7d252010ccf7`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:35.594263 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-703d1d01-7ef3-4830-b775-4a0754aaffeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:35.630109 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:35.704782 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-c98e83af-fbf2-4803-a76e-1c2fe5df4906 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e49b9d9c7b4b45a3a2650fe19c035fa9', 'request_id': 'req-c98e83af-fbf2-4803-a76e-1c2fe5df4906'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:35.719557 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 859/1706] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:35.723746 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d1d01-7ef3-4830-b775-4a0754aaffeb None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:35.723875 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-c98e83af-fbf2-4803-a76e-1c2fe5df4906 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e49b9d9c7b4b45a3a2650fe19c035fa9', 'request_id': 'req-c98e83af-fbf2-4803-a76e-1c2fe5df4906'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:35.735677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d1d01-7ef3-4830-b775-4a0754aaffeb None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:35.749164 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-c98e83af-fbf2-4803-a76e-1c2fe5df4906 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e49b9d9c7b4b45a3a2650fe19c035fa9', 'request_id': 'req-c98e83af-fbf2-4803-a76e-1c2fe5df4906'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:35.813761 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3da4db-cfd2-4a7f-8e5e-77a69fcb2f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:35.814585 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3da4db-cfd2-4a7f-8e5e-77a69fcb2f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:35.814952 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3da4db-cfd2-4a7f-8e5e-77a69fcb2f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:35.815368 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3da4db-cfd2-4a7f-8e5e-77a69fcb2f2f admin admin] PATH_INFO: `/v3/projects/edb89d85913b4b6fa7b98e5234b579e4/users/519ba394af9e43e18438b8bdf609ee66/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:35.817620 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3da4db-cfd2-4a7f-8e5e-77a69fcb2f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=edb89d85913b4b6fa7b98e5234b579e4, user_id=519ba394af9e43e18438b8bdf609ee66, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:35.820698 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3da4db-cfd2-4a7f-8e5e-77a69fcb2f2f admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:35.834149 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 860/1707] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:35 2022] PUT /identity/v3/projects/edb89d85913b4b6fa7b98e5234b579e4/users/519ba394af9e43e18438b8bdf609ee66/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:35.835544 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e85f97-6bc6-47a1-a7c0-93ffbbf05921 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:35.835938 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e85f97-6bc6-47a1-a7c0-93ffbbf05921 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:35.836286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e85f97-6bc6-47a1-a7c0-93ffbbf05921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:35.867106 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-f4e85f97-6bc6-47a1-a7c0-93ffbbf05921 None None] MFA Rules not processed for user `ce7828f322174fe5b3ee7d252010ccf7`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:35.870917 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-f4e85f97-6bc6-47a1-a7c0-93ffbbf05921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:35.875313 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-c98e83af-fbf2-4803-a76e-1c2fe5df4906 admin admin] The token cache is being invalidate because project e49b9d9c7b4b45a3a2650fe19c035fa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:24:35.875828 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-c98e83af-fbf2-4803-a76e-1c2fe5df4906 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:35.878920 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-c98e83af-fbf2-4803-a76e-1c2fe5df4906 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:35.885348 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 848/1708] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:24:35 2022] DELETE /identity/v3/projects/e49b9d9c7b4b45a3a2650fe19c035fa9 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:35.886858 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8895004-9ac7-4b84-93fb-39a795ec784e None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:35.887148 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8895004-9ac7-4b84-93fb-39a795ec784e None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:35.887416 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8895004-9ac7-4b84-93fb-39a795ec784e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:35.974718 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 861/1709] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:35.976431 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9605b3b-28c8-44dc-8af9-e62e3b3b4123 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:35.976944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9605b3b-28c8-44dc-8af9-e62e3b3b4123 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:35.977568 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9605b3b-28c8-44dc-8af9-e62e3b3b4123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:36.005822 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-b9605b3b-28c8-44dc-8af9-e62e3b3b4123 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:36.008430 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-b9605b3b-28c8-44dc-8af9-e62e3b3b4123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:36.012050 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-c8895004-9ac7-4b84-93fb-39a795ec784e None None] MFA Rules not processed for user `519ba394af9e43e18438b8bdf609ee66`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:36.015126 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c8895004-9ac7-4b84-93fb-39a795ec784e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:36.156066 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 862/1710] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:36.160408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9605b3b-28c8-44dc-8af9-e62e3b3b4123 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:36.165310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-b9605b3b-28c8-44dc-8af9-e62e3b3b4123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:36.242132 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 849/1711] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:36.243465 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ada1fc-eb93-42d8-8d75-5371c1260c87 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:36.243757 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ada1fc-eb93-42d8-8d75-5371c1260c87 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:36.244033 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ada1fc-eb93-42d8-8d75-5371c1260c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:36.309645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-a3ada1fc-eb93-42d8-8d75-5371c1260c87 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:36.312591 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-a3ada1fc-eb93-42d8-8d75-5371c1260c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:36.334863 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 850/1712] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:36.339863 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ada1fc-eb93-42d8-8d75-5371c1260c87 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:36.341462 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9605b3b-28c8-44dc-8af9-e62e3b3b4123 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:36.345965 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-a3ada1fc-eb93-42d8-8d75-5371c1260c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:36.360150 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef769e52-252e-4815-b949-21265bebbbc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:36.360802 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef769e52-252e-4815-b949-21265bebbbc2 service nova] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:36.364907 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef769e52-252e-4815-b949-21265bebbbc2 service nova] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:36.364907 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef769e52-252e-4815-b949-21265bebbbc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:36.370905 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-ef769e52-252e-4815-b949-21265bebbbc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:36.383434 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ada1fc-eb93-42d8-8d75-5371c1260c87 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:36.400468 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ad081-fe13-4933-adfe-6e8e7a59d2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:36.404056 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ad081-fe13-4933-adfe-6e8e7a59d2fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:36.404425 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef769e52-252e-4815-b949-21265bebbbc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:36.415163 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ad081-fe13-4933-adfe-6e8e7a59d2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:36.417974 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef769e52-252e-4815-b949-21265bebbbc2 service nova] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:36.421510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ad081-fe13-4933-adfe-6e8e7a59d2fa admin admin] PATH_INFO: `/v3/users/48d0bcae53794da791c8dfe05caaf030` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:36.424169 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ad081-fe13-4933-adfe-6e8e7a59d2fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=48d0bcae53794da791c8dfe05caaf030)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:36.444650 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ad081-fe13-4933-adfe-6e8e7a59d2fa admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:36.458725 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 863/1713] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:36.471528 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef769e52-252e-4815-b949-21265bebbbc2 service nova] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:36.475602 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-ef769e52-252e-4815-b949-21265bebbbc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:36.666590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:36.720371 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef769e52-252e-4815-b949-21265bebbbc2 service nova] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:36.733374 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff043ec1-44c9-4904-bf75-890ece5e8b09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:36.733501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff043ec1-44c9-4904-bf75-890ece5e8b09 service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:36.733856 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff043ec1-44c9-4904-bf75-890ece5e8b09 service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:36.734143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff043ec1-44c9-4904-bf75-890ece5e8b09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:36.734494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-cb6ad081-fe13-4933-adfe-6e8e7a59d2fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48d0bcae53794da791c8dfe05caaf030'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:36.747077 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff043ec1-44c9-4904-bf75-890ece5e8b09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:36.753035 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff043ec1-44c9-4904-bf75-890ece5e8b09 service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:36.768135 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 864/1714] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:36.769746 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff043ec1-44c9-4904-bf75-890ece5e8b09 service cinder] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:36.804612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:36.807126 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-cb6ad081-fe13-4933-adfe-6e8e7a59d2fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48d0bcae53794da791c8dfe05caaf030'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:36.818743 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-cb6ad081-fe13-4933-adfe-6e8e7a59d2fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48d0bcae53794da791c8dfe05caaf030'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:36.826658 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff043ec1-44c9-4904-bf75-890ece5e8b09 service cinder] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:36.841448 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07541e5f-6b2d-4829-9b59-5bf7a5a5e494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:36.842197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07541e5f-6b2d-4829-9b59-5bf7a5a5e494 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:36.842651 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07541e5f-6b2d-4829-9b59-5bf7a5a5e494 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:36.843139 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07541e5f-6b2d-4829-9b59-5bf7a5a5e494 admin admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:36.843616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07541e5f-6b2d-4829-9b59-5bf7a5a5e494 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:24:36.843914 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07541e5f-6b2d-4829-9b59-5bf7a5a5e494 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:36.845598 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07541e5f-6b2d-4829-9b59-5bf7a5a5e494 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:36.871438 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-cb6ad081-fe13-4933-adfe-6e8e7a59d2fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48d0bcae53794da791c8dfe05caaf030'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:36.873209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-cb6ad081-fe13-4933-adfe-6e8e7a59d2fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48d0bcae53794da791c8dfe05caaf030'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:36.892266 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 851/1715] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:24:36 2022] DELETE /identity/v3/users/48d0bcae53794da791c8dfe05caaf030 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:36.893396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d90e48-d667-42e6-973a-97a9887c71b7 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:36.893690 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d90e48-d667-42e6-973a-97a9887c71b7 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:36.894006 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d90e48-d667-42e6-973a-97a9887c71b7 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:36.902466 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 852/1716] 10.222.0.42 () {54 vars in 961 bytes} [Tue Aug 23 04:24:36 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:24:36.903741 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 865/1717] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:24:36.905463 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07541e5f-6b2d-4829-9b59-5bf7a5a5e494 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:36.905672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87846a5c-7b87-489b-a261-c70586a16b55 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:36.907098 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87846a5c-7b87-489b-a261-c70586a16b55 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:36.907500 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87846a5c-7b87-489b-a261-c70586a16b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:36.910118 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-07541e5f-6b2d-4829-9b59-5bf7a5a5e494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:36.953425 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07541e5f-6b2d-4829-9b59-5bf7a5a5e494 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:36.987225 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-87846a5c-7b87-489b-a261-c70586a16b55 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:36.991147 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-87846a5c-7b87-489b-a261-c70586a16b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:37.196076 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa73b95-c1cb-4632-b2fd-d707a11bd6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:37.196750 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa73b95-c1cb-4632-b2fd-d707a11bd6ea admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:37.197039 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa73b95-c1cb-4632-b2fd-d707a11bd6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:37.197344 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa73b95-c1cb-4632-b2fd-d707a11bd6ea admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:37.197998 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa73b95-c1cb-4632-b2fd-d707a11bd6ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:37.204950 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa73b95-c1cb-4632-b2fd-d707a11bd6ea admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:37.215753 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 853/1718] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:37.217462 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f8745-9a8c-4cfd-80ea-a151001c58fc None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:37.217762 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f8745-9a8c-4cfd-80ea-a151001c58fc None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:37.218044 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f8745-9a8c-4cfd-80ea-a151001c58fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:37.266475 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-405f8745-9a8c-4cfd-80ea-a151001c58fc None None] MFA Rules not processed for user `34794124b7234aeb98a15f0c2ae06a0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:37.269721 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-405f8745-9a8c-4cfd-80ea-a151001c58fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:37.381065 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 866/1719] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:24:36 2022] POST /identity/v3/projects => generated 373 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:37.382588 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73072a39-aee2-4d3f-97c8-ac963a065cdb None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:37.384378 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73072a39-aee2-4d3f-97c8-ac963a065cdb None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:37.385549 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73072a39-aee2-4d3f-97c8-ac963a065cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:37.394023 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:37.413072 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 854/1720] 10.222.0.42 () {58 vars in 1058 bytes} [Tue Aug 23 04:24:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:37.414160 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f8745-9a8c-4cfd-80ea-a151001c58fc None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:37.415784 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-405f8745-9a8c-4cfd-80ea-a151001c58fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:37.427227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-73072a39-aee2-4d3f-97c8-ac963a065cdb None None] MFA Rules not processed for user `a42dcd2083e7477caeb79bedbcde3643`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:37.428629 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-73072a39-aee2-4d3f-97c8-ac963a065cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:37.562638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 867/1721] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:37.563666 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3c8e8-9939-4178-bef9-dde89e2e3273 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:37.564438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3c8e8-9939-4178-bef9-dde89e2e3273 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:37.578301 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f8745-9a8c-4cfd-80ea-a151001c58fc None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:37.580119 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3c8e8-9939-4178-bef9-dde89e2e3273 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:37.596164 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 868/1722] 10.222.0.42 () {54 vars in 912 bytes} [Tue Aug 23 04:24:37 2022] GET /identity => generated 270 bytes in 34 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:24:37.599773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3c8e8-9939-4178-bef9-dde89e2e3273 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:37.733863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:37.766073 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604e68b-8f94-4c59-a18a-934f0d1ebabd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:37.766775 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604e68b-8f94-4c59-a18a-934f0d1ebabd service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:37.767101 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604e68b-8f94-4c59-a18a-934f0d1ebabd service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:37.767588 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604e68b-8f94-4c59-a18a-934f0d1ebabd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:37.789377 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604e68b-8f94-4c59-a18a-934f0d1ebabd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:37.790947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604e68b-8f94-4c59-a18a-934f0d1ebabd service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:37.806001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3c8e8-9939-4178-bef9-dde89e2e3273 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:37.819109 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 855/1723] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:37.819948 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604e68b-8f94-4c59-a18a-934f0d1ebabd service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:37.820386 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2aa46b-db34-442e-b66f-7a10455a542b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:37.820969 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2aa46b-db34-442e-b66f-7a10455a542b admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:37.821304 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2aa46b-db34-442e-b66f-7a10455a542b admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:37.821588 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2aa46b-db34-442e-b66f-7a10455a542b admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:37.822241 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2aa46b-db34-442e-b66f-7a10455a542b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:37.828157 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2aa46b-db34-442e-b66f-7a10455a542b admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:37.976588 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 869/1724] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:24:37 2022] POST /identity/v3/users => generated 287 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:37.976588 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec7dc8-dad0-419f-ba84-bbbe47c4cd2a None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:37.976849 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec7dc8-dad0-419f-ba84-bbbe47c4cd2a None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:37.977113 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec7dc8-dad0-419f-ba84-bbbe47c4cd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:37.979386 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604e68b-8f94-4c59-a18a-934f0d1ebabd service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:37.991829 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a880d-79d0-4bba-8b95-1f988cfd18b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34794124b7234aeb98a15f0c2ae06a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:37.992764 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a880d-79d0-4bba-8b95-1f988cfd18b7 service placement] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:37.993080 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a880d-79d0-4bba-8b95-1f988cfd18b7 service placement] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:37.993389 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a880d-79d0-4bba-8b95-1f988cfd18b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:37.999911 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-052a880d-79d0-4bba-8b95-1f988cfd18b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:38.021758 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-d8ec7dc8-dad0-419f-ba84-bbbe47c4cd2a None None] MFA Rules not processed for user `8304ca06f82742ef8ce74396884e90b4`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:38.023764 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-d8ec7dc8-dad0-419f-ba84-bbbe47c4cd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:38.026002 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a880d-79d0-4bba-8b95-1f988cfd18b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:38.027616 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a880d-79d0-4bba-8b95-1f988cfd18b7 service placement] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:38.045997 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 856/1725] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:38.046694 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a880d-79d0-4bba-8b95-1f988cfd18b7 service placement] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:38.053969 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-052a880d-79d0-4bba-8b95-1f988cfd18b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:38.059884 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 870/1726] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 23 04:24:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:38.061062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec7dc8-dad0-419f-ba84-bbbe47c4cd2a None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:38.077250 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec7dc8-dad0-419f-ba84-bbbe47c4cd2a None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:38.082771 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a880d-79d0-4bba-8b95-1f988cfd18b7 service placement] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:38.083502 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e77d6-79b9-4fd3-95a2-5d6a5d05838d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:38.084194 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e77d6-79b9-4fd3-95a2-5d6a5d05838d admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:38.084541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e77d6-79b9-4fd3-95a2-5d6a5d05838d admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:38.084826 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e77d6-79b9-4fd3-95a2-5d6a5d05838d admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:38.085547 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e77d6-79b9-4fd3-95a2-5d6a5d05838d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:38.088451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e77d6-79b9-4fd3-95a2-5d6a5d05838d admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:38.092678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4c6c3-585e-459b-b95b-f3934ee09eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:38.093869 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4c6c3-585e-459b-b95b-f3934ee09eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:38.094162 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4c6c3-585e-459b-b95b-f3934ee09eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:38.094543 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4c6c3-585e-459b-b95b-f3934ee09eb5 admin admin] PATH_INFO: `/v3/users/6a11a98453464583a7600bd43d791aeb` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:38.099340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4c6c3-585e-459b-b95b-f3934ee09eb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a11a98453464583a7600bd43d791aeb)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:38.101371 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4c6c3-585e-459b-b95b-f3934ee09eb5 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:38.103450 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 871/1727] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:38.106273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e77d6-79b9-4fd3-95a2-5d6a5d05838d admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:38.108318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-103e77d6-79b9-4fd3-95a2-5d6a5d05838d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:38.127789 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e77d6-79b9-4fd3-95a2-5d6a5d05838d admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:38.141938 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c35625-fee2-42c4-98e5-7827589c2a4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:38.143116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c35625-fee2-42c4-98e5-7827589c2a4e service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:38.143763 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c35625-fee2-42c4-98e5-7827589c2a4e service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:38.145148 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c35625-fee2-42c4-98e5-7827589c2a4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:38.155240 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c35625-fee2-42c4-98e5-7827589c2a4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:38.158466 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c35625-fee2-42c4-98e5-7827589c2a4e service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:38.173659 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 872/1728] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:24:38.175408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c35625-fee2-42c4-98e5-7827589c2a4e service neutron] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:38.205394 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c35625-fee2-42c4-98e5-7827589c2a4e service neutron] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:38.210725 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:38.216534 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877eae3-5444-447b-ae59-952349e87a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:38.226591 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877eae3-5444-447b-ae59-952349e87a91 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:38.228047 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877eae3-5444-447b-ae59-952349e87a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:38.228047 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877eae3-5444-447b-ae59-952349e87a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:38.228467 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877eae3-5444-447b-ae59-952349e87a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:38.230733 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877eae3-5444-447b-ae59-952349e87a91 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:38.256804 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 873/1729] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:38.258383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877eae3-5444-447b-ae59-952349e87a91 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:38.271848 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877eae3-5444-447b-ae59-952349e87a91 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:38.279171 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b82948-5a42-4563-bf18-954f666ea294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:38.280128 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b82948-5a42-4563-bf18-954f666ea294 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:38.280562 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b82948-5a42-4563-bf18-954f666ea294 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:38.281016 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b82948-5a42-4563-bf18-954f666ea294 admin admin] PATH_INFO: `/v3/projects/30d4a35d67644cad8bcc3d8717924ce0/users/86050b96970c4e9588763a30aab4929b/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:38.307062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b82948-5a42-4563-bf18-954f666ea294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30d4a35d67644cad8bcc3d8717924ce0, user_id=86050b96970c4e9588763a30aab4929b, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:38.311335 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b82948-5a42-4563-bf18-954f666ea294 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:38.368106 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-ffb4c6c3-585e-459b-b95b-f3934ee09eb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a11a98453464583a7600bd43d791aeb'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:38.395477 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 874/1730] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:38 2022] PUT /identity/v3/projects/30d4a35d67644cad8bcc3d8717924ce0/users/86050b96970c4e9588763a30aab4929b/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:38.411118 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e0e5c-1a86-4c86-952b-87677b09b215 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:38.411413 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e0e5c-1a86-4c86-952b-87677b09b215 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:38.411693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e0e5c-1a86-4c86-952b-87677b09b215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:38.472523 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-ffb4c6c3-585e-459b-b95b-f3934ee09eb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a11a98453464583a7600bd43d791aeb'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:38.485571 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-ffb4c6c3-585e-459b-b95b-f3934ee09eb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a11a98453464583a7600bd43d791aeb'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:38.492139 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-9e1e0e5c-1a86-4c86-952b-87677b09b215 None None] MFA Rules not processed for user `86050b96970c4e9588763a30aab4929b`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:38.495855 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-9e1e0e5c-1a86-4c86-952b-87677b09b215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:38.536518 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-ffb4c6c3-585e-459b-b95b-f3934ee09eb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a11a98453464583a7600bd43d791aeb'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:38.537589 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-ffb4c6c3-585e-459b-b95b-f3934ee09eb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a11a98453464583a7600bd43d791aeb'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:38.562485 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 857/1731] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:24:38 2022] DELETE /identity/v3/users/6a11a98453464583a7600bd43d791aeb => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:38.574889 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f56bb-4c9c-4bdd-9832-5f41c4b6e466 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:38.575410 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f56bb-4c9c-4bdd-9832-5f41c4b6e466 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:38.575790 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f56bb-4c9c-4bdd-9832-5f41c4b6e466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:38.618419 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 875/1732] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:24:38.624959 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e0e5c-1a86-4c86-952b-87677b09b215 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:38.626336 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-9e1e0e5c-1a86-4c86-952b-87677b09b215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:38.630042 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-6a9f56bb-4c9c-4bdd-9832-5f41c4b6e466 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:38.632597 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-6a9f56bb-4c9c-4bdd-9832-5f41c4b6e466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:38.768186 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 858/1733] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:24:38.774824 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e0e5c-1a86-4c86-952b-87677b09b215 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:38.780017 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff991c-b518-45d7-bcef-76e0c841b65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:38.781451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff991c-b518-45d7-bcef-76e0c841b65a admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:38.782120 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff991c-b518-45d7-bcef-76e0c841b65a admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:38.782120 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff991c-b518-45d7-bcef-76e0c841b65a admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:38.782947 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff991c-b518-45d7-bcef-76e0c841b65a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:38.785924 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff991c-b518-45d7-bcef-76e0c841b65a admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:38.800124 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f56bb-4c9c-4bdd-9832-5f41c4b6e466 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:38.804133 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-6a9f56bb-4c9c-4bdd-9832-5f41c4b6e466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:38.907760 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f56bb-4c9c-4bdd-9832-5f41c4b6e466 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:38.921340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfc028-a669-4cbb-aa11-f9b03d9dcbcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:38.922348 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfc028-a669-4cbb-aa11-f9b03d9dcbcb service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:38.922857 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfc028-a669-4cbb-aa11-f9b03d9dcbcb service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:38.923342 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfc028-a669-4cbb-aa11-f9b03d9dcbcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:38.956922 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dfc028-a669-4cbb-aa11-f9b03d9dcbcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:38.958675 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dfc028-a669-4cbb-aa11-f9b03d9dcbcb service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:38.973188 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 876/1734] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:24:38 2022] POST /identity/v3/projects => generated 373 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:38.976160 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff991c-b518-45d7-bcef-76e0c841b65a admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:38.997618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 859/1735] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:24:39.131725 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff991c-b518-45d7-bcef-76e0c841b65a admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:39.155440 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2f0c5-0ff5-4c20-9974-b0741787b447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:39.156623 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2f0c5-0ff5-4c20-9974-b0741787b447 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:39.157163 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2f0c5-0ff5-4c20-9974-b0741787b447 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:39.164435 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2f0c5-0ff5-4c20-9974-b0741787b447 admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:39.164435 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e2f0c5-0ff5-4c20-9974-b0741787b447 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:39.164435 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e2f0c5-0ff5-4c20-9974-b0741787b447 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:39.238905 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:39.329944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 877/1736] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:24:38 2022] POST /identity/v3/users => generated 293 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:39.333744 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfc028-a669-4cbb-aa11-f9b03d9dcbcb service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:39.339429 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2f0c5-0ff5-4c20-9974-b0741787b447 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:39.344958 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-74e2f0c5-0ff5-4c20-9974-b0741787b447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:39.358290 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfc028-a669-4cbb-aa11-f9b03d9dcbcb service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:39.381023 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a9f04-d2ea-4dd3-92f1-08424fd771b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:39.383544 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a9f04-d2ea-4dd3-92f1-08424fd771b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:39.386914 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a9f04-d2ea-4dd3-92f1-08424fd771b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:39.387664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a9f04-d2ea-4dd3-92f1-08424fd771b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:39.389966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a9f04-d2ea-4dd3-92f1-08424fd771b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:39.392085 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a9f04-d2ea-4dd3-92f1-08424fd771b7 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:39.393427 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2f0c5-0ff5-4c20-9974-b0741787b447 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:39.405518 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b585e8-e958-4e1b-8f09-33048c6c5a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:39.406229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b585e8-e958-4e1b-8f09-33048c6c5a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:39.406522 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b585e8-e958-4e1b-8f09-33048c6c5a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:39.406857 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b585e8-e958-4e1b-8f09-33048c6c5a57 admin admin] PATH_INFO: `/v3/users/ee78a25b0244465688508d7924a8e8ad` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:39.408828 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b585e8-e958-4e1b-8f09-33048c6c5a57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee78a25b0244465688508d7924a8e8ad)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:39.412614 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b585e8-e958-4e1b-8f09-33048c6c5a57 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:39.422611 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 860/1737] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:39.423762 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a9f04-d2ea-4dd3-92f1-08424fd771b7 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:39.448573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a9f04-d2ea-4dd3-92f1-08424fd771b7 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:39.468459 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31936616-0730-4309-95f0-cb0712c024d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:39.470745 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31936616-0730-4309-95f0-cb0712c024d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:39.471231 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31936616-0730-4309-95f0-cb0712c024d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:39.472623 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31936616-0730-4309-95f0-cb0712c024d5 admin admin] PATH_INFO: `/v3/projects/9395a92fa15a442d872e48814108f5ba/users/9baa85c817064dd2b4b0a7b12e7b74d2/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:39.530626 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31936616-0730-4309-95f0-cb0712c024d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9395a92fa15a442d872e48814108f5ba, user_id=9baa85c817064dd2b4b0a7b12e7b74d2, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:39.533396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31936616-0730-4309-95f0-cb0712c024d5 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:39.588705 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:39.652358 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 861/1738] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:39 2022] PUT /identity/v3/projects/9395a92fa15a442d872e48814108f5ba/users/9baa85c817064dd2b4b0a7b12e7b74d2/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:39.657373 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31936616-0730-4309-95f0-cb0712c024d5 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:39.709926 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-e5b585e8-e958-4e1b-8f09-33048c6c5a57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee78a25b0244465688508d7924a8e8ad'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:39.711890 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-e5b585e8-e958-4e1b-8f09-33048c6c5a57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee78a25b0244465688508d7924a8e8ad'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:39.734938 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-e5b585e8-e958-4e1b-8f09-33048c6c5a57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee78a25b0244465688508d7924a8e8ad'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:39.736794 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-e5b585e8-e958-4e1b-8f09-33048c6c5a57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee78a25b0244465688508d7924a8e8ad'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:39.761708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-e5b585e8-e958-4e1b-8f09-33048c6c5a57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee78a25b0244465688508d7924a8e8ad'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:39.825172 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31936616-0730-4309-95f0-cb0712c024d5 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:39.841594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 878/1739] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:24:39 2022] DELETE /identity/v3/users/ee78a25b0244465688508d7924a8e8ad => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:39.847760 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba92c5e-175d-47d7-91c6-ff8d7cbce608 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:39.848062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba92c5e-175d-47d7-91c6-ff8d7cbce608 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:39.848345 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba92c5e-175d-47d7-91c6-ff8d7cbce608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:39.851163 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c88e6c-e8ec-4886-86aa-7d1f45a99153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:39.851835 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c88e6c-e8ec-4886-86aa-7d1f45a99153 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:39.854177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c88e6c-e8ec-4886-86aa-7d1f45a99153 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:39.854467 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c88e6c-e8ec-4886-86aa-7d1f45a99153 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:39.855694 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c88e6c-e8ec-4886-86aa-7d1f45a99153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:39.858392 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c88e6c-e8ec-4886-86aa-7d1f45a99153 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:39.908940 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 862/1740] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:24:39.912026 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c88e6c-e8ec-4886-86aa-7d1f45a99153 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:39.920384 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-8ba92c5e-175d-47d7-91c6-ff8d7cbce608 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:39.922740 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-b0c88e6c-e8ec-4886-86aa-7d1f45a99153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:39.929282 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-8ba92c5e-175d-47d7-91c6-ff8d7cbce608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:39.975739 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c88e6c-e8ec-4886-86aa-7d1f45a99153 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:40.098406 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 879/1741] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:40.114592 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba92c5e-175d-47d7-91c6-ff8d7cbce608 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:40.116372 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-8ba92c5e-175d-47d7-91c6-ff8d7cbce608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:40.129036 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a67ab-7eda-4686-abed-f0d7bf812e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:40.129773 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a67ab-7eda-4686-abed-f0d7bf812e66 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:40.135169 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a67ab-7eda-4686-abed-f0d7bf812e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:40.135290 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a67ab-7eda-4686-abed-f0d7bf812e66 admin admin] PATH_INFO: `/v3/projects/9395a92fa15a442d872e48814108f5ba/users/9baa85c817064dd2b4b0a7b12e7b74d2/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:40.142680 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a67ab-7eda-4686-abed-f0d7bf812e66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9395a92fa15a442d872e48814108f5ba, user_id=9baa85c817064dd2b4b0a7b12e7b74d2, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:40.148322 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a67ab-7eda-4686-abed-f0d7bf812e66 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:40.163883 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 863/1742] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:39 2022] PUT /identity/v3/projects/9395a92fa15a442d872e48814108f5ba/users/9baa85c817064dd2b4b0a7b12e7b74d2/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:24:40.177798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9422a-23b1-4d44-a7ec-bdc044536b6e None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:40.178134 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9422a-23b1-4d44-a7ec-bdc044536b6e None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:40.179613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9422a-23b1-4d44-a7ec-bdc044536b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:40.235986 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-f8b9422a-23b1-4d44-a7ec-bdc044536b6e None None] MFA Rules not processed for user `9baa85c817064dd2b4b0a7b12e7b74d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:40.237331 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-f8b9422a-23b1-4d44-a7ec-bdc044536b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:40.336737 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba92c5e-175d-47d7-91c6-ff8d7cbce608 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:40.395802 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 864/1743] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:24:40.423205 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9422a-23b1-4d44-a7ec-bdc044536b6e None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:40.424720 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-f8b9422a-23b1-4d44-a7ec-bdc044536b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:40.496018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d8e44-185e-476f-a9db-a4a83e80277a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:40.496680 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d8e44-185e-476f-a9db-a4a83e80277a service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:40.497431 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d8e44-185e-476f-a9db-a4a83e80277a service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:40.497431 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d8e44-185e-476f-a9db-a4a83e80277a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:40.519807 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:40.633167 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9422a-23b1-4d44-a7ec-bdc044536b6e None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:40.669073 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d8e44-185e-476f-a9db-a4a83e80277a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:40.670248 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8fcd7-adf4-42b4-8403-a4aa14dc69a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:40.670993 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8fcd7-adf4-42b4-8403-a4aa14dc69a5 service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:40.671278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8fcd7-adf4-42b4-8403-a4aa14dc69a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:40.671541 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8fcd7-adf4-42b4-8403-a4aa14dc69a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:40.676920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d8e44-185e-476f-a9db-a4a83e80277a service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:40.699086 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 880/1744] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:24:40.700712 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d8e44-185e-476f-a9db-a4a83e80277a service neutron] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:40.702912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-4f4d8e44-185e-476f-a9db-a4a83e80277a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:40.716327 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8fcd7-adf4-42b4-8403-a4aa14dc69a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:40.723387 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8fcd7-adf4-42b4-8403-a4aa14dc69a5 service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:40.743523 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d8e44-185e-476f-a9db-a4a83e80277a service neutron] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:40.757429 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db543e6-df51-4415-aba7-da7b65177cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:40.758588 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db543e6-df51-4415-aba7-da7b65177cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:40.758976 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db543e6-df51-4415-aba7-da7b65177cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:40.759400 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db543e6-df51-4415-aba7-da7b65177cd8 admin admin] PATH_INFO: `/v3/projects/66b8d823ff154fb3a3fd8d7b43aed30f` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:40.762155 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db543e6-df51-4415-aba7-da7b65177cd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66b8d823ff154fb3a3fd8d7b43aed30f)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:40.767618 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db543e6-df51-4415-aba7-da7b65177cd8 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:40.775544 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 865/1745] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:24:40.777205 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c7e6a-c042-41f1-8cad-f3f6a925e0ee None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:40.778534 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c7e6a-c042-41f1-8cad-f3f6a925e0ee None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:40.780913 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c7e6a-c042-41f1-8cad-f3f6a925e0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:40.820592 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-b46c7e6a-c042-41f1-8cad-f3f6a925e0ee None None] MFA Rules not processed for user `0c2e8b2cb29542febfe09e6a33e094b6`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:40.823408 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-b46c7e6a-c042-41f1-8cad-f3f6a925e0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:40.930149 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2db543e6-df51-4415-aba7-da7b65177cd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66b8d823ff154fb3a3fd8d7b43aed30f', 'request_id': 'req-2db543e6-df51-4415-aba7-da7b65177cd8'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:40.947792 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2db543e6-df51-4415-aba7-da7b65177cd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66b8d823ff154fb3a3fd8d7b43aed30f', 'request_id': 'req-2db543e6-df51-4415-aba7-da7b65177cd8'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:40.957030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2db543e6-df51-4415-aba7-da7b65177cd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66b8d823ff154fb3a3fd8d7b43aed30f', 'request_id': 'req-2db543e6-df51-4415-aba7-da7b65177cd8'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:41.020109 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 866/1746] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:41.039186 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c7e6a-c042-41f1-8cad-f3f6a925e0ee None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:41.053867 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:41.060072 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c7e6a-c042-41f1-8cad-f3f6a925e0ee None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:41.060658 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2db543e6-df51-4415-aba7-da7b65177cd8 admin admin] The token cache is being invalidate because project 66b8d823ff154fb3a3fd8d7b43aed30f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:24:41.063581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2db543e6-df51-4415-aba7-da7b65177cd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:41.064671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2db543e6-df51-4415-aba7-da7b65177cd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:41.067165 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 881/1747] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:24:40 2022] DELETE /identity/v3/projects/66b8d823ff154fb3a3fd8d7b43aed30f => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:41.071731 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db543e6-df51-4415-aba7-da7b65177cd8 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:41.074223 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-2db543e6-df51-4415-aba7-da7b65177cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:41.185922 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db543e6-df51-4415-aba7-da7b65177cd8 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:41.190956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6673a-7ca9-4482-bc65-863030d5c0ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:41.191530 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abb3d1-6f61-4ae9-89ae-efeb020dccf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:41.191625 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6673a-7ca9-4482-bc65-863030d5c0ce service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:41.192036 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6673a-7ca9-4482-bc65-863030d5c0ce service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:41.192331 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6673a-7ca9-4482-bc65-863030d5c0ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:41.192706 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abb3d1-6f61-4ae9-89ae-efeb020dccf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:41.195775 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abb3d1-6f61-4ae9-89ae-efeb020dccf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:41.195775 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abb3d1-6f61-4ae9-89ae-efeb020dccf1 admin admin] PATH_INFO: `/v3/users/17f21e4ab1f2457b9b81449d0d877951` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:41.197398 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12abb3d1-6f61-4ae9-89ae-efeb020dccf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17f21e4ab1f2457b9b81449d0d877951)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:41.200941 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-f3d6673a-7ca9-4482-bc65-863030d5c0ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:41.201071 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12abb3d1-6f61-4ae9-89ae-efeb020dccf1 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:41.389813 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6673a-7ca9-4482-bc65-863030d5c0ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:41.393344 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6673a-7ca9-4482-bc65-863030d5c0ce service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:41.425875 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 867/1748] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:24:41.492249 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6673a-7ca9-4482-bc65-863030d5c0ce service cinder] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:41.496564 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-f3d6673a-7ca9-4482-bc65-863030d5c0ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:41.517615 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-12abb3d1-6f61-4ae9-89ae-efeb020dccf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17f21e4ab1f2457b9b81449d0d877951'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:41.519973 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-12abb3d1-6f61-4ae9-89ae-efeb020dccf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17f21e4ab1f2457b9b81449d0d877951'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:41.546173 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6673a-7ca9-4482-bc65-863030d5c0ce service cinder] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:41.553334 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35039d-7189-4775-95e1-b1d02542d06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:41.554181 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35039d-7189-4775-95e1-b1d02542d06d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:41.558250 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-12abb3d1-6f61-4ae9-89ae-efeb020dccf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17f21e4ab1f2457b9b81449d0d877951'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:41.558594 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35039d-7189-4775-95e1-b1d02542d06d admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:41.559019 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35039d-7189-4775-95e1-b1d02542d06d admin admin] PATH_INFO: `/v3/projects/d997518cf59347fc8f103b696ca8b0ba` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:41.560471 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-12abb3d1-6f61-4ae9-89ae-efeb020dccf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17f21e4ab1f2457b9b81449d0d877951'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:41.561861 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35039d-7189-4775-95e1-b1d02542d06d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d997518cf59347fc8f103b696ca8b0ba)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:41.564258 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35039d-7189-4775-95e1-b1d02542d06d admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:41.586984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-12abb3d1-6f61-4ae9-89ae-efeb020dccf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17f21e4ab1f2457b9b81449d0d877951'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:41.751188 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 882/1749] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:24:41 2022] DELETE /identity/v3/users/17f21e4ab1f2457b9b81449d0d877951 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:41.846852 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abb3d1-6f61-4ae9-89ae-efeb020dccf1 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:41.849266 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-12abb3d1-6f61-4ae9-89ae-efeb020dccf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:41.850684 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-fa35039d-7189-4775-95e1-b1d02542d06d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd997518cf59347fc8f103b696ca8b0ba', 'request_id': 'req-fa35039d-7189-4775-95e1-b1d02542d06d'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:41.871132 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-fa35039d-7189-4775-95e1-b1d02542d06d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd997518cf59347fc8f103b696ca8b0ba', 'request_id': 'req-fa35039d-7189-4775-95e1-b1d02542d06d'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:41.897913 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-fa35039d-7189-4775-95e1-b1d02542d06d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd997518cf59347fc8f103b696ca8b0ba', 'request_id': 'req-fa35039d-7189-4775-95e1-b1d02542d06d'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:42.006537 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-fa35039d-7189-4775-95e1-b1d02542d06d admin admin] The token cache is being invalidate because project d997518cf59347fc8f103b696ca8b0ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:24:42.006892 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-fa35039d-7189-4775-95e1-b1d02542d06d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:42.008562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-fa35039d-7189-4775-95e1-b1d02542d06d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:42.014232 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 868/1750] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:24:41 2022] DELETE /identity/v3/projects/d997518cf59347fc8f103b696ca8b0ba => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:42.021230 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35039d-7189-4775-95e1-b1d02542d06d admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:42.025361 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-fa35039d-7189-4775-95e1-b1d02542d06d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:42.090884 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abb3d1-6f61-4ae9-89ae-efeb020dccf1 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:42.214706 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35039d-7189-4775-95e1-b1d02542d06d admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:42.230366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1a594-cf99-43a7-8351-7dcfce91d736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:42.231331 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1a594-cf99-43a7-8351-7dcfce91d736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:42.232841 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1a594-cf99-43a7-8351-7dcfce91d736 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:42.232841 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1a594-cf99-43a7-8351-7dcfce91d736 admin admin] PATH_INFO: `/v3/users/6cd77d9634ce4173aa0afc5697531a2c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:42.239152 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1a594-cf99-43a7-8351-7dcfce91d736 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cd77d9634ce4173aa0afc5697531a2c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:42.241926 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1a594-cf99-43a7-8351-7dcfce91d736 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:42.254731 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62a704-0200-46be-a6ac-96fa53f310c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:42.255523 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62a704-0200-46be-a6ac-96fa53f310c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:42.255801 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62a704-0200-46be-a6ac-96fa53f310c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:42.256361 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62a704-0200-46be-a6ac-96fa53f310c0 admin admin] PATH_INFO: `/v3/users/327bb928f67d4c9888f38984e79dd7f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:42.260050 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62a704-0200-46be-a6ac-96fa53f310c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=327bb928f67d4c9888f38984e79dd7f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:42.263635 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62a704-0200-46be-a6ac-96fa53f310c0 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:42.594427 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-ea62a704-0200-46be-a6ac-96fa53f310c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '327bb928f67d4c9888f38984e79dd7f1'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:42.595094 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-c7a1a594-cf99-43a7-8351-7dcfce91d736 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cd77d9634ce4173aa0afc5697531a2c'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:42.595743 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-ea62a704-0200-46be-a6ac-96fa53f310c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '327bb928f67d4c9888f38984e79dd7f1'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:42.607381 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-ea62a704-0200-46be-a6ac-96fa53f310c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '327bb928f67d4c9888f38984e79dd7f1'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:42.608354 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-ea62a704-0200-46be-a6ac-96fa53f310c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '327bb928f67d4c9888f38984e79dd7f1'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:42.627638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-ea62a704-0200-46be-a6ac-96fa53f310c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '327bb928f67d4c9888f38984e79dd7f1'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:42.711752 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-c7a1a594-cf99-43a7-8351-7dcfce91d736 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cd77d9634ce4173aa0afc5697531a2c'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:42.722608 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-c7a1a594-cf99-43a7-8351-7dcfce91d736 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cd77d9634ce4173aa0afc5697531a2c'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:42.747500 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-c7a1a594-cf99-43a7-8351-7dcfce91d736 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cd77d9634ce4173aa0afc5697531a2c'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:42.748510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-c7a1a594-cf99-43a7-8351-7dcfce91d736 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cd77d9634ce4173aa0afc5697531a2c'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:42.757315 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 869/1751] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:24:42 2022] DELETE /identity/v3/users/6cd77d9634ce4173aa0afc5697531a2c => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:42.758466 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1a594-cf99-43a7-8351-7dcfce91d736 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:42.761381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c7a1a594-cf99-43a7-8351-7dcfce91d736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:42.835451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 883/1752] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:24:41 2022] DELETE /identity/v3/users/327bb928f67d4c9888f38984e79dd7f1 => generated 0 bytes in 990 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:24:42.837501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62a704-0200-46be-a6ac-96fa53f310c0 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:42.839522 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-ea62a704-0200-46be-a6ac-96fa53f310c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:42.890206 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1a594-cf99-43a7-8351-7dcfce91d736 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:43.012931 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fa964-e5cf-41ff-a28d-d4ebc5fa0239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:43.014211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fa964-e5cf-41ff-a28d-d4ebc5fa0239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:43.014698 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fa964-e5cf-41ff-a28d-d4ebc5fa0239 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:43.015180 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fa964-e5cf-41ff-a28d-d4ebc5fa0239 admin admin] PATH_INFO: `/v3/projects/3c88234720e043abbca3a4bcb2a7b626` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:43.017046 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fa964-e5cf-41ff-a28d-d4ebc5fa0239 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c88234720e043abbca3a4bcb2a7b626)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:43.020159 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fa964-e5cf-41ff-a28d-d4ebc5fa0239 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:43.049520 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62a704-0200-46be-a6ac-96fa53f310c0 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:43.074869 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe173f2b-d46f-41ed-85fb-7a7012d4c150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:43.075682 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe173f2b-d46f-41ed-85fb-7a7012d4c150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:43.076068 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe173f2b-d46f-41ed-85fb-7a7012d4c150 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:43.076445 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe173f2b-d46f-41ed-85fb-7a7012d4c150 admin admin] PATH_INFO: `/v3/projects/227590ea391840a087e8acf327aff8d5` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:43.077827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe173f2b-d46f-41ed-85fb-7a7012d4c150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=227590ea391840a087e8acf327aff8d5)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:43.080071 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe173f2b-d46f-41ed-85fb-7a7012d4c150 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:43.231812 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-561fa964-e5cf-41ff-a28d-d4ebc5fa0239 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c88234720e043abbca3a4bcb2a7b626', 'request_id': 'req-561fa964-e5cf-41ff-a28d-d4ebc5fa0239'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:43.245631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-561fa964-e5cf-41ff-a28d-d4ebc5fa0239 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c88234720e043abbca3a4bcb2a7b626', 'request_id': 'req-561fa964-e5cf-41ff-a28d-d4ebc5fa0239'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:43.260742 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-561fa964-e5cf-41ff-a28d-d4ebc5fa0239 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c88234720e043abbca3a4bcb2a7b626', 'request_id': 'req-561fa964-e5cf-41ff-a28d-d4ebc5fa0239'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:43.281933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-fe173f2b-d46f-41ed-85fb-7a7012d4c150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '227590ea391840a087e8acf327aff8d5', 'request_id': 'req-fe173f2b-d46f-41ed-85fb-7a7012d4c150'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:43.296900 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-fe173f2b-d46f-41ed-85fb-7a7012d4c150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '227590ea391840a087e8acf327aff8d5', 'request_id': 'req-fe173f2b-d46f-41ed-85fb-7a7012d4c150'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:43.307049 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-fe173f2b-d46f-41ed-85fb-7a7012d4c150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '227590ea391840a087e8acf327aff8d5', 'request_id': 'req-fe173f2b-d46f-41ed-85fb-7a7012d4c150'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:43.406031 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-561fa964-e5cf-41ff-a28d-d4ebc5fa0239 admin admin] The token cache is being invalidate because project 3c88234720e043abbca3a4bcb2a7b626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:24:43.406426 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-561fa964-e5cf-41ff-a28d-d4ebc5fa0239 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:43.407365 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-561fa964-e5cf-41ff-a28d-d4ebc5fa0239 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:43.409133 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 870/1753] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:24:42 2022] DELETE /identity/v3/projects/3c88234720e043abbca3a4bcb2a7b626 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:43.410421 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a89440-7291-445f-82b7-a230ec88d3af None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:43.410713 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a89440-7291-445f-82b7-a230ec88d3af None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:43.411012 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a89440-7291-445f-82b7-a230ec88d3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:43.435857 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-f2a89440-7291-445f-82b7-a230ec88d3af None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:43.437163 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-f2a89440-7291-445f-82b7-a230ec88d3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:43.463044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-fe173f2b-d46f-41ed-85fb-7a7012d4c150 admin admin] The token cache is being invalidate because project 227590ea391840a087e8acf327aff8d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:24:43.463044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-fe173f2b-d46f-41ed-85fb-7a7012d4c150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:43.463810 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-fe173f2b-d46f-41ed-85fb-7a7012d4c150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:43.469923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 884/1754] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:24:42 2022] DELETE /identity/v3/projects/227590ea391840a087e8acf327aff8d5 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:43.472400 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe173f2b-d46f-41ed-85fb-7a7012d4c150 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:43.474259 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-fe173f2b-d46f-41ed-85fb-7a7012d4c150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:43.479369 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:43.523767 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 871/1755] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:43.523767 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a89440-7291-445f-82b7-a230ec88d3af None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:43.535393 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-f2a89440-7291-445f-82b7-a230ec88d3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:43.560233 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a89440-7291-445f-82b7-a230ec88d3af None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:43.579194 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1f9b4-e7ba-40e8-8467-061d7aa53d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:43.584190 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1f9b4-e7ba-40e8-8467-061d7aa53d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:43.584396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1f9b4-e7ba-40e8-8467-061d7aa53d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:43.584677 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1f9b4-e7ba-40e8-8467-061d7aa53d60 admin admin] PATH_INFO: `/v3/projects/36ab60524d324a95959ffea35e54c31d` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:43.588734 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1f9b4-e7ba-40e8-8467-061d7aa53d60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36ab60524d324a95959ffea35e54c31d)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:43.590801 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe173f2b-d46f-41ed-85fb-7a7012d4c150 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:43.594579 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1f9b4-e7ba-40e8-8467-061d7aa53d60 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:43.596471 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc17ce-d328-4c43-97c1-1321f60bd04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:43.597301 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc17ce-d328-4c43-97c1-1321f60bd04b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:43.597822 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc17ce-d328-4c43-97c1-1321f60bd04b admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:43.598854 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc17ce-d328-4c43-97c1-1321f60bd04b admin admin] PATH_INFO: `/v3/users/c60719c17a144357bda35ea4290266e5` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:43.600321 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc17ce-d328-4c43-97c1-1321f60bd04b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c60719c17a144357bda35ea4290266e5)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:43.602847 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc17ce-d328-4c43-97c1-1321f60bd04b admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:43.755107 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-80b1f9b4-e7ba-40e8-8467-061d7aa53d60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36ab60524d324a95959ffea35e54c31d', 'request_id': 'req-80b1f9b4-e7ba-40e8-8467-061d7aa53d60'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:43.762137 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-80b1f9b4-e7ba-40e8-8467-061d7aa53d60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36ab60524d324a95959ffea35e54c31d', 'request_id': 'req-80b1f9b4-e7ba-40e8-8467-061d7aa53d60'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:43.768126 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-80b1f9b4-e7ba-40e8-8467-061d7aa53d60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36ab60524d324a95959ffea35e54c31d', 'request_id': 'req-80b1f9b4-e7ba-40e8-8467-061d7aa53d60'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:43.839269 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:43.847334 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-80b1f9b4-e7ba-40e8-8467-061d7aa53d60 admin admin] The token cache is being invalidate because project 36ab60524d324a95959ffea35e54c31d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:24:43.847661 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-80b1f9b4-e7ba-40e8-8467-061d7aa53d60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:43.853768 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-80b1f9b4-e7ba-40e8-8467-061d7aa53d60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:43.856169 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 872/1756] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:24:43 2022] DELETE /identity/v3/projects/36ab60524d324a95959ffea35e54c31d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:43.861775 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92e310-3f1f-47d7-b397-de926f742e62 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:43.862098 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92e310-3f1f-47d7-b397-de926f742e62 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:43.862898 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92e310-3f1f-47d7-b397-de926f742e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:43.923351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-5edc17ce-d328-4c43-97c1-1321f60bd04b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c60719c17a144357bda35ea4290266e5'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:43.924073 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-5edc17ce-d328-4c43-97c1-1321f60bd04b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c60719c17a144357bda35ea4290266e5'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:43.938971 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-5edc17ce-d328-4c43-97c1-1321f60bd04b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c60719c17a144357bda35ea4290266e5'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:43.942061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-5edc17ce-d328-4c43-97c1-1321f60bd04b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c60719c17a144357bda35ea4290266e5'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:43.987005 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-5edc17ce-d328-4c43-97c1-1321f60bd04b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c60719c17a144357bda35ea4290266e5'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:43.987631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-8e92e310-3f1f-47d7-b397-de926f742e62 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:43.987631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-8e92e310-3f1f-47d7-b397-de926f742e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:44.111147 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 885/1757] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:24:43 2022] DELETE /identity/v3/users/c60719c17a144357bda35ea4290266e5 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:44.119717 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc17ce-d328-4c43-97c1-1321f60bd04b admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:44.122999 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-5edc17ce-d328-4c43-97c1-1321f60bd04b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:44.177870 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 873/1758] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:44.182237 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931f65e-6b27-4381-9c40-36530c439481 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:44.183331 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931f65e-6b27-4381-9c40-36530c439481 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:44.205622 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931f65e-6b27-4381-9c40-36530c439481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:44.284595 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-b931f65e-6b27-4381-9c40-36530c439481 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:44.291778 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-b931f65e-6b27-4381-9c40-36530c439481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:44.320602 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc17ce-d328-4c43-97c1-1321f60bd04b admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:44.330232 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf92a6c-845e-4b02-9e69-92e79c9cfe7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:44.337045 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf92a6c-845e-4b02-9e69-92e79c9cfe7f service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:44.338308 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf92a6c-845e-4b02-9e69-92e79c9cfe7f service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:44.339881 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf92a6c-845e-4b02-9e69-92e79c9cfe7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:44.343850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-dbf92a6c-845e-4b02-9e69-92e79c9cfe7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:44.440329 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 874/1759] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:44.443244 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee117553-1cae-4906-be9a-fd7675b7a691 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:44.445280 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee117553-1cae-4906-be9a-fd7675b7a691 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:44.445671 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee117553-1cae-4906-be9a-fd7675b7a691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:44.505821 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf92a6c-845e-4b02-9e69-92e79c9cfe7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:44.507464 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf92a6c-845e-4b02-9e69-92e79c9cfe7f service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:44.511280 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-ee117553-1cae-4906-be9a-fd7675b7a691 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:44.515056 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-ee117553-1cae-4906-be9a-fd7675b7a691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:44.528297 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 886/1760] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:44.530021 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740449f-1a5e-49a7-bc3d-ae7bd8cf5ab6 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:44.530323 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740449f-1a5e-49a7-bc3d-ae7bd8cf5ab6 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:44.537744 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740449f-1a5e-49a7-bc3d-ae7bd8cf5ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:44.537893 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 875/1761] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:44.537893 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e12fe-b4b0-4917-977b-33d68b7b39aa None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:44.537893 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e12fe-b4b0-4917-977b-33d68b7b39aa None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:44.537893 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e12fe-b4b0-4917-977b-33d68b7b39aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:44.567303 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-663e12fe-b4b0-4917-977b-33d68b7b39aa None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:44.568863 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-663e12fe-b4b0-4917-977b-33d68b7b39aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:44.606877 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 876/1762] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:44.607860 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e12fe-b4b0-4917-977b-33d68b7b39aa None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:44.632228 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e12fe-b4b0-4917-977b-33d68b7b39aa None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:44.645804 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc867f02-0388-45c5-b524-70257449faa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:44.646432 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc867f02-0388-45c5-b524-70257449faa6 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:44.646962 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc867f02-0388-45c5-b524-70257449faa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:44.647068 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc867f02-0388-45c5-b524-70257449faa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:44.647839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc867f02-0388-45c5-b524-70257449faa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:24:44.648153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc867f02-0388-45c5-b524-70257449faa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:44.653355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc867f02-0388-45c5-b524-70257449faa6 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:44.672156 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-c740449f-1a5e-49a7-bc3d-ae7bd8cf5ab6 None None] MFA Rules not processed for user `826b9a7c343b4dbc9aeb3dbc0b75fc92`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:44.675657 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-c740449f-1a5e-49a7-bc3d-ae7bd8cf5ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:44.694314 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 877/1763] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:24:44.696199 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc867f02-0388-45c5-b524-70257449faa6 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:44.715684 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc867f02-0388-45c5-b524-70257449faa6 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:44.731701 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02740ea5-3957-4d80-8c93-6e1200e66dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:44.732487 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02740ea5-3957-4d80-8c93-6e1200e66dda admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:44.732877 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02740ea5-3957-4d80-8c93-6e1200e66dda admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:44.733280 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02740ea5-3957-4d80-8c93-6e1200e66dda admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:44.734207 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02740ea5-3957-4d80-8c93-6e1200e66dda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:24:44.734723 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02740ea5-3957-4d80-8c93-6e1200e66dda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:44.736559 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02740ea5-3957-4d80-8c93-6e1200e66dda admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:44.795785 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 878/1764] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:24:44.799245 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02740ea5-3957-4d80-8c93-6e1200e66dda admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:44.848666 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02740ea5-3957-4d80-8c93-6e1200e66dda admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:44.849687 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:44.863896 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 887/1765] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 23 04:24:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:44.867992 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0f100-da27-4743-928e-404027780707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:44.868442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740449f-1a5e-49a7-bc3d-ae7bd8cf5ab6 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:44.868635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0f100-da27-4743-928e-404027780707 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:44.869068 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0f100-da27-4743-928e-404027780707 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:44.869381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0f100-da27-4743-928e-404027780707 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:44.870032 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0f100-da27-4743-928e-404027780707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:44.871986 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0f100-da27-4743-928e-404027780707 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:44.899781 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740449f-1a5e-49a7-bc3d-ae7bd8cf5ab6 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:44.908471 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172e726-403a-4ed6-a98a-b4cb040903b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:44.909264 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172e726-403a-4ed6-a98a-b4cb040903b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:44.909618 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172e726-403a-4ed6-a98a-b4cb040903b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:44.910034 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172e726-403a-4ed6-a98a-b4cb040903b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:44.910645 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172e726-403a-4ed6-a98a-b4cb040903b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:44.912658 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172e726-403a-4ed6-a98a-b4cb040903b2 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:45.018144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 879/1766] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:24:44 2022] POST /identity/v3/projects => generated 363 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:45.030403 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0f100-da27-4743-928e-404027780707 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:45.078273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 888/1767] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:24:44 2022] POST /identity/v3/projects => generated 407 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:45.083228 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172e726-403a-4ed6-a98a-b4cb040903b2 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:45.143088 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0f100-da27-4743-928e-404027780707 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:45.216722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172e726-403a-4ed6-a98a-b4cb040903b2 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:45.228171 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b9560-0571-4bb9-bd22-a30905d95896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:45.228814 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b9560-0571-4bb9-bd22-a30905d95896 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:45.229289 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b9560-0571-4bb9-bd22-a30905d95896 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:45.229467 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b9560-0571-4bb9-bd22-a30905d95896 admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:45.230548 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b9560-0571-4bb9-bd22-a30905d95896 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:45.236403 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b9560-0571-4bb9-bd22-a30905d95896 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:45.277956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e17da-0053-4bd7-a5ca-4cce64325b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:45.280138 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e17da-0053-4bd7-a5ca-4cce64325b79 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:45.280480 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e17da-0053-4bd7-a5ca-4cce64325b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:45.280948 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e17da-0053-4bd7-a5ca-4cce64325b79 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:45.282290 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e17da-0053-4bd7-a5ca-4cce64325b79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:45.287564 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e17da-0053-4bd7-a5ca-4cce64325b79 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:45.439232 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 889/1768] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:24:45 2022] POST /identity/v3/users => generated 304 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:45.444638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b9560-0571-4bb9-bd22-a30905d95896 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:45.444750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 880/1769] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:24:45 2022] POST /identity/v3/users => generated 282 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:45.444830 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-b31b9560-0571-4bb9-bd22-a30905d95896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:45.449548 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e17da-0053-4bd7-a5ca-4cce64325b79 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:45.464195 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e17da-0053-4bd7-a5ca-4cce64325b79 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:45.470526 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bb3f8-afef-459e-9cf1-f08744b22fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:45.472572 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bb3f8-afef-459e-9cf1-f08744b22fae admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:45.472938 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bb3f8-afef-459e-9cf1-f08744b22fae admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:45.473339 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bb3f8-afef-459e-9cf1-f08744b22fae admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:45.474149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bb3f8-afef-459e-9cf1-f08744b22fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:45.475974 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bb3f8-afef-459e-9cf1-f08744b22fae admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:45.490895 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 881/1770] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:45.491726 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bb3f8-afef-459e-9cf1-f08744b22fae admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:45.506821 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bb3f8-afef-459e-9cf1-f08744b22fae admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:45.514786 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcaeac-dde4-46df-9c27-7a07ce5c8272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:45.517933 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcaeac-dde4-46df-9c27-7a07ce5c8272 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:45.518422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcaeac-dde4-46df-9c27-7a07ce5c8272 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:45.518887 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcaeac-dde4-46df-9c27-7a07ce5c8272 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:45.519644 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dcaeac-dde4-46df-9c27-7a07ce5c8272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:45.521715 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dcaeac-dde4-46df-9c27-7a07ce5c8272 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:45.536269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 882/1771] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:45.537242 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcaeac-dde4-46df-9c27-7a07ce5c8272 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:45.560709 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcaeac-dde4-46df-9c27-7a07ce5c8272 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:45.574152 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a51438-aa69-44fe-82ea-05c459005741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:45.575248 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a51438-aa69-44fe-82ea-05c459005741 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:45.575659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a51438-aa69-44fe-82ea-05c459005741 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:45.576707 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a51438-aa69-44fe-82ea-05c459005741 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:45.577624 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a51438-aa69-44fe-82ea-05c459005741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:45.579797 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a51438-aa69-44fe-82ea-05c459005741 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:45.591593 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 883/1772] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:45.592823 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a51438-aa69-44fe-82ea-05c459005741 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:45.595073 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-e0a51438-aa69-44fe-82ea-05c459005741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:45.609686 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b9560-0571-4bb9-bd22-a30905d95896 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:45.618624 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeffec6-d374-45a6-b8f5-7c65abc39f63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63190c62bc92403880ffaedc4737485a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:45.620128 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeffec6-d374-45a6-b8f5-7c65abc39f63 service swift] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:45.620620 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeffec6-d374-45a6-b8f5-7c65abc39f63 service swift] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:45.621154 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeffec6-d374-45a6-b8f5-7c65abc39f63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:45.625547 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a51438-aa69-44fe-82ea-05c459005741 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:45.631806 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a041a-0b8b-4f65-b0aa-3c7a9254e8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:45.632613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a041a-0b8b-4f65-b0aa-3c7a9254e8f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:45.633032 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a041a-0b8b-4f65-b0aa-3c7a9254e8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:45.633416 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a041a-0b8b-4f65-b0aa-3c7a9254e8f1 admin admin] PATH_INFO: `/v3/projects/dc5c78b722ee4aedb7f4ef3422e314ae` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:45.634686 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a041a-0b8b-4f65-b0aa-3c7a9254e8f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc5c78b722ee4aedb7f4ef3422e314ae)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:45.636777 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a041a-0b8b-4f65-b0aa-3c7a9254e8f1 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:45.720067 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeffec6-d374-45a6-b8f5-7c65abc39f63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:45.722919 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeffec6-d374-45a6-b8f5-7c65abc39f63 service swift] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:45.733508 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 890/1773] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 23 04:24:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 04:24:45.734490 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeffec6-d374-45a6-b8f5-7c65abc39f63 service swift] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:45.746258 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeffec6-d374-45a6-b8f5-7c65abc39f63 service swift] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:45.753408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ee417-9e5b-403d-a98b-4f064a5f87a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:45.754288 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ee417-9e5b-403d-a98b-4f064a5f87a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:45.754799 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ee417-9e5b-403d-a98b-4f064a5f87a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:45.755112 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ee417-9e5b-403d-a98b-4f064a5f87a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:45.768577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ee417-9e5b-403d-a98b-4f064a5f87a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:45.771376 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ee417-9e5b-403d-a98b-4f064a5f87a2 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:45.787304 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 891/1774] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:45.787304 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ee417-9e5b-403d-a98b-4f064a5f87a2 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:45.819036 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ee417-9e5b-403d-a98b-4f064a5f87a2 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:45.831836 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-ef1a041a-0b8b-4f65-b0aa-3c7a9254e8f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc5c78b722ee4aedb7f4ef3422e314ae', 'request_id': 'req-ef1a041a-0b8b-4f65-b0aa-3c7a9254e8f1'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:45.863109 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-ef1a041a-0b8b-4f65-b0aa-3c7a9254e8f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc5c78b722ee4aedb7f4ef3422e314ae', 'request_id': 'req-ef1a041a-0b8b-4f65-b0aa-3c7a9254e8f1'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:45.880426 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-ef1a041a-0b8b-4f65-b0aa-3c7a9254e8f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc5c78b722ee4aedb7f4ef3422e314ae', 'request_id': 'req-ef1a041a-0b8b-4f65-b0aa-3c7a9254e8f1'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:46.020911 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-ef1a041a-0b8b-4f65-b0aa-3c7a9254e8f1 admin admin] The token cache is being invalidate because project dc5c78b722ee4aedb7f4ef3422e314ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:24:46.021421 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-ef1a041a-0b8b-4f65-b0aa-3c7a9254e8f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:46.024433 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-ef1a041a-0b8b-4f65-b0aa-3c7a9254e8f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:46.025491 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:46.039131 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 884/1775] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:24:45 2022] DELETE /identity/v3/projects/dc5c78b722ee4aedb7f4ef3422e314ae => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:46.048994 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a041a-0b8b-4f65-b0aa-3c7a9254e8f1 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:46.055553 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-ef1a041a-0b8b-4f65-b0aa-3c7a9254e8f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:46.063383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce68ad-c9c2-4884-a923-3bfbacb699dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:46.065813 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce68ad-c9c2-4884-a923-3bfbacb699dd admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:46.066343 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce68ad-c9c2-4884-a923-3bfbacb699dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:46.066927 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce68ad-c9c2-4884-a923-3bfbacb699dd admin admin] PATH_INFO: `/v3/projects/a55065c0d99f4b5eb5fe0418be4a6b81/users/337d944585b84351b80c3d82f7a9722d/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:46.121468 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a041a-0b8b-4f65-b0aa-3c7a9254e8f1 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:46.139159 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6089a-e329-4a00-bc9f-e9e4b7175504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:46.140921 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6089a-e329-4a00-bc9f-e9e4b7175504 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:46.144789 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce68ad-c9c2-4884-a923-3bfbacb699dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a55065c0d99f4b5eb5fe0418be4a6b81, user_id=337d944585b84351b80c3d82f7a9722d, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:46.145169 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6089a-e329-4a00-bc9f-e9e4b7175504 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:46.145585 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6089a-e329-4a00-bc9f-e9e4b7175504 admin admin] PATH_INFO: `/v3/projects/15e170b0e99248faa9bd3c06b43a68e7/users/5777266f150945378945ff2f04ebcc63/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:46.149783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce68ad-c9c2-4884-a923-3bfbacb699dd admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:46.197859 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:46.200215 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6089a-e329-4a00-bc9f-e9e4b7175504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15e170b0e99248faa9bd3c06b43a68e7, user_id=5777266f150945378945ff2f04ebcc63, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:46.204383 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6089a-e329-4a00-bc9f-e9e4b7175504 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:46.279421 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 892/1776] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:45 2022] PUT /identity/v3/projects/a55065c0d99f4b5eb5fe0418be4a6b81/users/337d944585b84351b80c3d82f7a9722d/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:46.281001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97108c-4fe5-46e5-8d74-3ac9efa56716 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:46.281320 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97108c-4fe5-46e5-8d74-3ac9efa56716 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:46.281600 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97108c-4fe5-46e5-8d74-3ac9efa56716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:46.310403 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 885/1777] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:46 2022] PUT /identity/v3/projects/15e170b0e99248faa9bd3c06b43a68e7/users/5777266f150945378945ff2f04ebcc63/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:46.323199 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645897f-4f02-4c58-968d-7a0a763c649d None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:46.323489 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645897f-4f02-4c58-968d-7a0a763c649d None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:46.323768 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645897f-4f02-4c58-968d-7a0a763c649d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:46.359622 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-5e97108c-4fe5-46e5-8d74-3ac9efa56716 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:46.360972 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-5e97108c-4fe5-46e5-8d74-3ac9efa56716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:46.392813 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-c645897f-4f02-4c58-968d-7a0a763c649d None None] MFA Rules not processed for user `8304ca06f82742ef8ce74396884e90b4`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:46.395467 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c645897f-4f02-4c58-968d-7a0a763c649d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:46.617708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 893/1778] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:46.617708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fa222-db3d-4f1d-b980-f6c9af790f92 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:46.617708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fa222-db3d-4f1d-b980-f6c9af790f92 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:46.618432 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fa222-db3d-4f1d-b980-f6c9af790f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:46.670006 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 886/1779] 10.222.0.26 () {58 vars in 1015 bytes} [Tue Aug 23 04:24:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:46.671503 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ac2cd-5059-4048-8b10-a69949576a24 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:46.679498 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ac2cd-5059-4048-8b10-a69949576a24 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:46.681571 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ac2cd-5059-4048-8b10-a69949576a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:46.769283 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-ce6ac2cd-5059-4048-8b10-a69949576a24 None None] MFA Rules not processed for user `5777266f150945378945ff2f04ebcc63`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:46.770613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-ce6ac2cd-5059-4048-8b10-a69949576a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:46.792875 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-3b8fa222-db3d-4f1d-b980-f6c9af790f92 None None] MFA Rules not processed for user `337d944585b84351b80c3d82f7a9722d`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:46.794640 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-3b8fa222-db3d-4f1d-b980-f6c9af790f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:47.020236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 894/1780] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:47.021577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fa222-db3d-4f1d-b980-f6c9af790f92 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:47.028397 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-3b8fa222-db3d-4f1d-b980-f6c9af790f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:47.063910 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fa222-db3d-4f1d-b980-f6c9af790f92 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:47.068855 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 887/1781] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:46 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:47.068855 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acbfe0-8d98-4cfb-8550-43d2be0c9593 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:47.068855 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acbfe0-8d98-4cfb-8550-43d2be0c9593 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:47.068855 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acbfe0-8d98-4cfb-8550-43d2be0c9593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:47.076294 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041d1fa-41cc-45b7-a289-66045309b219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:47.077129 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041d1fa-41cc-45b7-a289-66045309b219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:47.077477 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041d1fa-41cc-45b7-a289-66045309b219 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:47.077894 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041d1fa-41cc-45b7-a289-66045309b219 admin admin] PATH_INFO: `/v3/projects/db9057cc06734c62a988e7dd598d1c13` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:47.090235 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5041d1fa-41cc-45b7-a289-66045309b219 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db9057cc06734c62a988e7dd598d1c13)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:47.092530 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5041d1fa-41cc-45b7-a289-66045309b219 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:47.114464 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-53acbfe0-8d98-4cfb-8550-43d2be0c9593 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:47.116547 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-53acbfe0-8d98-4cfb-8550-43d2be0c9593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:47.126776 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 888/1782] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:47.128251 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acbfe0-8d98-4cfb-8550-43d2be0c9593 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:47.129700 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-53acbfe0-8d98-4cfb-8550-43d2be0c9593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:47.149749 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acbfe0-8d98-4cfb-8550-43d2be0c9593 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:47.156659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb2a92-8c8d-4035-b76c-484bfa53b214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:47.157984 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb2a92-8c8d-4035-b76c-484bfa53b214 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:47.158342 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb2a92-8c8d-4035-b76c-484bfa53b214 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:47.158716 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb2a92-8c8d-4035-b76c-484bfa53b214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:47.172098 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb2a92-8c8d-4035-b76c-484bfa53b214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:47.172098 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb2a92-8c8d-4035-b76c-484bfa53b214 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:47.186196 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 889/1783] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:47.187236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb2a92-8c8d-4035-b76c-484bfa53b214 service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:47.208299 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb2a92-8c8d-4035-b76c-484bfa53b214 service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:47.242873 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e060d6-b233-4cda-ac86-0bbc8bb43bda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:47.245738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e060d6-b233-4cda-ac86-0bbc8bb43bda service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:47.247180 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e060d6-b233-4cda-ac86-0bbc8bb43bda service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:47.247556 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e060d6-b233-4cda-ac86-0bbc8bb43bda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:47.253402 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-5041d1fa-41cc-45b7-a289-66045309b219 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db9057cc06734c62a988e7dd598d1c13', 'request_id': 'req-5041d1fa-41cc-45b7-a289-66045309b219'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:47.272448 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-5041d1fa-41cc-45b7-a289-66045309b219 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db9057cc06734c62a988e7dd598d1c13', 'request_id': 'req-5041d1fa-41cc-45b7-a289-66045309b219'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:47.273431 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e060d6-b233-4cda-ac86-0bbc8bb43bda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:47.290596 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e060d6-b233-4cda-ac86-0bbc8bb43bda service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:47.308754 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-5041d1fa-41cc-45b7-a289-66045309b219 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db9057cc06734c62a988e7dd598d1c13', 'request_id': 'req-5041d1fa-41cc-45b7-a289-66045309b219'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:47.318449 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 890/1784] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:47.320142 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e060d6-b233-4cda-ac86-0bbc8bb43bda service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:47.322402 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-a8e060d6-b233-4cda-ac86-0bbc8bb43bda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:47.455573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e060d6-b233-4cda-ac86-0bbc8bb43bda service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:47.467157 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2244f-862d-4a8f-8220-f56fa894db89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:47.468114 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2244f-862d-4a8f-8220-f56fa894db89 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:47.468667 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2244f-862d-4a8f-8220-f56fa894db89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:47.469188 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2244f-862d-4a8f-8220-f56fa894db89 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:47.470146 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2244f-862d-4a8f-8220-f56fa894db89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:47.473622 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2244f-862d-4a8f-8220-f56fa894db89 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:47.598752 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-5041d1fa-41cc-45b7-a289-66045309b219 admin admin] The token cache is being invalidate because project db9057cc06734c62a988e7dd598d1c13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:24:47.599133 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-5041d1fa-41cc-45b7-a289-66045309b219 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:47.600488 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-5041d1fa-41cc-45b7-a289-66045309b219 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:47.602525 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 895/1785] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:24:47 2022] DELETE /identity/v3/projects/db9057cc06734c62a988e7dd598d1c13 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:47.603438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041d1fa-41cc-45b7-a289-66045309b219 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:47.604965 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-5041d1fa-41cc-45b7-a289-66045309b219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:47.716737 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041d1fa-41cc-45b7-a289-66045309b219 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:47.721904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562c303-ced9-4da9-bfcc-757085c9733f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:47.722627 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562c303-ced9-4da9-bfcc-757085c9733f service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:47.723141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562c303-ced9-4da9-bfcc-757085c9733f service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:47.723636 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562c303-ced9-4da9-bfcc-757085c9733f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:47.725765 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-6562c303-ced9-4da9-bfcc-757085c9733f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:47.741826 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562c303-ced9-4da9-bfcc-757085c9733f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:47.743654 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562c303-ced9-4da9-bfcc-757085c9733f service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:47.754121 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 896/1786] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:47.755367 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562c303-ced9-4da9-bfcc-757085c9733f service neutron] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:47.757313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-6562c303-ced9-4da9-bfcc-757085c9733f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:47.784112 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562c303-ced9-4da9-bfcc-757085c9733f service neutron] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:47.784112 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02839b3-8cf4-4227-b906-a2c1ccc2b934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:47.784112 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02839b3-8cf4-4227-b906-a2c1ccc2b934 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:47.784112 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02839b3-8cf4-4227-b906-a2c1ccc2b934 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:47.784537 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02839b3-8cf4-4227-b906-a2c1ccc2b934 admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:47.784537 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02839b3-8cf4-4227-b906-a2c1ccc2b934 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:47.786571 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02839b3-8cf4-4227-b906-a2c1ccc2b934 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:47.920981 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 891/1787] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:24:47 2022] POST /identity/v3/projects => generated 363 bytes in 602 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:47.924973 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2244f-862d-4a8f-8220-f56fa894db89 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:47.927002 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-7ff2244f-862d-4a8f-8220-f56fa894db89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:47.982071 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 897/1788] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:24:47 2022] POST /identity/v3/projects => generated 407 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:47.983180 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02839b3-8cf4-4227-b906-a2c1ccc2b934 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:48.010423 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-b02839b3-8cf4-4227-b906-a2c1ccc2b934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:48.088154 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:48.128420 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:48.177637 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2244f-862d-4a8f-8220-f56fa894db89 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:48.247132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02839b3-8cf4-4227-b906-a2c1ccc2b934 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:48.256762 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b070ac5-7ff7-4e7c-bf5b-240d882cb204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:48.257629 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b070ac5-7ff7-4e7c-bf5b-240d882cb204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:48.258015 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b070ac5-7ff7-4e7c-bf5b-240d882cb204 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:48.258773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b070ac5-7ff7-4e7c-bf5b-240d882cb204 admin admin] PATH_INFO: `/v3/users/519ba394af9e43e18438b8bdf609ee66` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:48.260115 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b070ac5-7ff7-4e7c-bf5b-240d882cb204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=519ba394af9e43e18438b8bdf609ee66)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:48.263135 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b070ac5-7ff7-4e7c-bf5b-240d882cb204 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:48.389771 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc882005-d88b-4732-8d73-c5693b1380fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:48.390604 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc882005-d88b-4732-8d73-c5693b1380fe admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:48.390924 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc882005-d88b-4732-8d73-c5693b1380fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:48.391276 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc882005-d88b-4732-8d73-c5693b1380fe admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:48.392151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc882005-d88b-4732-8d73-c5693b1380fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:24:48.392495 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc882005-d88b-4732-8d73-c5693b1380fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:48.394252 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc882005-d88b-4732-8d73-c5693b1380fe admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:48.422339 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 892/1789] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 500 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:24:48.423273 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc882005-d88b-4732-8d73-c5693b1380fe admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:48.425602 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-bc882005-d88b-4732-8d73-c5693b1380fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:48.462053 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc882005-d88b-4732-8d73-c5693b1380fe admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:48.467023 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af41c51-ae65-4f75-bce7-856dedce2955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:48.467768 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af41c51-ae65-4f75-bce7-856dedce2955 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:48.468055 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af41c51-ae65-4f75-bce7-856dedce2955 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:48.468332 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af41c51-ae65-4f75-bce7-856dedce2955 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:48.468972 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af41c51-ae65-4f75-bce7-856dedce2955 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:48.470985 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af41c51-ae65-4f75-bce7-856dedce2955 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:48.513130 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-9b070ac5-7ff7-4e7c-bf5b-240d882cb204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '519ba394af9e43e18438b8bdf609ee66'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:48.514838 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-9b070ac5-7ff7-4e7c-bf5b-240d882cb204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '519ba394af9e43e18438b8bdf609ee66'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:48.527172 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-9b070ac5-7ff7-4e7c-bf5b-240d882cb204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '519ba394af9e43e18438b8bdf609ee66'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:48.528475 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-9b070ac5-7ff7-4e7c-bf5b-240d882cb204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '519ba394af9e43e18438b8bdf609ee66'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:48.578513 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-9b070ac5-7ff7-4e7c-bf5b-240d882cb204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '519ba394af9e43e18438b8bdf609ee66'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:48.623141 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 893/1790] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:24:48 2022] POST /identity/v3/users => generated 288 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:48.623141 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af41c51-ae65-4f75-bce7-856dedce2955 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:48.624678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-7af41c51-ae65-4f75-bce7-856dedce2955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:48.653213 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af41c51-ae65-4f75-bce7-856dedce2955 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:48.664790 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d485d5d-193e-4c50-a64f-2bd90432fd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:48.665753 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d485d5d-193e-4c50-a64f-2bd90432fd47 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:48.665883 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d485d5d-193e-4c50-a64f-2bd90432fd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:48.666253 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d485d5d-193e-4c50-a64f-2bd90432fd47 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:48.666732 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d485d5d-193e-4c50-a64f-2bd90432fd47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:48.668673 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d485d5d-193e-4c50-a64f-2bd90432fd47 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:48.690218 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 898/1791] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:24:47 2022] DELETE /identity/v3/users/519ba394af9e43e18438b8bdf609ee66 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:48.693902 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b070ac5-7ff7-4e7c-bf5b-240d882cb204 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:48.701992 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-9b070ac5-7ff7-4e7c-bf5b-240d882cb204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:48.778595 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 894/1792] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:24:48 2022] POST /identity/v3/users => generated 310 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:48.778595 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d485d5d-193e-4c50-a64f-2bd90432fd47 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:48.779819 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-7d485d5d-193e-4c50-a64f-2bd90432fd47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:48.803395 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d485d5d-193e-4c50-a64f-2bd90432fd47 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:48.896844 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b070ac5-7ff7-4e7c-bf5b-240d882cb204 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:48.915514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b793b-01de-48bf-95b0-20c9206acf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:48.917128 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b793b-01de-48bf-95b0-20c9206acf5c admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:48.927084 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b793b-01de-48bf-95b0-20c9206acf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:48.927084 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b793b-01de-48bf-95b0-20c9206acf5c admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:48.927084 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b793b-01de-48bf-95b0-20c9206acf5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:48.927084 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b793b-01de-48bf-95b0-20c9206acf5c admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:48.934490 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b930e2-f7d1-415b-9b33-aaa4b48c4196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:48.935818 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b930e2-f7d1-415b-9b33-aaa4b48c4196 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:48.936712 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b930e2-f7d1-415b-9b33-aaa4b48c4196 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:48.938107 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b930e2-f7d1-415b-9b33-aaa4b48c4196 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:48.938863 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b930e2-f7d1-415b-9b33-aaa4b48c4196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:48.961888 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b930e2-f7d1-415b-9b33-aaa4b48c4196 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:48.996042 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 895/1793] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:48.996042 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b930e2-f7d1-415b-9b33-aaa4b48c4196 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:49.023045 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b930e2-f7d1-415b-9b33-aaa4b48c4196 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:49.028423 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998daf4-9b0c-4bfb-aeba-795fe11b58b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:49.029312 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998daf4-9b0c-4bfb-aeba-795fe11b58b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:49.029669 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998daf4-9b0c-4bfb-aeba-795fe11b58b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:49.030015 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998daf4-9b0c-4bfb-aeba-795fe11b58b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:49.044471 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998daf4-9b0c-4bfb-aeba-795fe11b58b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:49.048350 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998daf4-9b0c-4bfb-aeba-795fe11b58b8 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:49.064965 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 896/1794] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:49.069837 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998daf4-9b0c-4bfb-aeba-795fe11b58b8 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:49.083136 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998daf4-9b0c-4bfb-aeba-795fe11b58b8 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:49.083384 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 899/1795] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:24:48 2022] POST /identity/v3/projects => generated 357 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:49.084513 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b793b-01de-48bf-95b0-20c9206acf5c admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:49.263368 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aedc4b-4825-497f-aff4-166d32ec37c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:49.263871 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aedc4b-4825-497f-aff4-166d32ec37c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:49.264309 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aedc4b-4825-497f-aff4-166d32ec37c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:49.266484 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aedc4b-4825-497f-aff4-166d32ec37c1 admin admin] PATH_INFO: `/v3/projects/58a9815a81704327a6672e146b2687e2/users/6369fc2d4a5a4106aef6c85ae6d7ca0d/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:49.277690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b793b-01de-48bf-95b0-20c9206acf5c admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:49.281572 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456392e-153f-43ad-b811-84a4d20cc6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:49.282482 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456392e-153f-43ad-b811-84a4d20cc6b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:49.283224 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456392e-153f-43ad-b811-84a4d20cc6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:49.284291 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456392e-153f-43ad-b811-84a4d20cc6b7 admin admin] PATH_INFO: `/v3/projects/b1a5c110f2d54c0da20703428fba4318/users/dda450b7e0cd41fab8c729d30f5e4500/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:49.291968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aedc4b-4825-497f-aff4-166d32ec37c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58a9815a81704327a6672e146b2687e2, user_id=6369fc2d4a5a4106aef6c85ae6d7ca0d, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:49.296915 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aedc4b-4825-497f-aff4-166d32ec37c1 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:49.308339 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8456392e-153f-43ad-b811-84a4d20cc6b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1a5c110f2d54c0da20703428fba4318, user_id=dda450b7e0cd41fab8c729d30f5e4500, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:49.312146 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8456392e-153f-43ad-b811-84a4d20cc6b7 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:49.363890 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:49.399724 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 897/1796] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:49 2022] PUT /identity/v3/projects/58a9815a81704327a6672e146b2687e2/users/6369fc2d4a5a4106aef6c85ae6d7ca0d/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:49.405859 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aedc4b-4825-497f-aff4-166d32ec37c1 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:49.415618 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 900/1797] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:49 2022] PUT /identity/v3/projects/b1a5c110f2d54c0da20703428fba4318/users/dda450b7e0cd41fab8c729d30f5e4500/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:49.417773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b38b5e-20b3-4cd7-9d43-e529b358bb0e None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:49.418266 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b38b5e-20b3-4cd7-9d43-e529b358bb0e None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:49.418576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b38b5e-20b3-4cd7-9d43-e529b358bb0e None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:49.439569 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 901/1798] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 23 04:24:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:24:49.439569 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b38b5e-20b3-4cd7-9d43-e529b358bb0e None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:49.490015 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:49.609380 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b38b5e-20b3-4cd7-9d43-e529b358bb0e None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:49.619171 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027be36-0407-4519-af45-d09d97250b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:49.621323 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027be36-0407-4519-af45-d09d97250b6b admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:49.621644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027be36-0407-4519-af45-d09d97250b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:49.621926 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027be36-0407-4519-af45-d09d97250b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:49.624882 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027be36-0407-4519-af45-d09d97250b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:49.632240 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027be36-0407-4519-af45-d09d97250b6b admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:49.649899 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aedc4b-4825-497f-aff4-166d32ec37c1 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:49.658682 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c42388-0777-4680-b3ad-f9563d05964a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:49.659522 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c42388-0777-4680-b3ad-f9563d05964a admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:49.659906 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c42388-0777-4680-b3ad-f9563d05964a admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:49.660283 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c42388-0777-4680-b3ad-f9563d05964a admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:49.661034 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c42388-0777-4680-b3ad-f9563d05964a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:49.661962 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 902/1799] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:49.663592 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c42388-0777-4680-b3ad-f9563d05964a admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:49.665207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027be36-0407-4519-af45-d09d97250b6b admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:49.697167 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027be36-0407-4519-af45-d09d97250b6b admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:49.708427 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27197cc-2a3e-45f5-bff0-b850665f618f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:49.709560 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27197cc-2a3e-45f5-bff0-b850665f618f admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:49.710636 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27197cc-2a3e-45f5-bff0-b850665f618f admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:49.711448 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27197cc-2a3e-45f5-bff0-b850665f618f admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:49.712843 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27197cc-2a3e-45f5-bff0-b850665f618f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:49.715032 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27197cc-2a3e-45f5-bff0-b850665f618f admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:49.747668 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 903/1800] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:49.749120 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97df2a4-8c90-486c-9d20-e351702d65f4 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:49.749417 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97df2a4-8c90-486c-9d20-e351702d65f4 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:49.749680 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97df2a4-8c90-486c-9d20-e351702d65f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:49.794725 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 898/1801] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:24:49 2022] POST /identity/v3/users => generated 279 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:49.802501 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c42388-0777-4680-b3ad-f9563d05964a admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:49.813128 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-a97df2a4-8c90-486c-9d20-e351702d65f4 None None] MFA Rules not processed for user `1e0236a0acac4b87be977878b5186551`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:49.814469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-a97df2a4-8c90-486c-9d20-e351702d65f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:49.818323 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c42388-0777-4680-b3ad-f9563d05964a admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:49.832042 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39d6d0-7fdd-4486-98e2-c2fc4a4c4821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:49.834925 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39d6d0-7fdd-4486-98e2-c2fc4a4c4821 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:49.837355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39d6d0-7fdd-4486-98e2-c2fc4a4c4821 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:49.837731 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39d6d0-7fdd-4486-98e2-c2fc4a4c4821 admin admin] PATH_INFO: `/v3/projects/58a9815a81704327a6672e146b2687e2/users/6369fc2d4a5a4106aef6c85ae6d7ca0d/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:49.841725 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39d6d0-7fdd-4486-98e2-c2fc4a4c4821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58a9815a81704327a6672e146b2687e2, user_id=6369fc2d4a5a4106aef6c85ae6d7ca0d, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:49.848518 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39d6d0-7fdd-4486-98e2-c2fc4a4c4821 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:49.882104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 899/1802] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:49 2022] PUT /identity/v3/projects/58a9815a81704327a6672e146b2687e2/users/6369fc2d4a5a4106aef6c85ae6d7ca0d/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:49.883272 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39d6d0-7fdd-4486-98e2-c2fc4a4c4821 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:49.998067 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 904/1803] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 23 04:24:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:50.001433 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97df2a4-8c90-486c-9d20-e351702d65f4 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:50.030656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97df2a4-8c90-486c-9d20-e351702d65f4 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:50.061619 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39d6d0-7fdd-4486-98e2-c2fc4a4c4821 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:50.074413 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfea75a-123c-4c58-8fa2-f63a2e3a8b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:50.078872 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfea75a-123c-4c58-8fa2-f63a2e3a8b90 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:50.080501 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfea75a-123c-4c58-8fa2-f63a2e3a8b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:50.081685 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfea75a-123c-4c58-8fa2-f63a2e3a8b90 admin admin] PATH_INFO: `/v3/projects/b1a5c110f2d54c0da20703428fba4318/users/dda450b7e0cd41fab8c729d30f5e4500/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:50.086667 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfea75a-123c-4c58-8fa2-f63a2e3a8b90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1a5c110f2d54c0da20703428fba4318, user_id=dda450b7e0cd41fab8c729d30f5e4500, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:50.097888 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfea75a-123c-4c58-8fa2-f63a2e3a8b90 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:50.137680 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 900/1804] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:49 2022] PUT /identity/v3/projects/b1a5c110f2d54c0da20703428fba4318/users/dda450b7e0cd41fab8c729d30f5e4500/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:50.146304 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32abb0-bcbb-4919-a6d1-eea8e1f0e42f None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:50.146304 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32abb0-bcbb-4919-a6d1-eea8e1f0e42f None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:50.146304 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32abb0-bcbb-4919-a6d1-eea8e1f0e42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:50.187823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb214b-7f47-4e13-b564-98f4b2270e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:50.188722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb214b-7f47-4e13-b564-98f4b2270e25 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:50.189018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb214b-7f47-4e13-b564-98f4b2270e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:50.189329 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb214b-7f47-4e13-b564-98f4b2270e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:50.189936 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-4b32abb0-bcbb-4919-a6d1-eea8e1f0e42f None None] MFA Rules not processed for user `6369fc2d4a5a4106aef6c85ae6d7ca0d`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:50.190241 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb214b-7f47-4e13-b564-98f4b2270e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:50.191503 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-4b32abb0-bcbb-4919-a6d1-eea8e1f0e42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:50.192204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb214b-7f47-4e13-b564-98f4b2270e25 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:50.216275 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 905/1805] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:50.218356 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568da64-032d-485d-8a24-27af6c83a7f1 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:50.218656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568da64-032d-485d-8a24-27af6c83a7f1 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:50.218941 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568da64-032d-485d-8a24-27af6c83a7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:50.285207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-f568da64-032d-485d-8a24-27af6c83a7f1 None None] MFA Rules not processed for user `dda450b7e0cd41fab8c729d30f5e4500`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:50.287257 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-f568da64-032d-485d-8a24-27af6c83a7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:50.425439 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 901/1806] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:50 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:50.426586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32abb0-bcbb-4919-a6d1-eea8e1f0e42f None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:50.492187 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 906/1807] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:50 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:50.493801 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fda929-af75-4f49-b566-0ffc9b63b021 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:50.494118 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fda929-af75-4f49-b566-0ffc9b63b021 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:50.494397 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fda929-af75-4f49-b566-0ffc9b63b021 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:50.498997 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 907/1808] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 23 04:24:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:24:50.499743 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fda929-af75-4f49-b566-0ffc9b63b021 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:50.503749 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-32fda929-af75-4f49-b566-0ffc9b63b021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:50.573295 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:50.609525 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32abb0-bcbb-4919-a6d1-eea8e1f0e42f None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:50.622017 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25102516-8912-47aa-ac50-515c1a3f017f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:50.623356 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25102516-8912-47aa-ac50-515c1a3f017f admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:50.624058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25102516-8912-47aa-ac50-515c1a3f017f admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:50.626633 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25102516-8912-47aa-ac50-515c1a3f017f admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:50.628103 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25102516-8912-47aa-ac50-515c1a3f017f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:50.631394 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25102516-8912-47aa-ac50-515c1a3f017f admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:50.661259 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 902/1809] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:50.663727 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25102516-8912-47aa-ac50-515c1a3f017f admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:50.666430 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-25102516-8912-47aa-ac50-515c1a3f017f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:50.715576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fda929-af75-4f49-b566-0ffc9b63b021 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:50.725814 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612551c-acc6-4156-8557-6b441a291be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:50.726649 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612551c-acc6-4156-8557-6b441a291be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:50.727001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612551c-acc6-4156-8557-6b441a291be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:50.727325 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612551c-acc6-4156-8557-6b441a291be4 admin admin] PATH_INFO: `/v3/projects/edb89d85913b4b6fa7b98e5234b579e4` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:50.730649 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612551c-acc6-4156-8557-6b441a291be4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edb89d85913b4b6fa7b98e5234b579e4)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:50.732853 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612551c-acc6-4156-8557-6b441a291be4 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:50.766935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25102516-8912-47aa-ac50-515c1a3f017f admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:50.771471 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac528789-efc9-4677-8856-15d1a61855f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:50.772620 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac528789-efc9-4677-8856-15d1a61855f6 service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:50.772620 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac528789-efc9-4677-8856-15d1a61855f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:50.772899 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac528789-efc9-4677-8856-15d1a61855f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:50.785367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac528789-efc9-4677-8856-15d1a61855f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:50.787305 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac528789-efc9-4677-8856-15d1a61855f6 service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:50.801123 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 903/1810] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:50.802418 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac528789-efc9-4677-8856-15d1a61855f6 service cinder] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:50.803973 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-ac528789-efc9-4677-8856-15d1a61855f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:50.819673 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac528789-efc9-4677-8856-15d1a61855f6 service cinder] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:50.826438 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79371873-a375-4819-9e85-679f52a56981 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:50.828032 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79371873-a375-4819-9e85-679f52a56981 service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:50.828778 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79371873-a375-4819-9e85-679f52a56981 service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:50.829257 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79371873-a375-4819-9e85-679f52a56981 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:50.842514 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79371873-a375-4819-9e85-679f52a56981 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:50.844835 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79371873-a375-4819-9e85-679f52a56981 service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:50.870489 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 904/1811] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:50 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:50.871476 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79371873-a375-4819-9e85-679f52a56981 service cinder] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:50.874881 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-79371873-a375-4819-9e85-679f52a56981 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:51.006779 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c612551c-acc6-4156-8557-6b441a291be4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edb89d85913b4b6fa7b98e5234b579e4', 'request_id': 'req-c612551c-acc6-4156-8557-6b441a291be4'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:51.035021 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c612551c-acc6-4156-8557-6b441a291be4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edb89d85913b4b6fa7b98e5234b579e4', 'request_id': 'req-c612551c-acc6-4156-8557-6b441a291be4'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:51.058489 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c612551c-acc6-4156-8557-6b441a291be4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edb89d85913b4b6fa7b98e5234b579e4', 'request_id': 'req-c612551c-acc6-4156-8557-6b441a291be4'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:51.074554 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:51.093540 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79371873-a375-4819-9e85-679f52a56981 service cinder] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:51.192025 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c612551c-acc6-4156-8557-6b441a291be4 admin admin] The token cache is being invalidate because project edb89d85913b4b6fa7b98e5234b579e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:24:51.199501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c612551c-acc6-4156-8557-6b441a291be4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:51.199501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c612551c-acc6-4156-8557-6b441a291be4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:51.199501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 908/1812] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:24:50 2022] DELETE /identity/v3/projects/edb89d85913b4b6fa7b98e5234b579e4 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:51.199501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381fa0e-536b-41e7-bc51-9b6673a0421d None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:51.199501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381fa0e-536b-41e7-bc51-9b6673a0421d None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:51.199501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381fa0e-536b-41e7-bc51-9b6673a0421d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:51.223591 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370d070-41e4-49f5-b3fc-fca0448f3a12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:51.226633 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370d070-41e4-49f5-b3fc-fca0448f3a12 service nova] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:51.226633 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370d070-41e4-49f5-b3fc-fca0448f3a12 service nova] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:51.226633 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370d070-41e4-49f5-b3fc-fca0448f3a12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:51.227026 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-1370d070-41e4-49f5-b3fc-fca0448f3a12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:51.240811 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370d070-41e4-49f5-b3fc-fca0448f3a12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:51.254461 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370d070-41e4-49f5-b3fc-fca0448f3a12 service nova] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:51.260379 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-6381fa0e-536b-41e7-bc51-9b6673a0421d None None] MFA Rules not processed for user `1e0236a0acac4b87be977878b5186551`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:51.261918 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-6381fa0e-536b-41e7-bc51-9b6673a0421d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:51.279586 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 909/1813] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 23 04:24:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:51.280836 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381fa0e-536b-41e7-bc51-9b6673a0421d None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:51.282436 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-6381fa0e-536b-41e7-bc51-9b6673a0421d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:51.285048 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 905/1814] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:51.285935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370d070-41e4-49f5-b3fc-fca0448f3a12 service nova] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:51.290597 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-1370d070-41e4-49f5-b3fc-fca0448f3a12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:51.440716 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381fa0e-536b-41e7-bc51-9b6673a0421d None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:51.450995 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815f528-2f99-4b93-add9-0b39df8904cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:51.451791 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815f528-2f99-4b93-add9-0b39df8904cc admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:51.452074 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815f528-2f99-4b93-add9-0b39df8904cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:51.452808 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815f528-2f99-4b93-add9-0b39df8904cc admin admin] PATH_INFO: `/v3/projects/e11ec05b91de4886a6d18e8ab9cbc133/users/9c5b3e1c775449cbbb49c12e3eff2013/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:51.482376 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3815f528-2f99-4b93-add9-0b39df8904cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e11ec05b91de4886a6d18e8ab9cbc133, user_id=9c5b3e1c775449cbbb49c12e3eff2013, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:51.489652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3815f528-2f99-4b93-add9-0b39df8904cc admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:51.552622 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370d070-41e4-49f5-b3fc-fca0448f3a12 service nova] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:51.559656 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c66c62-da63-469f-956b-e393b02758c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:51.560931 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c66c62-da63-469f-956b-e393b02758c0 service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:51.561317 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c66c62-da63-469f-956b-e393b02758c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:51.561687 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c66c62-da63-469f-956b-e393b02758c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:51.566297 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-36c66c62-da63-469f-956b-e393b02758c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:51.616147 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 910/1815] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:51 2022] PUT /identity/v3/projects/e11ec05b91de4886a6d18e8ab9cbc133/users/9c5b3e1c775449cbbb49c12e3eff2013/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:51.618389 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef91b5-be74-404a-9d56-432dcb3b12dd None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:51.621792 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef91b5-be74-404a-9d56-432dcb3b12dd None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:51.621792 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef91b5-be74-404a-9d56-432dcb3b12dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:51.625711 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:51.657773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-b3ef91b5-be74-404a-9d56-432dcb3b12dd None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:51.659653 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-b3ef91b5-be74-404a-9d56-432dcb3b12dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:51.667887 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c66c62-da63-469f-956b-e393b02758c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:51.669601 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c66c62-da63-469f-956b-e393b02758c0 service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:51.685467 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 906/1816] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:51.686403 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c66c62-da63-469f-956b-e393b02758c0 service cinder] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:51.688898 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-36c66c62-da63-469f-956b-e393b02758c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:51.720175 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c66c62-da63-469f-956b-e393b02758c0 service cinder] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:51.816174 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:51.827238 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 911/1817] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:51.838093 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef91b5-be74-404a-9d56-432dcb3b12dd None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:51.840590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-b3ef91b5-be74-404a-9d56-432dcb3b12dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:51.853011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577be5a0-8cfe-4213-b0da-7cfa69c8f52f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:51.854621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577be5a0-8cfe-4213-b0da-7cfa69c8f52f service nova] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:51.875544 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577be5a0-8cfe-4213-b0da-7cfa69c8f52f service nova] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:51.875933 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577be5a0-8cfe-4213-b0da-7cfa69c8f52f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:51.892683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577be5a0-8cfe-4213-b0da-7cfa69c8f52f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:51.894624 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577be5a0-8cfe-4213-b0da-7cfa69c8f52f service nova] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:51.907276 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 907/1818] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:51.909530 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10d5fb-5cef-4caf-910c-975ef5fffd53 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:51.909831 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10d5fb-5cef-4caf-910c-975ef5fffd53 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:51.910982 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10d5fb-5cef-4caf-910c-975ef5fffd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:51.956262 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-3c10d5fb-5cef-4caf-910c-975ef5fffd53 None None] MFA Rules not processed for user `9c5b3e1c775449cbbb49c12e3eff2013`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:51.956879 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-3c10d5fb-5cef-4caf-910c-975ef5fffd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:51.958716 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef91b5-be74-404a-9d56-432dcb3b12dd None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:51.971669 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33abac-7ab3-4041-94ee-843d6257bf9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:51.972514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33abac-7ab3-4041-94ee-843d6257bf9f service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:51.980576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33abac-7ab3-4041-94ee-843d6257bf9f service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:51.981056 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33abac-7ab3-4041-94ee-843d6257bf9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:51.997041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-8f33abac-7ab3-4041-94ee-843d6257bf9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:52.086195 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 908/1819] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:51 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:52.092269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbaa3b4-45ad-43d1-916d-cfac297e4c49 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:52.092455 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbaa3b4-45ad-43d1-916d-cfac297e4c49 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:52.092648 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbaa3b4-45ad-43d1-916d-cfac297e4c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:52.143576 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-4fbaa3b4-45ad-43d1-916d-cfac297e4c49 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:52.144479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-4fbaa3b4-45ad-43d1-916d-cfac297e4c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:52.171821 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33abac-7ab3-4041-94ee-843d6257bf9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:52.174485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33abac-7ab3-4041-94ee-843d6257bf9f service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:52.185634 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 909/1820] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:52.185634 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbaa3b4-45ad-43d1-916d-cfac297e4c49 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:52.214592 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 912/1821] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:51 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:52.215593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33abac-7ab3-4041-94ee-843d6257bf9f service cinder] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:52.230945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33abac-7ab3-4041-94ee-843d6257bf9f service cinder] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:52.235806 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbaa3b4-45ad-43d1-916d-cfac297e4c49 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:52.237719 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb8ec0-8ffd-4a54-bacd-8bf36ddd9870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:52.238580 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb8ec0-8ffd-4a54-bacd-8bf36ddd9870 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:52.239029 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb8ec0-8ffd-4a54-bacd-8bf36ddd9870 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:52.239402 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb8ec0-8ffd-4a54-bacd-8bf36ddd9870 admin admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:52.240171 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb8ec0-8ffd-4a54-bacd-8bf36ddd9870 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:24:52.240568 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb8ec0-8ffd-4a54-bacd-8bf36ddd9870 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:52.242485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb8ec0-8ffd-4a54-bacd-8bf36ddd9870 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:52.254217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af9ba0-0b67-41f0-9ba5-f2279e485e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:52.257793 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af9ba0-0b67-41f0-9ba5-f2279e485e5b admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:52.257793 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af9ba0-0b67-41f0-9ba5-f2279e485e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:52.257793 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af9ba0-0b67-41f0-9ba5-f2279e485e5b admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:52.257793 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af9ba0-0b67-41f0-9ba5-f2279e485e5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:52.267156 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af9ba0-0b67-41f0-9ba5-f2279e485e5b admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:52.267648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 913/1822] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:24:52.269310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb8ec0-8ffd-4a54-bacd-8bf36ddd9870 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:52.297019 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb8ec0-8ffd-4a54-bacd-8bf36ddd9870 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:52.306478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7ce0f-8437-4b5a-b805-f82a91b7e2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:52.308743 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7ce0f-8437-4b5a-b805-f82a91b7e2ba admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:52.309187 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7ce0f-8437-4b5a-b805-f82a91b7e2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:52.309795 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7ce0f-8437-4b5a-b805-f82a91b7e2ba admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:52.311322 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7ce0f-8437-4b5a-b805-f82a91b7e2ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:52.314063 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7ce0f-8437-4b5a-b805-f82a91b7e2ba admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:52.415843 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 910/1823] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:24:52 2022] POST /identity/v3/projects => generated 355 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:52.417158 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af9ba0-0b67-41f0-9ba5-f2279e485e5b admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:52.443322 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 914/1824] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:24:52 2022] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:52.448386 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7ce0f-8437-4b5a-b805-f82a91b7e2ba admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:52.576975 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7ce0f-8437-4b5a-b805-f82a91b7e2ba admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:52.586954 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783621cd-90c6-4d03-a0e8-bab27c6a712e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:52.587868 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783621cd-90c6-4d03-a0e8-bab27c6a712e admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:52.588166 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783621cd-90c6-4d03-a0e8-bab27c6a712e admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:52.588588 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783621cd-90c6-4d03-a0e8-bab27c6a712e admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:52.590173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783621cd-90c6-4d03-a0e8-bab27c6a712e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:52.596602 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783621cd-90c6-4d03-a0e8-bab27c6a712e admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:52.648207 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af9ba0-0b67-41f0-9ba5-f2279e485e5b admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:52.653649 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5ca49-464b-42c1-b433-a1903a55af5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:52.659031 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5ca49-464b-42c1-b433-a1903a55af5c admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:52.659031 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5ca49-464b-42c1-b433-a1903a55af5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:52.659031 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5ca49-464b-42c1-b433-a1903a55af5c admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:52.659816 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5ca49-464b-42c1-b433-a1903a55af5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:52.662202 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5ca49-464b-42c1-b433-a1903a55af5c admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:52.716056 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 915/1825] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:24:52 2022] POST /identity/v3/users => generated 293 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:52.720687 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783621cd-90c6-4d03-a0e8-bab27c6a712e admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:52.763705 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:52.764807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783621cd-90c6-4d03-a0e8-bab27c6a712e admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:52.781123 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968abae7-e70c-4e0b-92cf-1e44f0bb760c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:52.782328 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968abae7-e70c-4e0b-92cf-1e44f0bb760c admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:52.782776 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968abae7-e70c-4e0b-92cf-1e44f0bb760c admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:52.783200 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968abae7-e70c-4e0b-92cf-1e44f0bb760c admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:52.784262 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968abae7-e70c-4e0b-92cf-1e44f0bb760c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:52.787285 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968abae7-e70c-4e0b-92cf-1e44f0bb760c admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:52.800273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 916/1826] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:52.812881 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968abae7-e70c-4e0b-92cf-1e44f0bb760c admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:52.835147 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 911/1827] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:24:52 2022] POST /identity/v3/users => generated 284 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:52.837223 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5ca49-464b-42c1-b433-a1903a55af5c admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:52.863561 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5ca49-464b-42c1-b433-a1903a55af5c admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:52.882125 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968abae7-e70c-4e0b-92cf-1e44f0bb760c admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:52.885739 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef1f29-4799-48f1-8524-9275161ed40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:52.888883 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef1f29-4799-48f1-8524-9275161ed40e admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:52.889540 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef1f29-4799-48f1-8524-9275161ed40e admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:52.891325 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef1f29-4799-48f1-8524-9275161ed40e admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:52.892048 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef1f29-4799-48f1-8524-9275161ed40e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:52.896805 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef1f29-4799-48f1-8524-9275161ed40e admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:52.904807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532f064-dbdb-4372-8cce-f3178d3fa878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:52.905928 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532f064-dbdb-4372-8cce-f3178d3fa878 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:52.908851 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532f064-dbdb-4372-8cce-f3178d3fa878 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:52.912940 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532f064-dbdb-4372-8cce-f3178d3fa878 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:52.920002 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532f064-dbdb-4372-8cce-f3178d3fa878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:52.922383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532f064-dbdb-4372-8cce-f3178d3fa878 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:52.926431 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 912/1828] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:52.929780 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef1f29-4799-48f1-8524-9275161ed40e admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:52.944427 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 917/1829] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:52.948932 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532f064-dbdb-4372-8cce-f3178d3fa878 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:52.958066 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef1f29-4799-48f1-8524-9275161ed40e admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:52.972993 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c53cd-6086-4118-a3b4-0355ec609acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:52.974111 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c53cd-6086-4118-a3b4-0355ec609acd admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:52.974270 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c53cd-6086-4118-a3b4-0355ec609acd admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:52.977081 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532f064-dbdb-4372-8cce-f3178d3fa878 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:52.977616 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c53cd-6086-4118-a3b4-0355ec609acd admin admin] PATH_INFO: `/v3/projects/f07f44994adb437ca2ad248c7abbb4ef/users/e000b375d94a4c91a6eb13b78f709bf9/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:52.996402 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb3405-ff31-450f-afcd-e7187e538eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:52.996613 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb3405-ff31-450f-afcd-e7187e538eeb admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:52.997021 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb3405-ff31-450f-afcd-e7187e538eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:52.997404 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb3405-ff31-450f-afcd-e7187e538eeb admin admin] PATH_INFO: `/v3/projects/c852ea4ae86d4a7cbd0665fb8ae09c34/users/b7331f93243b44f4b9cc41b388ad1f75/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:53.029906 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c53cd-6086-4118-a3b4-0355ec609acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f07f44994adb437ca2ad248c7abbb4ef, user_id=e000b375d94a4c91a6eb13b78f709bf9, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:53.032790 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c53cd-6086-4118-a3b4-0355ec609acd admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:53.044717 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb3405-ff31-450f-afcd-e7187e538eeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c852ea4ae86d4a7cbd0665fb8ae09c34, user_id=b7331f93243b44f4b9cc41b388ad1f75, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:53.048763 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb3405-ff31-450f-afcd-e7187e538eeb admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:53.112187 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 913/1830] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:52 2022] PUT /identity/v3/projects/f07f44994adb437ca2ad248c7abbb4ef/users/e000b375d94a4c91a6eb13b78f709bf9/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:53.117751 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c53cd-6086-4118-a3b4-0355ec609acd admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:53.136625 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 918/1831] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:52 2022] PUT /identity/v3/projects/c852ea4ae86d4a7cbd0665fb8ae09c34/users/b7331f93243b44f4b9cc41b388ad1f75/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:53.154402 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da440c-44a8-4da5-b696-f927d31a37f7 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:53.159663 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da440c-44a8-4da5-b696-f927d31a37f7 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:53.160432 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da440c-44a8-4da5-b696-f927d31a37f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:53.210610 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-31da440c-44a8-4da5-b696-f927d31a37f7 None None] MFA Rules not processed for user `b7331f93243b44f4b9cc41b388ad1f75`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:53.212743 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-31da440c-44a8-4da5-b696-f927d31a37f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:53.321389 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 919/1832] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:53.325575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da440c-44a8-4da5-b696-f927d31a37f7 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:53.331356 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c53cd-6086-4118-a3b4-0355ec609acd admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:53.437400 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da440c-44a8-4da5-b696-f927d31a37f7 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:53.450973 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db9a63-02a9-400f-83bd-04f566c15d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:53.453950 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db9a63-02a9-400f-83bd-04f566c15d36 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:53.454236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db9a63-02a9-400f-83bd-04f566c15d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:53.454543 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db9a63-02a9-400f-83bd-04f566c15d36 admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:53.457467 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db9a63-02a9-400f-83bd-04f566c15d36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:53.460406 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db9a63-02a9-400f-83bd-04f566c15d36 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:53.509840 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae347dc-3840-4548-895d-c3ece23d5bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:53.510682 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae347dc-3840-4548-895d-c3ece23d5bbb admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:53.511017 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae347dc-3840-4548-895d-c3ece23d5bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:53.511419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae347dc-3840-4548-895d-c3ece23d5bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:53.512709 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae347dc-3840-4548-895d-c3ece23d5bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:53.513989 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae347dc-3840-4548-895d-c3ece23d5bbb admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:53.531435 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 914/1833] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:53.535549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae347dc-3840-4548-895d-c3ece23d5bbb admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:53.565794 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae347dc-3840-4548-895d-c3ece23d5bbb admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:53.578580 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204202a-bd91-4a28-a1af-33526181eb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:53.579332 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204202a-bd91-4a28-a1af-33526181eb5b admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:53.581911 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204202a-bd91-4a28-a1af-33526181eb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:53.581911 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204202a-bd91-4a28-a1af-33526181eb5b admin admin] PATH_INFO: `/v3/projects/f07f44994adb437ca2ad248c7abbb4ef/users/e000b375d94a4c91a6eb13b78f709bf9/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:53.594535 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204202a-bd91-4a28-a1af-33526181eb5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f07f44994adb437ca2ad248c7abbb4ef, user_id=e000b375d94a4c91a6eb13b78f709bf9, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:53.604541 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204202a-bd91-4a28-a1af-33526181eb5b admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:53.634418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 920/1834] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:24:53 2022] POST /identity/v3/projects => generated 385 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:24:53.639830 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db9a63-02a9-400f-83bd-04f566c15d36 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:53.649650 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 915/1835] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:53 2022] PUT /identity/v3/projects/f07f44994adb437ca2ad248c7abbb4ef/users/e000b375d94a4c91a6eb13b78f709bf9/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:53.663740 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cb8db-cc69-4074-b705-c81df6ff4da6 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:53.669249 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cb8db-cc69-4074-b705-c81df6ff4da6 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:53.669249 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cb8db-cc69-4074-b705-c81df6ff4da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:53.754217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-554cb8db-cc69-4074-b705-c81df6ff4da6 None None] MFA Rules not processed for user `e000b375d94a4c91a6eb13b78f709bf9`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:53.758281 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db9a63-02a9-400f-83bd-04f566c15d36 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:53.762103 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-554cb8db-cc69-4074-b705-c81df6ff4da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:53.763887 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3228c1-291c-4c68-a3fd-583dc473f56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:53.764524 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3228c1-291c-4c68-a3fd-583dc473f56d admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:53.764809 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3228c1-291c-4c68-a3fd-583dc473f56d admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:53.765129 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3228c1-291c-4c68-a3fd-583dc473f56d admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:53.765770 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3228c1-291c-4c68-a3fd-583dc473f56d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:53.775640 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3228c1-291c-4c68-a3fd-583dc473f56d admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:53.883316 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 916/1836] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:53 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:53.896453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cb8db-cc69-4074-b705-c81df6ff4da6 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:53.902326 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 921/1837] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:24:53 2022] POST /identity/v3/users => generated 299 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:53.911186 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3228c1-291c-4c68-a3fd-583dc473f56d admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:53.922575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3228c1-291c-4c68-a3fd-583dc473f56d admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:53.928464 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ea11a-2429-4029-b84d-e638d0918099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:53.928975 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ea11a-2429-4029-b84d-e638d0918099 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:53.929614 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ea11a-2429-4029-b84d-e638d0918099 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:53.929851 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ea11a-2429-4029-b84d-e638d0918099 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:53.938409 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ea11a-2429-4029-b84d-e638d0918099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:53.938409 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ea11a-2429-4029-b84d-e638d0918099 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:53.949158 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 922/1838] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:53.950869 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ea11a-2429-4029-b84d-e638d0918099 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:53.968359 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ea11a-2429-4029-b84d-e638d0918099 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:53.982771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ee93e-445d-486b-8359-22ff9a25edfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:53.983663 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ee93e-445d-486b-8359-22ff9a25edfa admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:53.984009 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ee93e-445d-486b-8359-22ff9a25edfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:53.984319 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ee93e-445d-486b-8359-22ff9a25edfa admin admin] PATH_INFO: `/v3/projects/1e3ea849fa3e49e7b2e64a79347db3c1/users/28a908adb5d24eae8251fcc5ef39e330/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:54.006603 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cb8db-cc69-4074-b705-c81df6ff4da6 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:54.006603 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33084a1-453d-43ac-9491-d78d91576bf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:54.006603 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33084a1-453d-43ac-9491-d78d91576bf5 service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:54.006603 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33084a1-453d-43ac-9491-d78d91576bf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:54.007284 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33084a1-453d-43ac-9491-d78d91576bf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:54.012128 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ee93e-445d-486b-8359-22ff9a25edfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e3ea849fa3e49e7b2e64a79347db3c1, user_id=28a908adb5d24eae8251fcc5ef39e330, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:54.015141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ee93e-445d-486b-8359-22ff9a25edfa admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:54.028679 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33084a1-453d-43ac-9491-d78d91576bf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:54.030652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33084a1-453d-43ac-9491-d78d91576bf5 service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:54.052906 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 917/1839] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:53 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:54.101378 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 923/1840] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:53 2022] PUT /identity/v3/projects/1e3ea849fa3e49e7b2e64a79347db3c1/users/28a908adb5d24eae8251fcc5ef39e330/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:54.105350 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33084a1-453d-43ac-9491-d78d91576bf5 service cinder] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:54.147021 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33084a1-453d-43ac-9491-d78d91576bf5 service cinder] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:54.243866 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:54.260985 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a483859-e378-4669-adf8-583182269c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:54.262214 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a483859-e378-4669-adf8-583182269c61 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:54.262678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a483859-e378-4669-adf8-583182269c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:54.265458 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a483859-e378-4669-adf8-583182269c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:54.273736 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a483859-e378-4669-adf8-583182269c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:54.279313 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a483859-e378-4669-adf8-583182269c61 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:54.309135 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ee93e-445d-486b-8359-22ff9a25edfa admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:54.309667 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 918/1841] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:54.333151 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ee93e-445d-486b-8359-22ff9a25edfa admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:54.335904 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a483859-e378-4669-adf8-583182269c61 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:54.354100 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8850b24-a27b-485a-bf1a-9fd23512639f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:54.354958 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8850b24-a27b-485a-bf1a-9fd23512639f admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:54.364841 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8850b24-a27b-485a-bf1a-9fd23512639f admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:54.366139 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8850b24-a27b-485a-bf1a-9fd23512639f admin admin] PATH_INFO: `/v3/projects/1e3ea849fa3e49e7b2e64a79347db3c1/users/28a908adb5d24eae8251fcc5ef39e330/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:54.372035 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8850b24-a27b-485a-bf1a-9fd23512639f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e3ea849fa3e49e7b2e64a79347db3c1, user_id=28a908adb5d24eae8251fcc5ef39e330, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:54.390444 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8850b24-a27b-485a-bf1a-9fd23512639f admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:54.416323 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 924/1842] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:54 2022] PUT /identity/v3/projects/1e3ea849fa3e49e7b2e64a79347db3c1/users/28a908adb5d24eae8251fcc5ef39e330/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:54.435112 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a483859-e378-4669-adf8-583182269c61 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:54.438249 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80f15f-01bd-4c8a-b304-bd67b535fc41 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:54.438546 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80f15f-01bd-4c8a-b304-bd67b535fc41 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:54.438827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80f15f-01bd-4c8a-b304-bd67b535fc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:54.513797 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-de80f15f-01bd-4c8a-b304-bd67b535fc41 None None] MFA Rules not processed for user `28a908adb5d24eae8251fcc5ef39e330`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:54.515622 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-de80f15f-01bd-4c8a-b304-bd67b535fc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:54.649824 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99572454-e1d5-4eeb-b404-df13f0ab91cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:54.651382 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99572454-e1d5-4eeb-b404-df13f0ab91cb service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:54.652218 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99572454-e1d5-4eeb-b404-df13f0ab91cb service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:54.654001 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99572454-e1d5-4eeb-b404-df13f0ab91cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:54.696136 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 925/1843] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:54.752467 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99572454-e1d5-4eeb-b404-df13f0ab91cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:54.755219 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99572454-e1d5-4eeb-b404-df13f0ab91cb service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:54.769118 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 919/1844] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:54 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:24:54.799580 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:54.879866 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80f15f-01bd-4c8a-b304-bd67b535fc41 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:54.897968 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80f15f-01bd-4c8a-b304-bd67b535fc41 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:54.906827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be59455-fb80-48d8-b7a1-cd4f9722bb9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:54.906827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be59455-fb80-48d8-b7a1-cd4f9722bb9b service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:54.906827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be59455-fb80-48d8-b7a1-cd4f9722bb9b service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:54.906827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be59455-fb80-48d8-b7a1-cd4f9722bb9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:54.918233 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be59455-fb80-48d8-b7a1-cd4f9722bb9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:54.921191 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be59455-fb80-48d8-b7a1-cd4f9722bb9b service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:54.941268 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 926/1845] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:55.000986 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99572454-e1d5-4eeb-b404-df13f0ab91cb service cinder] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:55.160075 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99572454-e1d5-4eeb-b404-df13f0ab91cb service cinder] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:55.166673 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48109c-9ea8-40de-8465-2dfaff9d44b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:55.171400 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48109c-9ea8-40de-8465-2dfaff9d44b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:55.171400 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48109c-9ea8-40de-8465-2dfaff9d44b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:55.171400 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48109c-9ea8-40de-8465-2dfaff9d44b1 admin admin] PATH_INFO: `/v3/users/b7331f93243b44f4b9cc41b388ad1f75` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:55.171400 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48109c-9ea8-40de-8465-2dfaff9d44b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7331f93243b44f4b9cc41b388ad1f75)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:55.177727 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48109c-9ea8-40de-8465-2dfaff9d44b1 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:55.307120 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:55.592097 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-3e48109c-9ea8-40de-8465-2dfaff9d44b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7331f93243b44f4b9cc41b388ad1f75'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:55.706224 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-3e48109c-9ea8-40de-8465-2dfaff9d44b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7331f93243b44f4b9cc41b388ad1f75'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:55.725659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-3e48109c-9ea8-40de-8465-2dfaff9d44b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7331f93243b44f4b9cc41b388ad1f75'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:55.748669 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-3e48109c-9ea8-40de-8465-2dfaff9d44b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7331f93243b44f4b9cc41b388ad1f75'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:55.750238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-3e48109c-9ea8-40de-8465-2dfaff9d44b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7331f93243b44f4b9cc41b388ad1f75'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:55.766001 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 920/1846] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:24:54 2022] DELETE /identity/v3/users/b7331f93243b44f4b9cc41b388ad1f75 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:55.767682 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bd797-2be8-4ae9-86a1-a91ed17729e3 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:55.768297 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bd797-2be8-4ae9-86a1-a91ed17729e3 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:55.768620 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bd797-2be8-4ae9-86a1-a91ed17729e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:55.806158 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-9e3bd797-2be8-4ae9-86a1-a91ed17729e3 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:55.807671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-9e3bd797-2be8-4ae9-86a1-a91ed17729e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:55.899337 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 927/1847] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:24:55.910436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48109c-9ea8-40de-8465-2dfaff9d44b1 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:55.912215 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-3e48109c-9ea8-40de-8465-2dfaff9d44b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:56.011563 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48109c-9ea8-40de-8465-2dfaff9d44b1 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:56.018440 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319fa65-1543-4beb-9877-f0e3d8bcbe5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:56.022625 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319fa65-1543-4beb-9877-f0e3d8bcbe5e service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:56.022625 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319fa65-1543-4beb-9877-f0e3d8bcbe5e service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:56.022625 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319fa65-1543-4beb-9877-f0e3d8bcbe5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:56.032392 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319fa65-1543-4beb-9877-f0e3d8bcbe5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:56.034940 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319fa65-1543-4beb-9877-f0e3d8bcbe5e service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:56.050196 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 921/1848] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:24:56.628140 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bd797-2be8-4ae9-86a1-a91ed17729e3 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:56.628140 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-9e3bd797-2be8-4ae9-86a1-a91ed17729e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:56.651779 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bd797-2be8-4ae9-86a1-a91ed17729e3 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:56.654568 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45104305-3a22-4fbd-b71f-10b081885466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:56.655228 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45104305-3a22-4fbd-b71f-10b081885466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:56.655512 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45104305-3a22-4fbd-b71f-10b081885466 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:56.655782 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45104305-3a22-4fbd-b71f-10b081885466 admin admin] PATH_INFO: `/v3/projects/c852ea4ae86d4a7cbd0665fb8ae09c34` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:56.657708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45104305-3a22-4fbd-b71f-10b081885466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c852ea4ae86d4a7cbd0665fb8ae09c34)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:56.660417 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45104305-3a22-4fbd-b71f-10b081885466 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:56.819400 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-45104305-3a22-4fbd-b71f-10b081885466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c852ea4ae86d4a7cbd0665fb8ae09c34', 'request_id': 'req-45104305-3a22-4fbd-b71f-10b081885466'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:56.825738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:56.829312 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-45104305-3a22-4fbd-b71f-10b081885466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c852ea4ae86d4a7cbd0665fb8ae09c34', 'request_id': 'req-45104305-3a22-4fbd-b71f-10b081885466'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:56.841743 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-45104305-3a22-4fbd-b71f-10b081885466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c852ea4ae86d4a7cbd0665fb8ae09c34', 'request_id': 'req-45104305-3a22-4fbd-b71f-10b081885466'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:56.923904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-45104305-3a22-4fbd-b71f-10b081885466 admin admin] The token cache is being invalidate because project c852ea4ae86d4a7cbd0665fb8ae09c34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:24:56.924300 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-45104305-3a22-4fbd-b71f-10b081885466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:56.926906 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-45104305-3a22-4fbd-b71f-10b081885466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:56.928632 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 928/1849] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:24:56 2022] DELETE /identity/v3/projects/c852ea4ae86d4a7cbd0665fb8ae09c34 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:56.932711 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319fa65-1543-4beb-9877-f0e3d8bcbe5e service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:56.948237 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319fa65-1543-4beb-9877-f0e3d8bcbe5e service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:56.991842 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:57.067605 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6d3f2-dcdc-4303-90b6-377e4b26d97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:57.068710 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6d3f2-dcdc-4303-90b6-377e4b26d97d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:57.075911 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6d3f2-dcdc-4303-90b6-377e4b26d97d admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:57.075911 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6d3f2-dcdc-4303-90b6-377e4b26d97d admin admin] PATH_INFO: `/v3/users/28a908adb5d24eae8251fcc5ef39e330` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:57.075911 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6d3f2-dcdc-4303-90b6-377e4b26d97d admin admin] RBAC: Authorizing `identity:delete_user(user_id=28a908adb5d24eae8251fcc5ef39e330)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:57.075911 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6d3f2-dcdc-4303-90b6-377e4b26d97d admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:57.228311 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45104305-3a22-4fbd-b71f-10b081885466 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:57.232459 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-45104305-3a22-4fbd-b71f-10b081885466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:57.257376 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45104305-3a22-4fbd-b71f-10b081885466 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:57.262687 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e40c31-7199-4612-ad4d-647584a67165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:57.263677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e40c31-7199-4612-ad4d-647584a67165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:57.264135 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e40c31-7199-4612-ad4d-647584a67165 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:57.264608 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e40c31-7199-4612-ad4d-647584a67165 admin admin] PATH_INFO: `/v3/users/337d944585b84351b80c3d82f7a9722d` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:57.265789 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e40c31-7199-4612-ad4d-647584a67165 admin admin] RBAC: Authorizing `identity:delete_user(user_id=337d944585b84351b80c3d82f7a9722d)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:57.267945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e40c31-7199-4612-ad4d-647584a67165 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:57.299527 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-29e6d3f2-dcdc-4303-90b6-377e4b26d97d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28a908adb5d24eae8251fcc5ef39e330'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:57.367955 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-29e6d3f2-dcdc-4303-90b6-377e4b26d97d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28a908adb5d24eae8251fcc5ef39e330'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:57.377481 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-29e6d3f2-dcdc-4303-90b6-377e4b26d97d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28a908adb5d24eae8251fcc5ef39e330'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:57.395922 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-29e6d3f2-dcdc-4303-90b6-377e4b26d97d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28a908adb5d24eae8251fcc5ef39e330'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:57.397862 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-29e6d3f2-dcdc-4303-90b6-377e4b26d97d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28a908adb5d24eae8251fcc5ef39e330'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:57.404025 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 922/1850] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:24:56 2022] DELETE /identity/v3/users/28a908adb5d24eae8251fcc5ef39e330 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:57.486580 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-96e40c31-7199-4612-ad4d-647584a67165 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '337d944585b84351b80c3d82f7a9722d'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:57.487504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-96e40c31-7199-4612-ad4d-647584a67165 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '337d944585b84351b80c3d82f7a9722d'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:57.511854 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-96e40c31-7199-4612-ad4d-647584a67165 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '337d944585b84351b80c3d82f7a9722d'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:57.512687 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-96e40c31-7199-4612-ad4d-647584a67165 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '337d944585b84351b80c3d82f7a9722d'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:57.551652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-96e40c31-7199-4612-ad4d-647584a67165 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '337d944585b84351b80c3d82f7a9722d'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:57.622426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 929/1851] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:24:57 2022] DELETE /identity/v3/users/337d944585b84351b80c3d82f7a9722d => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:24:57.627719 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff4c2b-6990-4b65-9c65-fe2db465d2f9 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:57.628037 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff4c2b-6990-4b65-9c65-fe2db465d2f9 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:57.628328 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff4c2b-6990-4b65-9c65-fe2db465d2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:57.668254 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-88ff4c2b-6990-4b65-9c65-fe2db465d2f9 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:57.669794 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-88ff4c2b-6990-4b65-9c65-fe2db465d2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:57.717990 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:57.770268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 923/1852] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:57.780574 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e40c31-7199-4612-ad4d-647584a67165 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:57.782821 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-96e40c31-7199-4612-ad4d-647584a67165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:57.803728 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:57.872108 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e40c31-7199-4612-ad4d-647584a67165 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:57.876397 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1968ebf-c30d-4e02-bab8-161e69006838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:57.877767 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1968ebf-c30d-4e02-bab8-161e69006838 service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:57.878155 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1968ebf-c30d-4e02-bab8-161e69006838 service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:57.878502 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1968ebf-c30d-4e02-bab8-161e69006838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:57.889030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1968ebf-c30d-4e02-bab8-161e69006838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:57.890544 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1968ebf-c30d-4e02-bab8-161e69006838 service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:57.900778 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 930/1853] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:57.952614 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:57.999741 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff4c2b-6990-4b65-9c65-fe2db465d2f9 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:58.001226 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-88ff4c2b-6990-4b65-9c65-fe2db465d2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:58.015609 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff4c2b-6990-4b65-9c65-fe2db465d2f9 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:58.021753 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19cdbc-52e1-42f3-909b-06a16f47bdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:58.022325 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19cdbc-52e1-42f3-909b-06a16f47bdbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:58.022698 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19cdbc-52e1-42f3-909b-06a16f47bdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:58.023213 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19cdbc-52e1-42f3-909b-06a16f47bdbc admin admin] PATH_INFO: `/v3/projects/1e3ea849fa3e49e7b2e64a79347db3c1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:58.024317 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19cdbc-52e1-42f3-909b-06a16f47bdbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e3ea849fa3e49e7b2e64a79347db3c1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:58.033542 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19cdbc-52e1-42f3-909b-06a16f47bdbc admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:58.284441 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-9d19cdbc-52e1-42f3-909b-06a16f47bdbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e3ea849fa3e49e7b2e64a79347db3c1', 'request_id': 'req-9d19cdbc-52e1-42f3-909b-06a16f47bdbc'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:58.290790 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-9d19cdbc-52e1-42f3-909b-06a16f47bdbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e3ea849fa3e49e7b2e64a79347db3c1', 'request_id': 'req-9d19cdbc-52e1-42f3-909b-06a16f47bdbc'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:58.294252 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:58.301593 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-9d19cdbc-52e1-42f3-909b-06a16f47bdbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e3ea849fa3e49e7b2e64a79347db3c1', 'request_id': 'req-9d19cdbc-52e1-42f3-909b-06a16f47bdbc'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:58.406159 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-9d19cdbc-52e1-42f3-909b-06a16f47bdbc admin admin] The token cache is being invalidate because project 1e3ea849fa3e49e7b2e64a79347db3c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:24:58.406546 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-9d19cdbc-52e1-42f3-909b-06a16f47bdbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:58.407281 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-9d19cdbc-52e1-42f3-909b-06a16f47bdbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:58.413789 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 924/1854] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:24:57 2022] DELETE /identity/v3/projects/1e3ea849fa3e49e7b2e64a79347db3c1 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:58.415468 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a35110-fe3a-464a-9808-49ef85567008 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:58.415758 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a35110-fe3a-464a-9808-49ef85567008 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:58.416267 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a35110-fe3a-464a-9808-49ef85567008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:58.440628 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-98a35110-fe3a-464a-9808-49ef85567008 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:58.442422 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-98a35110-fe3a-464a-9808-49ef85567008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:58.506138 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 931/1855] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:58.514741 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84977e-05b2-43e5-bc43-b1dfba1c9a30 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:58.519096 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84977e-05b2-43e5-bc43-b1dfba1c9a30 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:58.519096 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84977e-05b2-43e5-bc43-b1dfba1c9a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:58.540834 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-7c84977e-05b2-43e5-bc43-b1dfba1c9a30 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:58.542377 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-7c84977e-05b2-43e5-bc43-b1dfba1c9a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:58.551860 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 925/1856] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:58.558529 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a35110-fe3a-464a-9808-49ef85567008 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:58.567071 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a35110-fe3a-464a-9808-49ef85567008 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:58.573188 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543cbab6-c612-4e2d-b81f-f829720b29f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:58.574441 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cbab6-c612-4e2d-b81f-f829720b29f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:58.575765 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cbab6-c612-4e2d-b81f-f829720b29f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:58.575765 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cbab6-c612-4e2d-b81f-f829720b29f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:58.576631 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543cbab6-c612-4e2d-b81f-f829720b29f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:24:58.577474 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543cbab6-c612-4e2d-b81f-f829720b29f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:58.580174 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543cbab6-c612-4e2d-b81f-f829720b29f7 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:58.594652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:58.599281 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 932/1857] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:24:58.601276 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84977e-05b2-43e5-bc43-b1dfba1c9a30 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:58.612424 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84977e-05b2-43e5-bc43-b1dfba1c9a30 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:58.617943 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a11cd-55db-4b03-a8f8-52d443a051cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:58.621760 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a11cd-55db-4b03-a8f8-52d443a051cd admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:58.621760 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a11cd-55db-4b03-a8f8-52d443a051cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:58.621760 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a11cd-55db-4b03-a8f8-52d443a051cd admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:58.621760 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a11cd-55db-4b03-a8f8-52d443a051cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:58.621760 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a11cd-55db-4b03-a8f8-52d443a051cd admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:58.697249 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543cbab6-c612-4e2d-b81f-f829720b29f7 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:58.698183 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-543cbab6-c612-4e2d-b81f-f829720b29f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:58.714541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543cbab6-c612-4e2d-b81f-f829720b29f7 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:58.719761 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa607b-687c-4137-ab3c-ead7e352b87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:58.725883 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa607b-687c-4137-ab3c-ead7e352b87e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:58.725883 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa607b-687c-4137-ab3c-ead7e352b87e admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:58.725883 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa607b-687c-4137-ab3c-ead7e352b87e admin admin] PATH_INFO: `/v3/projects/a55065c0d99f4b5eb5fe0418be4a6b81` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:58.725883 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa607b-687c-4137-ab3c-ead7e352b87e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a55065c0d99f4b5eb5fe0418be4a6b81)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:58.725883 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa607b-687c-4137-ab3c-ead7e352b87e admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:58.726718 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 926/1858] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:24:58 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:24:58.729418 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a11cd-55db-4b03-a8f8-52d443a051cd admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:58.792627 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a11cd-55db-4b03-a8f8-52d443a051cd admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:58.797494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbb1db-2fc5-4686-9d57-45860d471ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:58.798107 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbb1db-2fc5-4686-9d57-45860d471ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:58.798388 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbb1db-2fc5-4686-9d57-45860d471ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:58.798694 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbb1db-2fc5-4686-9d57-45860d471ae6 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:58.799328 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedbb1db-2fc5-4686-9d57-45860d471ae6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:58.801536 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedbb1db-2fc5-4686-9d57-45860d471ae6 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:58.893284 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2caa607b-687c-4137-ab3c-ead7e352b87e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a55065c0d99f4b5eb5fe0418be4a6b81', 'request_id': 'req-2caa607b-687c-4137-ab3c-ead7e352b87e'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:58.914593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2caa607b-687c-4137-ab3c-ead7e352b87e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a55065c0d99f4b5eb5fe0418be4a6b81', 'request_id': 'req-2caa607b-687c-4137-ab3c-ead7e352b87e'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:58.914800 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 927/1859] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:24:58 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:24:58.914883 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2caa607b-687c-4137-ab3c-ead7e352b87e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a55065c0d99f4b5eb5fe0418be4a6b81', 'request_id': 'req-2caa607b-687c-4137-ab3c-ead7e352b87e'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:58.916890 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbb1db-2fc5-4686-9d57-45860d471ae6 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:58.927595 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbb1db-2fc5-4686-9d57-45860d471ae6 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:59.016958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29dba37-aacc-4ff5-8359-ef4d40fbafca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:59.018285 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29dba37-aacc-4ff5-8359-ef4d40fbafca admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:59.018373 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29dba37-aacc-4ff5-8359-ef4d40fbafca admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:59.018638 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29dba37-aacc-4ff5-8359-ef4d40fbafca admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:59.019287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29dba37-aacc-4ff5-8359-ef4d40fbafca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:59.020923 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29dba37-aacc-4ff5-8359-ef4d40fbafca admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:59.034365 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 928/1860] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:24:59.038045 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29dba37-aacc-4ff5-8359-ef4d40fbafca admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:59.039455 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2caa607b-687c-4137-ab3c-ead7e352b87e admin admin] The token cache is being invalidate because project a55065c0d99f4b5eb5fe0418be4a6b81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:24:59.039891 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2caa607b-687c-4137-ab3c-ead7e352b87e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:59.040543 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2caa607b-687c-4137-ab3c-ead7e352b87e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:59.045205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 933/1861] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:24:58 2022] DELETE /identity/v3/projects/a55065c0d99f4b5eb5fe0418be4a6b81 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:24:59.046238 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa607b-687c-4137-ab3c-ead7e352b87e admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:59.048282 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-2caa607b-687c-4137-ab3c-ead7e352b87e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:59.049186 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29dba37-aacc-4ff5-8359-ef4d40fbafca admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:59.054249 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bdf886-b4bf-4657-b1e5-9a5d3216e2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:59.054869 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdf886-b4bf-4657-b1e5-9a5d3216e2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:59.055155 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdf886-b4bf-4657-b1e5-9a5d3216e2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:59.055493 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdf886-b4bf-4657-b1e5-9a5d3216e2f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:59.056077 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bdf886-b4bf-4657-b1e5-9a5d3216e2f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:59.057742 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bdf886-b4bf-4657-b1e5-9a5d3216e2f4 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:59.067481 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa607b-687c-4137-ab3c-ead7e352b87e admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:59.073141 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 929/1862] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:24:59.073976 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bdf886-b4bf-4657-b1e5-9a5d3216e2f4 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:59.075605 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-67bdf886-b4bf-4657-b1e5-9a5d3216e2f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:59.084814 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b96db-61e0-48b5-8d65-2161176d8444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:59.085713 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b96db-61e0-48b5-8d65-2161176d8444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:59.091415 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b96db-61e0-48b5-8d65-2161176d8444 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:59.091415 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b96db-61e0-48b5-8d65-2161176d8444 admin admin] PATH_INFO: `/v3/users/6369fc2d4a5a4106aef6c85ae6d7ca0d` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:59.091415 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b96db-61e0-48b5-8d65-2161176d8444 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6369fc2d4a5a4106aef6c85ae6d7ca0d)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:59.091706 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bdf886-b4bf-4657-b1e5-9a5d3216e2f4 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:59.091903 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b96db-61e0-48b5-8d65-2161176d8444 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:59.094945 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d6868-b99e-4848-bc8c-f1c41e331d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:59.095636 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d6868-b99e-4848-bc8c-f1c41e331d13 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:59.096040 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d6868-b99e-4848-bc8c-f1c41e331d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:59.096196 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d6868-b99e-4848-bc8c-f1c41e331d13 admin admin] PATH_INFO: `/v3/projects/4a622d92e8514c0e9565046905eaa578/users/d59b4584385e414f8b9e0d118269df81/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:59.112976 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d6868-b99e-4848-bc8c-f1c41e331d13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a622d92e8514c0e9565046905eaa578, user_id=d59b4584385e414f8b9e0d118269df81, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:59.115893 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d6868-b99e-4848-bc8c-f1c41e331d13 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:59.254350 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 930/1863] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:24:59 2022] PUT /identity/v3/projects/4a622d92e8514c0e9565046905eaa578/users/d59b4584385e414f8b9e0d118269df81/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:24:59.265032 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f83147-946a-4d36-abdb-13da8319008a None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:59.265376 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f83147-946a-4d36-abdb-13da8319008a None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:59.265659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f83147-946a-4d36-abdb-13da8319008a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:59.297645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-59f83147-946a-4d36-abdb-13da8319008a None None] MFA Rules not processed for user `d59b4584385e414f8b9e0d118269df81`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:24:59.298987 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-59f83147-946a-4d36-abdb-13da8319008a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:59.375737 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 931/1864] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:24:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:24:59.387538 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-e00b96db-61e0-48b5-8d65-2161176d8444 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6369fc2d4a5a4106aef6c85ae6d7ca0d'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:59.388218 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-e00b96db-61e0-48b5-8d65-2161176d8444 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6369fc2d4a5a4106aef6c85ae6d7ca0d'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:59.396516 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-e00b96db-61e0-48b5-8d65-2161176d8444 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6369fc2d4a5a4106aef6c85ae6d7ca0d'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:59.397416 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-e00b96db-61e0-48b5-8d65-2161176d8444 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6369fc2d4a5a4106aef6c85ae6d7ca0d'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:59.399345 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f83147-946a-4d36-abdb-13da8319008a None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:59.401009 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-59f83147-946a-4d36-abdb-13da8319008a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:59.415016 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-e00b96db-61e0-48b5-8d65-2161176d8444 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6369fc2d4a5a4106aef6c85ae6d7ca0d'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:59.465718 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 934/1865] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:24:59 2022] DELETE /identity/v3/users/6369fc2d4a5a4106aef6c85ae6d7ca0d => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:24:59.470772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f83147-946a-4d36-abdb-13da8319008a None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:59.520590 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50c9c6-28f6-49c8-baf6-e188161950a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:59.521132 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50c9c6-28f6-49c8-baf6-e188161950a1 service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:59.521423 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50c9c6-28f6-49c8-baf6-e188161950a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:59.521700 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50c9c6-28f6-49c8-baf6-e188161950a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:59.523476 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-9c50c9c6-28f6-49c8-baf6-e188161950a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:59.586624 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50c9c6-28f6-49c8-baf6-e188161950a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:59.588065 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50c9c6-28f6-49c8-baf6-e188161950a1 service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:59.597278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 932/1866] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:24:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:24:59.619005 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b96db-61e0-48b5-8d65-2161176d8444 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:59.620392 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-e00b96db-61e0-48b5-8d65-2161176d8444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:59.703677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b96db-61e0-48b5-8d65-2161176d8444 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:59.711770 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407e8a0-8cb5-4684-9698-b0c894fc26b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:59.719428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407e8a0-8cb5-4684-9698-b0c894fc26b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:59.719428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407e8a0-8cb5-4684-9698-b0c894fc26b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:59.719428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407e8a0-8cb5-4684-9698-b0c894fc26b1 admin admin] PATH_INFO: `/v3/users/d59b4584385e414f8b9e0d118269df81` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:59.719428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407e8a0-8cb5-4684-9698-b0c894fc26b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d59b4584385e414f8b9e0d118269df81)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:59.719428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407e8a0-8cb5-4684-9698-b0c894fc26b1 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:59.740973 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:24:59.912809 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50c9c6-28f6-49c8-baf6-e188161950a1 service cinder] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:24:59.915291 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-9c50c9c6-28f6-49c8-baf6-e188161950a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:24:59.928877 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50c9c6-28f6-49c8-baf6-e188161950a1 service cinder] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:24:59.935229 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54634aed-0605-4c66-9367-a1935aef0db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:24:59.936007 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54634aed-0605-4c66-9367-a1935aef0db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:24:59.936366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54634aed-0605-4c66-9367-a1935aef0db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:24:59.936709 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54634aed-0605-4c66-9367-a1935aef0db7 admin admin] PATH_INFO: `/v3/projects/58a9815a81704327a6672e146b2687e2` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:24:59.938603 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54634aed-0605-4c66-9367-a1935aef0db7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58a9815a81704327a6672e146b2687e2)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:24:59.940640 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54634aed-0605-4c66-9367-a1935aef0db7 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:24:59.963112 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2407e8a0-8cb5-4684-9698-b0c894fc26b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd59b4584385e414f8b9e0d118269df81'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:59.964523 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2407e8a0-8cb5-4684-9698-b0c894fc26b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd59b4584385e414f8b9e0d118269df81'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:59.972751 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2407e8a0-8cb5-4684-9698-b0c894fc26b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd59b4584385e414f8b9e0d118269df81'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:59.973727 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2407e8a0-8cb5-4684-9698-b0c894fc26b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd59b4584385e414f8b9e0d118269df81'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:59.987388 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2407e8a0-8cb5-4684-9698-b0c894fc26b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd59b4584385e414f8b9e0d118269df81'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:24:59.997178 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:00.066382 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-54634aed-0605-4c66-9367-a1935aef0db7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58a9815a81704327a6672e146b2687e2', 'request_id': 'req-54634aed-0605-4c66-9367-a1935aef0db7'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:00.073755 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-54634aed-0605-4c66-9367-a1935aef0db7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58a9815a81704327a6672e146b2687e2', 'request_id': 'req-54634aed-0605-4c66-9367-a1935aef0db7'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:00.086395 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-54634aed-0605-4c66-9367-a1935aef0db7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58a9815a81704327a6672e146b2687e2', 'request_id': 'req-54634aed-0605-4c66-9367-a1935aef0db7'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:00.115600 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 935/1867] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:24:59 2022] DELETE /identity/v3/users/d59b4584385e414f8b9e0d118269df81 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:00.121923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32bcd2-c635-4fb8-868d-14ad544964fe None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:00.122213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32bcd2-c635-4fb8-868d-14ad544964fe None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:00.122496 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32bcd2-c635-4fb8-868d-14ad544964fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:00.143214 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-4d32bcd2-c635-4fb8-868d-14ad544964fe None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:00.144386 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-4d32bcd2-c635-4fb8-868d-14ad544964fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:00.213019 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 936/1868] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:00.219629 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32bcd2-c635-4fb8-868d-14ad544964fe None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:00.221786 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-4d32bcd2-c635-4fb8-868d-14ad544964fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:00.231175 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-54634aed-0605-4c66-9367-a1935aef0db7 admin admin] The token cache is being invalidate because project 58a9815a81704327a6672e146b2687e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:25:00.231475 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-54634aed-0605-4c66-9367-a1935aef0db7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:00.232340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-54634aed-0605-4c66-9367-a1935aef0db7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:00.235473 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 933/1869] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:24:59 2022] DELETE /identity/v3/projects/58a9815a81704327a6672e146b2687e2 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:25:00.241574 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad18875-9eec-41f1-b8aa-0bc495270de9 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:00.241863 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad18875-9eec-41f1-b8aa-0bc495270de9 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:00.242141 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad18875-9eec-41f1-b8aa-0bc495270de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:00.263772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-dad18875-9eec-41f1-b8aa-0bc495270de9 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:00.264994 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-dad18875-9eec-41f1-b8aa-0bc495270de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:00.273726 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 934/1870] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:00.282211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea3d14-3bd4-426c-931f-80f255b313e0 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:00.282502 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea3d14-3bd4-426c-931f-80f255b313e0 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:00.286073 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea3d14-3bd4-426c-931f-80f255b313e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:00.292076 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32bcd2-c635-4fb8-868d-14ad544964fe None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:00.296424 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b374e-4193-4583-9a80-5408b0165b15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:00.297042 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b374e-4193-4583-9a80-5408b0165b15 service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:00.297359 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b374e-4193-4583-9a80-5408b0165b15 service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:00.297630 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b374e-4193-4583-9a80-5408b0165b15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:00.299519 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-c95b374e-4193-4583-9a80-5408b0165b15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:00.312737 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b374e-4193-4583-9a80-5408b0165b15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:00.313702 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-22ea3d14-3bd4-426c-931f-80f255b313e0 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:00.318411 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b374e-4193-4583-9a80-5408b0165b15 service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:00.318707 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-22ea3d14-3bd4-426c-931f-80f255b313e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:00.327521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 935/1871] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:25:00.332200 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea3d14-3bd4-426c-931f-80f255b313e0 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:00.334768 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 937/1872] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:25:00.342789 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea3d14-3bd4-426c-931f-80f255b313e0 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:00.347936 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c4538-a976-4b0c-8453-866e48244cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:00.348648 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c4538-a976-4b0c-8453-866e48244cfb admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:00.349057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c4538-a976-4b0c-8453-866e48244cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:00.349504 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c4538-a976-4b0c-8453-866e48244cfb admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:00.350219 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c4538-a976-4b0c-8453-866e48244cfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:25:00.350603 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c4538-a976-4b0c-8453-866e48244cfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:00.352281 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c4538-a976-4b0c-8453-866e48244cfb admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:00.366827 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 936/1873] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:25:00.371479 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b374e-4193-4583-9a80-5408b0165b15 service neutron] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:00.382890 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b374e-4193-4583-9a80-5408b0165b15 service neutron] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:00.387824 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf523b-7062-4863-bd8c-d9f5071058e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:00.388448 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf523b-7062-4863-bd8c-d9f5071058e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:00.388729 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf523b-7062-4863-bd8c-d9f5071058e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:00.389001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf523b-7062-4863-bd8c-d9f5071058e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:00.389657 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf523b-7062-4863-bd8c-d9f5071058e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:00.393781 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf523b-7062-4863-bd8c-d9f5071058e8 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:00.485182 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 938/1874] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:25:00 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:25:00.489645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c4538-a976-4b0c-8453-866e48244cfb admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:00.500416 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c4538-a976-4b0c-8453-866e48244cfb admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:00.585841 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cdae61-eb89-401b-acdf-f67bf1cb88c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:00.586764 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdae61-eb89-401b-acdf-f67bf1cb88c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:00.587054 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdae61-eb89-401b-acdf-f67bf1cb88c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:00.587339 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdae61-eb89-401b-acdf-f67bf1cb88c2 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:00.587977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cdae61-eb89-401b-acdf-f67bf1cb88c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:00.590101 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cdae61-eb89-401b-acdf-f67bf1cb88c2 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:00.636561 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:00.678022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 937/1875] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:25:00 2022] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:25:00.682406 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf523b-7062-4863-bd8c-d9f5071058e8 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:00.693911 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:00.703802 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf523b-7062-4863-bd8c-d9f5071058e8 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:00.709911 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd89ed-1d81-4a08-aed2-00037327b0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:00.710680 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd89ed-1d81-4a08-aed2-00037327b0ec admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:00.711550 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd89ed-1d81-4a08-aed2-00037327b0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:00.711550 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd89ed-1d81-4a08-aed2-00037327b0ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:00.712583 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd89ed-1d81-4a08-aed2-00037327b0ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:00.714257 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd89ed-1d81-4a08-aed2-00037327b0ec admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:00.727497 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 939/1876] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:25:00.736148 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cdae61-eb89-401b-acdf-f67bf1cb88c2 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:00.774794 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cdae61-eb89-401b-acdf-f67bf1cb88c2 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:00.787690 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6486f3c-7700-4c51-972e-51361501910a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:00.788330 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6486f3c-7700-4c51-972e-51361501910a admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:00.788609 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6486f3c-7700-4c51-972e-51361501910a admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:00.788982 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6486f3c-7700-4c51-972e-51361501910a admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:00.791712 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6486f3c-7700-4c51-972e-51361501910a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:00.793498 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6486f3c-7700-4c51-972e-51361501910a admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:00.812358 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 938/1877] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:00.820456 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd89ed-1d81-4a08-aed2-00037327b0ec admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:00.839541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd89ed-1d81-4a08-aed2-00037327b0ec admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:00.853915 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ff67d-927e-488a-96a9-3c7f8780e8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:00.855534 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ff67d-927e-488a-96a9-3c7f8780e8ba admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:00.856016 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ff67d-927e-488a-96a9-3c7f8780e8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:00.856731 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ff67d-927e-488a-96a9-3c7f8780e8ba admin admin] PATH_INFO: `/v3/projects/a1ec800c9d0f471e84e5b003f7f9f967/users/a688c764791a47fbaad552af3ce9d8b9/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:00.866725 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:00.901451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ff67d-927e-488a-96a9-3c7f8780e8ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1ec800c9d0f471e84e5b003f7f9f967, user_id=a688c764791a47fbaad552af3ce9d8b9, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:00.905851 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6486f3c-7700-4c51-972e-51361501910a admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:00.907967 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-a6486f3c-7700-4c51-972e-51361501910a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:00.909633 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ff67d-927e-488a-96a9-3c7f8780e8ba admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:00.958028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6486f3c-7700-4c51-972e-51361501910a admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:00.967735 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3fda8-0855-4a08-8b50-119e1e4bae19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:00.968423 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3fda8-0855-4a08-8b50-119e1e4bae19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:00.968709 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3fda8-0855-4a08-8b50-119e1e4bae19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:00.969003 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3fda8-0855-4a08-8b50-119e1e4bae19 admin admin] PATH_INFO: `/v3/projects/4a622d92e8514c0e9565046905eaa578` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:00.970565 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3fda8-0855-4a08-8b50-119e1e4bae19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a622d92e8514c0e9565046905eaa578)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:00.973148 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3fda8-0855-4a08-8b50-119e1e4bae19 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:01.027195 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 940/1878] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:00 2022] PUT /identity/v3/projects/a1ec800c9d0f471e84e5b003f7f9f967/users/a688c764791a47fbaad552af3ce9d8b9/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:01.037526 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515dc4cd-cfc3-42c5-a374-2b3a1dd704de None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:01.037864 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515dc4cd-cfc3-42c5-a374-2b3a1dd704de None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:01.038145 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515dc4cd-cfc3-42c5-a374-2b3a1dd704de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:01.075438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-515dc4cd-cfc3-42c5-a374-2b3a1dd704de None None] MFA Rules not processed for user `a688c764791a47fbaad552af3ce9d8b9`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:01.077875 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-515dc4cd-cfc3-42c5-a374-2b3a1dd704de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:01.119240 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-a4d3fda8-0855-4a08-8b50-119e1e4bae19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a622d92e8514c0e9565046905eaa578', 'request_id': 'req-a4d3fda8-0855-4a08-8b50-119e1e4bae19'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:01.125673 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-a4d3fda8-0855-4a08-8b50-119e1e4bae19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a622d92e8514c0e9565046905eaa578', 'request_id': 'req-a4d3fda8-0855-4a08-8b50-119e1e4bae19'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:01.132682 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-a4d3fda8-0855-4a08-8b50-119e1e4bae19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a622d92e8514c0e9565046905eaa578', 'request_id': 'req-a4d3fda8-0855-4a08-8b50-119e1e4bae19'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:01.155492 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 941/1879] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:25:01.159695 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515dc4cd-cfc3-42c5-a374-2b3a1dd704de None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:01.218829 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-a4d3fda8-0855-4a08-8b50-119e1e4bae19 admin admin] The token cache is being invalidate because project 4a622d92e8514c0e9565046905eaa578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:25:01.219334 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-a4d3fda8-0855-4a08-8b50-119e1e4bae19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:01.219811 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-a4d3fda8-0855-4a08-8b50-119e1e4bae19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:01.226388 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515dc4cd-cfc3-42c5-a374-2b3a1dd704de None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:01.227063 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 939/1880] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:25:00 2022] DELETE /identity/v3/projects/4a622d92e8514c0e9565046905eaa578 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:25:01.231521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64b36b-4f89-4399-9d0c-db53451cedaa None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:01.231997 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64b36b-4f89-4399-9d0c-db53451cedaa None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:01.232543 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64b36b-4f89-4399-9d0c-db53451cedaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:01.255419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-be64b36b-4f89-4399-9d0c-db53451cedaa None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:01.256874 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-be64b36b-4f89-4399-9d0c-db53451cedaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:01.302476 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a399d-378e-4a15-8050-79ea9fb34cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:01.307576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a399d-378e-4a15-8050-79ea9fb34cbc admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:01.307576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a399d-378e-4a15-8050-79ea9fb34cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:01.307576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a399d-378e-4a15-8050-79ea9fb34cbc admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:01.307576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a399d-378e-4a15-8050-79ea9fb34cbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:01.307576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a399d-378e-4a15-8050-79ea9fb34cbc admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:01.329307 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 940/1881] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:25:01.338161 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcceed-1c4c-48af-96d0-26ad526b7ab6 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:01.338461 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcceed-1c4c-48af-96d0-26ad526b7ab6 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:01.338744 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcceed-1c4c-48af-96d0-26ad526b7ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:01.359294 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-10fcceed-1c4c-48af-96d0-26ad526b7ab6 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:01.360623 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-10fcceed-1c4c-48af-96d0-26ad526b7ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:01.369191 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 941/1882] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:25:01.373152 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcceed-1c4c-48af-96d0-26ad526b7ab6 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:01.381605 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcceed-1c4c-48af-96d0-26ad526b7ab6 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:01.386070 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ee53b-4eb4-4311-a3d1-b4f0fbdae685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:01.386631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ee53b-4eb4-4311-a3d1-b4f0fbdae685 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:01.386907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ee53b-4eb4-4311-a3d1-b4f0fbdae685 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:01.387179 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ee53b-4eb4-4311-a3d1-b4f0fbdae685 admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:01.387805 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ee53b-4eb4-4311-a3d1-b4f0fbdae685 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:25:01.388106 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ee53b-4eb4-4311-a3d1-b4f0fbdae685 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:01.389715 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ee53b-4eb4-4311-a3d1-b4f0fbdae685 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:01.401717 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 942/1883] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:25:01.405275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ee53b-4eb4-4311-a3d1-b4f0fbdae685 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:01.415485 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ee53b-4eb4-4311-a3d1-b4f0fbdae685 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:01.420281 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98896d64-8fdc-4bb6-b070-7272cbf2da99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:01.420887 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98896d64-8fdc-4bb6-b070-7272cbf2da99 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:01.421276 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98896d64-8fdc-4bb6-b070-7272cbf2da99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:01.421556 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98896d64-8fdc-4bb6-b070-7272cbf2da99 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:01.422260 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98896d64-8fdc-4bb6-b070-7272cbf2da99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:01.424820 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98896d64-8fdc-4bb6-b070-7272cbf2da99 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:01.441056 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 942/1884] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:25:01 2022] POST /identity/v3/projects => generated 383 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:25:01.442475 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a399d-378e-4a15-8050-79ea9fb34cbc admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:01.444642 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-930a399d-378e-4a15-8050-79ea9fb34cbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:01.511102 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a399d-378e-4a15-8050-79ea9fb34cbc admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:01.516404 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036f32d-0934-462a-b5fa-6f0400dc38ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:01.517079 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036f32d-0934-462a-b5fa-6f0400dc38ff admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:01.517557 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036f32d-0934-462a-b5fa-6f0400dc38ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:01.517833 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036f32d-0934-462a-b5fa-6f0400dc38ff admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:01.518468 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6036f32d-0934-462a-b5fa-6f0400dc38ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:01.520574 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6036f32d-0934-462a-b5fa-6f0400dc38ff admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:01.556853 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:01.564305 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 943/1885] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:25:01 2022] POST /identity/v3/projects => generated 359 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:25:01.566206 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98896d64-8fdc-4bb6-b070-7272cbf2da99 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:01.568541 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-98896d64-8fdc-4bb6-b070-7272cbf2da99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:01.636579 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98896d64-8fdc-4bb6-b070-7272cbf2da99 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:01.641293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f90569-0384-48f5-b8ae-70e3f9e3e21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:01.645323 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f90569-0384-48f5-b8ae-70e3f9e3e21e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:01.645323 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f90569-0384-48f5-b8ae-70e3f9e3e21e admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:01.645323 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f90569-0384-48f5-b8ae-70e3f9e3e21e admin admin] PATH_INFO: `/v3/users/5777266f150945378945ff2f04ebcc63` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:01.645323 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f90569-0384-48f5-b8ae-70e3f9e3e21e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5777266f150945378945ff2f04ebcc63)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:01.646118 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f90569-0384-48f5-b8ae-70e3f9e3e21e admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:01.670825 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 943/1886] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:25:01 2022] POST /identity/v3/users => generated 298 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:25:01.673963 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036f32d-0934-462a-b5fa-6f0400dc38ff admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:01.681288 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036f32d-0934-462a-b5fa-6f0400dc38ff admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:01.685902 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc3ac7-925b-460b-9669-46db2b3ce400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:01.686480 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc3ac7-925b-460b-9669-46db2b3ce400 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:01.686763 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc3ac7-925b-460b-9669-46db2b3ce400 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:01.687038 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc3ac7-925b-460b-9669-46db2b3ce400 admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:01.687650 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc3ac7-925b-460b-9669-46db2b3ce400 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:01.689656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc3ac7-925b-460b-9669-46db2b3ce400 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:01.794168 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 944/1887] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:25:01 2022] POST /identity/v3/users => generated 280 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:25:01.794168 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc3ac7-925b-460b-9669-46db2b3ce400 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:01.803070 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc3ac7-925b-460b-9669-46db2b3ce400 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:01.807989 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b60e7-d127-4265-9f3b-5db087c63583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:01.808593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b60e7-d127-4265-9f3b-5db087c63583 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:01.808875 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b60e7-d127-4265-9f3b-5db087c63583 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:01.809207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b60e7-d127-4265-9f3b-5db087c63583 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:01.809856 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b60e7-d127-4265-9f3b-5db087c63583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:01.811457 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b60e7-d127-4265-9f3b-5db087c63583 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:01.823162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 945/1888] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:01.826728 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b60e7-d127-4265-9f3b-5db087c63583 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:01.834522 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b60e7-d127-4265-9f3b-5db087c63583 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:01.839171 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0f6f9-f0e6-44df-864b-3c1d1877ccaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:01.839783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0f6f9-f0e6-44df-864b-3c1d1877ccaa admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:01.840064 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0f6f9-f0e6-44df-864b-3c1d1877ccaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:01.840339 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0f6f9-f0e6-44df-864b-3c1d1877ccaa admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:01.840987 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f0f6f9-f0e6-44df-864b-3c1d1877ccaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:01.842628 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f0f6f9-f0e6-44df-864b-3c1d1877ccaa admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:01.853382 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 946/1889] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:01.854379 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0f6f9-f0e6-44df-864b-3c1d1877ccaa admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:01.864475 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0f6f9-f0e6-44df-864b-3c1d1877ccaa admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:01.869336 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4feae7e-6556-4125-9fa4-2ef550d9670e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:01.869941 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4feae7e-6556-4125-9fa4-2ef550d9670e admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:01.870222 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4feae7e-6556-4125-9fa4-2ef550d9670e admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:01.870498 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4feae7e-6556-4125-9fa4-2ef550d9670e admin admin] PATH_INFO: `/v3/projects/0e75d100459748a3b0ae7e8f0004862e/users/acd6bc6adea34fe1b4cd36654e5c9623/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:01.872116 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-89f90569-0384-48f5-b8ae-70e3f9e3e21e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5777266f150945378945ff2f04ebcc63'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:01.887326 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4feae7e-6556-4125-9fa4-2ef550d9670e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e75d100459748a3b0ae7e8f0004862e, user_id=acd6bc6adea34fe1b4cd36654e5c9623, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:01.890090 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4feae7e-6556-4125-9fa4-2ef550d9670e admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:01.939357 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-89f90569-0384-48f5-b8ae-70e3f9e3e21e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5777266f150945378945ff2f04ebcc63'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:01.947831 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-89f90569-0384-48f5-b8ae-70e3f9e3e21e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5777266f150945378945ff2f04ebcc63'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:01.964444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-89f90569-0384-48f5-b8ae-70e3f9e3e21e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5777266f150945378945ff2f04ebcc63'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:01.965403 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-89f90569-0384-48f5-b8ae-70e3f9e3e21e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5777266f150945378945ff2f04ebcc63'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:01.974270 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 944/1890] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:25:01 2022] DELETE /identity/v3/users/5777266f150945378945ff2f04ebcc63 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:01.984067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f90569-0384-48f5-b8ae-70e3f9e3e21e admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:01.984067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-89f90569-0384-48f5-b8ae-70e3f9e3e21e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:01.984288 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 947/1891] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:01 2022] PUT /identity/v3/projects/0e75d100459748a3b0ae7e8f0004862e/users/acd6bc6adea34fe1b4cd36654e5c9623/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:01.984288 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99347b2c-7b5c-4dbd-b0a3-66e70b687b9b None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:01.984288 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99347b2c-7b5c-4dbd-b0a3-66e70b687b9b None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:01.984288 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99347b2c-7b5c-4dbd-b0a3-66e70b687b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:02.008436 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-99347b2c-7b5c-4dbd-b0a3-66e70b687b9b None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:02.012645 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-99347b2c-7b5c-4dbd-b0a3-66e70b687b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:02.055634 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f90569-0384-48f5-b8ae-70e3f9e3e21e admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:02.061847 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86e497-19b4-49c5-9e86-0871575feda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:02.062608 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86e497-19b4-49c5-9e86-0871575feda2 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:02.062898 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86e497-19b4-49c5-9e86-0871575feda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:02.063282 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86e497-19b4-49c5-9e86-0871575feda2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:02.064603 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86e497-19b4-49c5-9e86-0871575feda2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:02.066516 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86e497-19b4-49c5-9e86-0871575feda2 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:02.082581 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 945/1892] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:02.084377 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86e497-19b4-49c5-9e86-0871575feda2 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:02.086611 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-3c86e497-19b4-49c5-9e86-0871575feda2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:02.090468 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 948/1893] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:25:02.104080 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99347b2c-7b5c-4dbd-b0a3-66e70b687b9b None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:02.110803 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86e497-19b4-49c5-9e86-0871575feda2 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:02.117974 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2ac49-bdac-48aa-bbc7-901dac66e6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:02.118883 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2ac49-bdac-48aa-bbc7-901dac66e6ac admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:02.119179 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2ac49-bdac-48aa-bbc7-901dac66e6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:02.119460 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2ac49-bdac-48aa-bbc7-901dac66e6ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:02.120928 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f2ac49-bdac-48aa-bbc7-901dac66e6ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:02.123197 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f2ac49-bdac-48aa-bbc7-901dac66e6ac admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:02.129871 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99347b2c-7b5c-4dbd-b0a3-66e70b687b9b None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:02.140495 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 946/1894] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:02.141477 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2ac49-bdac-48aa-bbc7-901dac66e6ac admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:02.145126 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea358d-4bc1-46a6-b2d8-488d685c4349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:02.145723 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c9f2ac49-bdac-48aa-bbc7-901dac66e6ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:02.145836 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea358d-4bc1-46a6-b2d8-488d685c4349 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:02.147022 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea358d-4bc1-46a6-b2d8-488d685c4349 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:02.147327 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea358d-4bc1-46a6-b2d8-488d685c4349 admin admin] PATH_INFO: `/v3/projects/fee2dd80a81e41b1bc249aabcfdf5c9e/users/76a9b39b04874331924a0b2838f6a8ff/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:02.184555 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea358d-4bc1-46a6-b2d8-488d685c4349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fee2dd80a81e41b1bc249aabcfdf5c9e, user_id=76a9b39b04874331924a0b2838f6a8ff, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:02.190521 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea358d-4bc1-46a6-b2d8-488d685c4349 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:02.223407 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2ac49-bdac-48aa-bbc7-901dac66e6ac admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:02.231595 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376ff08-1c66-4642-99c9-b72c08c04308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:02.233060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376ff08-1c66-4642-99c9-b72c08c04308 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:02.233408 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376ff08-1c66-4642-99c9-b72c08c04308 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:02.233685 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376ff08-1c66-4642-99c9-b72c08c04308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:02.248195 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376ff08-1c66-4642-99c9-b72c08c04308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:02.249686 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376ff08-1c66-4642-99c9-b72c08c04308 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:02.261127 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 947/1895] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:25:02.266084 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376ff08-1c66-4642-99c9-b72c08c04308 service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:02.279027 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376ff08-1c66-4642-99c9-b72c08c04308 service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:02.287411 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a79e4-201a-4e0e-93a0-4db4270e8463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:02.287411 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a79e4-201a-4e0e-93a0-4db4270e8463 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:02.287411 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a79e4-201a-4e0e-93a0-4db4270e8463 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:02.287411 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a79e4-201a-4e0e-93a0-4db4270e8463 admin admin] PATH_INFO: `/v3/projects/0e75d100459748a3b0ae7e8f0004862e/users/acd6bc6adea34fe1b4cd36654e5c9623/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:02.287785 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a79e4-201a-4e0e-93a0-4db4270e8463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e75d100459748a3b0ae7e8f0004862e, user_id=acd6bc6adea34fe1b4cd36654e5c9623, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:02.290565 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a79e4-201a-4e0e-93a0-4db4270e8463 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:02.303501 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 948/1896] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:02 2022] PUT /identity/v3/projects/0e75d100459748a3b0ae7e8f0004862e/users/acd6bc6adea34fe1b4cd36654e5c9623/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:02.315999 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217de7de-00a0-442d-9c7a-1e0a2227cd55 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:02.315999 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217de7de-00a0-442d-9c7a-1e0a2227cd55 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:02.315999 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217de7de-00a0-442d-9c7a-1e0a2227cd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:02.326090 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 949/1897] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:02 2022] PUT /identity/v3/projects/fee2dd80a81e41b1bc249aabcfdf5c9e/users/76a9b39b04874331924a0b2838f6a8ff/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:02.336667 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26966a9d-732d-444f-bf2d-4b584993e770 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:02.339231 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26966a9d-732d-444f-bf2d-4b584993e770 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:02.339231 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26966a9d-732d-444f-bf2d-4b584993e770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:02.373477 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-217de7de-00a0-442d-9c7a-1e0a2227cd55 None None] MFA Rules not processed for user `acd6bc6adea34fe1b4cd36654e5c9623`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:02.375070 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-217de7de-00a0-442d-9c7a-1e0a2227cd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:02.381968 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-26966a9d-732d-444f-bf2d-4b584993e770 None None] MFA Rules not processed for user `76a9b39b04874331924a0b2838f6a8ff`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:02.383911 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-26966a9d-732d-444f-bf2d-4b584993e770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:02.457066 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 950/1898] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:02 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:25:02.460985 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 949/1899] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:02.472464 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26966a9d-732d-444f-bf2d-4b584993e770 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:02.472464 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-26966a9d-732d-444f-bf2d-4b584993e770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:02.490114 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:02.514329 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217de7de-00a0-442d-9c7a-1e0a2227cd55 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:02.516082 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-217de7de-00a0-442d-9c7a-1e0a2227cd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:02.560583 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26966a9d-732d-444f-bf2d-4b584993e770 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:02.565342 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2ab8e-5eed-42a5-9e49-377b969b0a34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:02.568102 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2ab8e-5eed-42a5-9e49-377b969b0a34 service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:02.568102 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2ab8e-5eed-42a5-9e49-377b969b0a34 service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:02.568102 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2ab8e-5eed-42a5-9e49-377b969b0a34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:02.577238 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2ab8e-5eed-42a5-9e49-377b969b0a34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:02.578869 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2ab8e-5eed-42a5-9e49-377b969b0a34 service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:02.580492 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217de7de-00a0-442d-9c7a-1e0a2227cd55 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:02.584291 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89808976-4932-4085-b706-66207b4fbe1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:02.585057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89808976-4932-4085-b706-66207b4fbe1a service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:02.585404 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89808976-4932-4085-b706-66207b4fbe1a service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:02.585685 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89808976-4932-4085-b706-66207b4fbe1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:02.590833 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 951/1900] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:02 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:25:02.594767 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89808976-4932-4085-b706-66207b4fbe1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:02.596397 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89808976-4932-4085-b706-66207b4fbe1a service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:02.606550 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 950/1901] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:02 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:25:02.622943 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2ab8e-5eed-42a5-9e49-377b969b0a34 service cinder] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:02.682847 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:02.700309 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2ab8e-5eed-42a5-9e49-377b969b0a34 service cinder] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:02.704982 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25a4e9-b39a-4c8a-a5e6-a1d485d13a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:02.706539 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89808976-4932-4085-b706-66207b4fbe1a service cinder] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:02.709297 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25a4e9-b39a-4c8a-a5e6-a1d485d13a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:02.709613 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25a4e9-b39a-4c8a-a5e6-a1d485d13a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:02.709906 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25a4e9-b39a-4c8a-a5e6-a1d485d13a82 admin admin] PATH_INFO: `/v3/users/76a9b39b04874331924a0b2838f6a8ff` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:02.711132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25a4e9-b39a-4c8a-a5e6-a1d485d13a82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76a9b39b04874331924a0b2838f6a8ff)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:02.713141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25a4e9-b39a-4c8a-a5e6-a1d485d13a82 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:02.715561 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89808976-4932-4085-b706-66207b4fbe1a service cinder] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:02.719426 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13932e1c-151f-45b8-a658-de77cc325ca1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:02.720034 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13932e1c-151f-45b8-a658-de77cc325ca1 service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:02.724936 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13932e1c-151f-45b8-a658-de77cc325ca1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:02.724936 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13932e1c-151f-45b8-a658-de77cc325ca1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:02.724936 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-13932e1c-151f-45b8-a658-de77cc325ca1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:02.780331 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13932e1c-151f-45b8-a658-de77cc325ca1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:02.783187 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13932e1c-151f-45b8-a658-de77cc325ca1 service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:02.791966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 951/1902] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:25:02.792800 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13932e1c-151f-45b8-a658-de77cc325ca1 service cinder] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:02.794238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-13932e1c-151f-45b8-a658-de77cc325ca1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:02.810055 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13932e1c-151f-45b8-a658-de77cc325ca1 service cinder] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:02.816086 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94de866-0bc6-4ed6-a20d-c90725c941a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:02.816740 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94de866-0bc6-4ed6-a20d-c90725c941a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:02.817024 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94de866-0bc6-4ed6-a20d-c90725c941a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:02.817322 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94de866-0bc6-4ed6-a20d-c90725c941a6 admin admin] PATH_INFO: `/v3/projects/15e170b0e99248faa9bd3c06b43a68e7` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:02.818523 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94de866-0bc6-4ed6-a20d-c90725c941a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15e170b0e99248faa9bd3c06b43a68e7)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:02.820578 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94de866-0bc6-4ed6-a20d-c90725c941a6 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:02.959832 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-f94de866-0bc6-4ed6-a20d-c90725c941a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15e170b0e99248faa9bd3c06b43a68e7', 'request_id': 'req-f94de866-0bc6-4ed6-a20d-c90725c941a6'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:02.966715 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-f94de866-0bc6-4ed6-a20d-c90725c941a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15e170b0e99248faa9bd3c06b43a68e7', 'request_id': 'req-f94de866-0bc6-4ed6-a20d-c90725c941a6'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:02.970669 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-ed25a4e9-b39a-4c8a-a5e6-a1d485d13a82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76a9b39b04874331924a0b2838f6a8ff'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:02.971348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-ed25a4e9-b39a-4c8a-a5e6-a1d485d13a82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76a9b39b04874331924a0b2838f6a8ff'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:02.973296 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-f94de866-0bc6-4ed6-a20d-c90725c941a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15e170b0e99248faa9bd3c06b43a68e7', 'request_id': 'req-f94de866-0bc6-4ed6-a20d-c90725c941a6'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:02.978911 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-ed25a4e9-b39a-4c8a-a5e6-a1d485d13a82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76a9b39b04874331924a0b2838f6a8ff'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:02.979575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-ed25a4e9-b39a-4c8a-a5e6-a1d485d13a82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76a9b39b04874331924a0b2838f6a8ff'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:02.992541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-ed25a4e9-b39a-4c8a-a5e6-a1d485d13a82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76a9b39b04874331924a0b2838f6a8ff'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:03.305503 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-f94de866-0bc6-4ed6-a20d-c90725c941a6 admin admin] The token cache is being invalidate because project 15e170b0e99248faa9bd3c06b43a68e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:25:03.363328 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-f94de866-0bc6-4ed6-a20d-c90725c941a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:03.363328 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-f94de866-0bc6-4ed6-a20d-c90725c941a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:03.363328 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 952/1903] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:25:02 2022] DELETE /identity/v3/projects/15e170b0e99248faa9bd3c06b43a68e7 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:03.363328 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94de866-0bc6-4ed6-a20d-c90725c941a6 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:03.363328 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-f94de866-0bc6-4ed6-a20d-c90725c941a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:03.487026 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94de866-0bc6-4ed6-a20d-c90725c941a6 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:03.493077 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfd9ec-739f-444d-ba2c-1e3efbae6248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:03.494748 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfd9ec-739f-444d-ba2c-1e3efbae6248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:03.495329 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfd9ec-739f-444d-ba2c-1e3efbae6248 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:03.495696 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfd9ec-739f-444d-ba2c-1e3efbae6248 admin admin] PATH_INFO: `/v3/users/dda450b7e0cd41fab8c729d30f5e4500` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:03.500502 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfd9ec-739f-444d-ba2c-1e3efbae6248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dda450b7e0cd41fab8c729d30f5e4500)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:03.509279 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfd9ec-739f-444d-ba2c-1e3efbae6248 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:04.108747 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 952/1904] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:25:02 2022] DELETE /identity/v3/users/76a9b39b04874331924a0b2838f6a8ff => generated 0 bytes in 1483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:04.111789 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8104963-f630-4473-b006-beed15202591 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:04.112076 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8104963-f630-4473-b006-beed15202591 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:04.112346 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8104963-f630-4473-b006-beed15202591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:04.154113 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-a8104963-f630-4473-b006-beed15202591 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:04.156153 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-a8104963-f630-4473-b006-beed15202591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:04.184216 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-12cfd9ec-739f-444d-ba2c-1e3efbae6248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dda450b7e0cd41fab8c729d30f5e4500'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:04.255647 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 953/1905] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:25:04.267060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8104963-f630-4473-b006-beed15202591 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:04.269618 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-a8104963-f630-4473-b006-beed15202591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:04.277464 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-12cfd9ec-739f-444d-ba2c-1e3efbae6248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dda450b7e0cd41fab8c729d30f5e4500'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:04.288257 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-12cfd9ec-739f-444d-ba2c-1e3efbae6248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dda450b7e0cd41fab8c729d30f5e4500'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:04.305251 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-12cfd9ec-739f-444d-ba2c-1e3efbae6248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dda450b7e0cd41fab8c729d30f5e4500'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:04.306046 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-12cfd9ec-739f-444d-ba2c-1e3efbae6248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dda450b7e0cd41fab8c729d30f5e4500'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:04.326099 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 953/1906] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:25:03 2022] DELETE /identity/v3/users/dda450b7e0cd41fab8c729d30f5e4500 => generated 0 bytes in 965 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:04.354100 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8104963-f630-4473-b006-beed15202591 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:04.433012 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ab165-282f-45d6-be1f-d9b190f8f4cb None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:04.433635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ab165-282f-45d6-be1f-d9b190f8f4cb None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:04.434156 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146875b8-75e8-4393-bf08-369ab057110b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:04.434490 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146875b8-75e8-4393-bf08-369ab057110b service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:04.434774 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146875b8-75e8-4393-bf08-369ab057110b service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:04.435098 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146875b8-75e8-4393-bf08-369ab057110b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:04.435726 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ab165-282f-45d6-be1f-d9b190f8f4cb None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:04.436932 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-146875b8-75e8-4393-bf08-369ab057110b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:04.438164 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 954/1907] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 23 04:25:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 04:25:04.457488 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb2e5c-5e53-49f8-9e00-dd1f549e8a9e None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:04.458283 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb2e5c-5e53-49f8-9e00-dd1f549e8a9e None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:04.459101 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb2e5c-5e53-49f8-9e00-dd1f549e8a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:04.486997 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-38cb2e5c-5e53-49f8-9e00-dd1f549e8a9e None None] MFA Rules not processed for user `1e0236a0acac4b87be977878b5186551`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:04.488609 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-38cb2e5c-5e53-49f8-9e00-dd1f549e8a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:04.543594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146875b8-75e8-4393-bf08-369ab057110b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:04.545263 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146875b8-75e8-4393-bf08-369ab057110b service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:04.558155 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 954/1908] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:25:04.587840 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 955/1909] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 23 04:25:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:04.647061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146875b8-75e8-4393-bf08-369ab057110b service neutron] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:04.648833 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-146875b8-75e8-4393-bf08-369ab057110b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:04.690728 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146875b8-75e8-4393-bf08-369ab057110b service neutron] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:04.706234 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90432577-898b-462c-b5d9-5246d4a55e65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:04.707537 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90432577-898b-462c-b5d9-5246d4a55e65 service nova] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:04.707980 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90432577-898b-462c-b5d9-5246d4a55e65 service nova] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:04.708398 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90432577-898b-462c-b5d9-5246d4a55e65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:04.723747 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90432577-898b-462c-b5d9-5246d4a55e65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:04.725923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90432577-898b-462c-b5d9-5246d4a55e65 service nova] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:04.744502 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 955/1910] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:25:05.227599 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb2e5c-5e53-49f8-9e00-dd1f549e8a9e None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:05.228388 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-38cb2e5c-5e53-49f8-9e00-dd1f549e8a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:05.248927 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb2e5c-5e53-49f8-9e00-dd1f549e8a9e None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:05.254251 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51a8da-63c2-4985-af76-5db28802042f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:05.255160 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51a8da-63c2-4985-af76-5db28802042f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:05.255587 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51a8da-63c2-4985-af76-5db28802042f admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:05.256028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51a8da-63c2-4985-af76-5db28802042f admin admin] PATH_INFO: `/v3/projects/b1a5c110f2d54c0da20703428fba4318` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:05.258099 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51a8da-63c2-4985-af76-5db28802042f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1a5c110f2d54c0da20703428fba4318)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:05.260614 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51a8da-63c2-4985-af76-5db28802042f admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:05.312402 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90432577-898b-462c-b5d9-5246d4a55e65 service nova] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:05.314373 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-90432577-898b-462c-b5d9-5246d4a55e65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:05.336318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90432577-898b-462c-b5d9-5246d4a55e65 service nova] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:05.354670 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80c98a-e264-4d84-ae89-bc5e281ab678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:05.355546 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80c98a-e264-4d84-ae89-bc5e281ab678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:05.355962 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80c98a-e264-4d84-ae89-bc5e281ab678 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:05.356266 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80c98a-e264-4d84-ae89-bc5e281ab678 admin admin] PATH_INFO: `/v3/projects/fee2dd80a81e41b1bc249aabcfdf5c9e` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:05.357849 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80c98a-e264-4d84-ae89-bc5e281ab678 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fee2dd80a81e41b1bc249aabcfdf5c9e)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:05.359804 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80c98a-e264-4d84-ae89-bc5e281ab678 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:05.418774 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:05.456534 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-3f51a8da-63c2-4985-af76-5db28802042f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1a5c110f2d54c0da20703428fba4318', 'request_id': 'req-3f51a8da-63c2-4985-af76-5db28802042f'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:05.487988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-3f51a8da-63c2-4985-af76-5db28802042f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1a5c110f2d54c0da20703428fba4318', 'request_id': 'req-3f51a8da-63c2-4985-af76-5db28802042f'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:05.487988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-3f51a8da-63c2-4985-af76-5db28802042f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1a5c110f2d54c0da20703428fba4318', 'request_id': 'req-3f51a8da-63c2-4985-af76-5db28802042f'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:05.590389 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-1d80c98a-e264-4d84-ae89-bc5e281ab678 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fee2dd80a81e41b1bc249aabcfdf5c9e', 'request_id': 'req-1d80c98a-e264-4d84-ae89-bc5e281ab678'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:05.599960 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-1d80c98a-e264-4d84-ae89-bc5e281ab678 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fee2dd80a81e41b1bc249aabcfdf5c9e', 'request_id': 'req-1d80c98a-e264-4d84-ae89-bc5e281ab678'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:05.609133 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-1d80c98a-e264-4d84-ae89-bc5e281ab678 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fee2dd80a81e41b1bc249aabcfdf5c9e', 'request_id': 'req-1d80c98a-e264-4d84-ae89-bc5e281ab678'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:05.613443 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-3f51a8da-63c2-4985-af76-5db28802042f admin admin] The token cache is being invalidate because project b1a5c110f2d54c0da20703428fba4318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:25:05.613750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-3f51a8da-63c2-4985-af76-5db28802042f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:05.614432 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-3f51a8da-63c2-4985-af76-5db28802042f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:05.618922 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 956/1911] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:25:05 2022] DELETE /identity/v3/projects/b1a5c110f2d54c0da20703428fba4318 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:25:05.631705 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bb733-04cc-4bcf-b1c5-5e47d5a998f6 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:05.632018 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bb733-04cc-4bcf-b1c5-5e47d5a998f6 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:05.632409 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bb733-04cc-4bcf-b1c5-5e47d5a998f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:05.675077 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-c79bb733-04cc-4bcf-b1c5-5e47d5a998f6 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:05.676560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c79bb733-04cc-4bcf-b1c5-5e47d5a998f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:05.723446 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-1d80c98a-e264-4d84-ae89-bc5e281ab678 admin admin] The token cache is being invalidate because project fee2dd80a81e41b1bc249aabcfdf5c9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:25:05.723827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-1d80c98a-e264-4d84-ae89-bc5e281ab678 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:05.724506 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-1d80c98a-e264-4d84-ae89-bc5e281ab678 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:05.726107 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 956/1912] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:25:05 2022] DELETE /identity/v3/projects/fee2dd80a81e41b1bc249aabcfdf5c9e => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:05.731044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c09a20-d366-4fcf-8222-5e9a5cd5a8f5 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:05.731331 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c09a20-d366-4fcf-8222-5e9a5cd5a8f5 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:05.731608 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c09a20-d366-4fcf-8222-5e9a5cd5a8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:05.740967 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:05.743880 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 957/1913] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:05.755206 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-85c09a20-d366-4fcf-8222-5e9a5cd5a8f5 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:05.755788 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797e8d2-78f8-4fc9-a969-deef7020784a None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:05.756160 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797e8d2-78f8-4fc9-a969-deef7020784a None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:05.756340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-85c09a20-d366-4fcf-8222-5e9a5cd5a8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:05.756564 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797e8d2-78f8-4fc9-a969-deef7020784a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:05.765651 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 957/1914] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:25:05.773896 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4bfbe-7f3e-425d-bb75-8773cb8b3b76 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:05.774184 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4bfbe-7f3e-425d-bb75-8773cb8b3b76 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:05.774461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4bfbe-7f3e-425d-bb75-8773cb8b3b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:05.778657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-4797e8d2-78f8-4fc9-a969-deef7020784a None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:05.780057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-4797e8d2-78f8-4fc9-a969-deef7020784a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:05.788966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 958/1915] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:25:05.793310 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797e8d2-78f8-4fc9-a969-deef7020784a None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:05.793579 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-caf4bfbe-7f3e-425d-bb75-8773cb8b3b76 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:05.794841 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-caf4bfbe-7f3e-425d-bb75-8773cb8b3b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:05.802694 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797e8d2-78f8-4fc9-a969-deef7020784a None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:05.803450 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 958/1916] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:25:05.807414 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939336a-3808-45a2-b9ab-c87aae1295ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:05.807601 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4bfbe-7f3e-425d-bb75-8773cb8b3b76 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:05.808010 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939336a-3808-45a2-b9ab-c87aae1295ef admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:05.808289 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939336a-3808-45a2-b9ab-c87aae1295ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:05.808560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939336a-3808-45a2-b9ab-c87aae1295ef admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:05.809240 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939336a-3808-45a2-b9ab-c87aae1295ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:25:05.809545 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939336a-3808-45a2-b9ab-c87aae1295ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:05.811124 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939336a-3808-45a2-b9ab-c87aae1295ef admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:05.817474 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4bfbe-7f3e-425d-bb75-8773cb8b3b76 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:05.826257 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257e995-8a88-4743-96ee-a42fdd338371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:05.826257 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257e995-8a88-4743-96ee-a42fdd338371 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:05.826257 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257e995-8a88-4743-96ee-a42fdd338371 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:05.826560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 959/1917] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:25:05.826644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257e995-8a88-4743-96ee-a42fdd338371 admin admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:05.826644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257e995-8a88-4743-96ee-a42fdd338371 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:25:05.826644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257e995-8a88-4743-96ee-a42fdd338371 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:05.826644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257e995-8a88-4743-96ee-a42fdd338371 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:05.830035 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939336a-3808-45a2-b9ab-c87aae1295ef admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:05.839581 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939336a-3808-45a2-b9ab-c87aae1295ef admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:05.841259 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 959/1918] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:25:05.842945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257e995-8a88-4743-96ee-a42fdd338371 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:05.847618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c199995-5ec5-46d7-8065-350d34f546c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:05.848454 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c199995-5ec5-46d7-8065-350d34f546c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:05.852427 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c199995-5ec5-46d7-8065-350d34f546c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:05.852427 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c199995-5ec5-46d7-8065-350d34f546c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:05.852427 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c199995-5ec5-46d7-8065-350d34f546c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:05.852427 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c199995-5ec5-46d7-8065-350d34f546c9 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:05.862152 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257e995-8a88-4743-96ee-a42fdd338371 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:05.869350 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6bf81-369b-49bd-abea-43e2544b292c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:05.875337 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6bf81-369b-49bd-abea-43e2544b292c admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:05.875337 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6bf81-369b-49bd-abea-43e2544b292c admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:05.875337 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6bf81-369b-49bd-abea-43e2544b292c admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:05.875337 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6bf81-369b-49bd-abea-43e2544b292c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:05.875337 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6bf81-369b-49bd-abea-43e2544b292c admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:05.949144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 960/1919] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:25:05 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:25:05.951220 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c199995-5ec5-46d7-8065-350d34f546c9 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:06.027997 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c199995-5ec5-46d7-8065-350d34f546c9 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:06.033797 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de436992-08bb-4a7d-bcb2-f21da3b7dc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:06.034554 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de436992-08bb-4a7d-bcb2-f21da3b7dc48 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:06.034951 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de436992-08bb-4a7d-bcb2-f21da3b7dc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:06.035391 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de436992-08bb-4a7d-bcb2-f21da3b7dc48 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:06.038834 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 960/1920] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:25:05 2022] POST /identity/v3/projects => generated 369 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:25:06.038977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de436992-08bb-4a7d-bcb2-f21da3b7dc48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:06.038977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de436992-08bb-4a7d-bcb2-f21da3b7dc48 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:06.039858 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6bf81-369b-49bd-abea-43e2544b292c admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:06.130278 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6bf81-369b-49bd-abea-43e2544b292c admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:06.136765 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc27fb4-ed25-4953-9c9c-5d41acf6fdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:06.137439 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc27fb4-ed25-4953-9c9c-5d41acf6fdaa admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:06.137725 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc27fb4-ed25-4953-9c9c-5d41acf6fdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:06.138564 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc27fb4-ed25-4953-9c9c-5d41acf6fdaa admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:06.139437 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc27fb4-ed25-4953-9c9c-5d41acf6fdaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:06.142368 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc27fb4-ed25-4953-9c9c-5d41acf6fdaa admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:06.151548 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 961/1921] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:25:05 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:25:06.157134 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de436992-08bb-4a7d-bcb2-f21da3b7dc48 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:06.167685 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de436992-08bb-4a7d-bcb2-f21da3b7dc48 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:06.173805 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1eba12-4a77-4203-a37f-3a162668872a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:06.174707 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1eba12-4a77-4203-a37f-3a162668872a admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:06.175124 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1eba12-4a77-4203-a37f-3a162668872a admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:06.175610 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1eba12-4a77-4203-a37f-3a162668872a admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:06.176260 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1eba12-4a77-4203-a37f-3a162668872a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:06.177935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1eba12-4a77-4203-a37f-3a162668872a admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:06.190820 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 962/1922] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:25:06.195262 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1eba12-4a77-4203-a37f-3a162668872a admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:06.209390 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1eba12-4a77-4203-a37f-3a162668872a admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:06.220001 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8bd62-df2b-4363-972d-e22bbbeb19eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:06.221142 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8bd62-df2b-4363-972d-e22bbbeb19eb admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:06.221443 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8bd62-df2b-4363-972d-e22bbbeb19eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:06.221726 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8bd62-df2b-4363-972d-e22bbbeb19eb admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:06.222453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8bd62-df2b-4363-972d-e22bbbeb19eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:06.225064 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8bd62-df2b-4363-972d-e22bbbeb19eb admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:06.232924 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 961/1923] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:25:06 2022] POST /identity/v3/users => generated 285 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:25:06.238139 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc27fb4-ed25-4953-9c9c-5d41acf6fdaa admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:06.244714 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 963/1924] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:06.245686 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8bd62-df2b-4363-972d-e22bbbeb19eb admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:06.258161 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8bd62-df2b-4363-972d-e22bbbeb19eb admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:06.260558 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc27fb4-ed25-4953-9c9c-5d41acf6fdaa admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:06.265970 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b8e00-13db-4cc5-ab04-9d277bde64ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:06.266947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b8e00-13db-4cc5-ab04-9d277bde64ed admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:06.267252 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b8e00-13db-4cc5-ab04-9d277bde64ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:06.267521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b8e00-13db-4cc5-ab04-9d277bde64ed admin admin] PATH_INFO: `/v3/projects/3a53b411c67045b1af520e2d5a64e83d/users/5947b1299e95423c8a89b39961d42112/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:06.271326 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c2ec4-5eb7-4a43-9d1e-634e03492d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:06.273761 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c2ec4-5eb7-4a43-9d1e-634e03492d30 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:06.274099 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c2ec4-5eb7-4a43-9d1e-634e03492d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:06.274384 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c2ec4-5eb7-4a43-9d1e-634e03492d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:06.276144 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c2ec4-5eb7-4a43-9d1e-634e03492d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:06.279961 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c2ec4-5eb7-4a43-9d1e-634e03492d30 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:06.296178 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b8e00-13db-4cc5-ab04-9d277bde64ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a53b411c67045b1af520e2d5a64e83d, user_id=5947b1299e95423c8a89b39961d42112, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:06.298426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 962/1925] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:06.299805 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b8e00-13db-4cc5-ab04-9d277bde64ed admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:06.304920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c2ec4-5eb7-4a43-9d1e-634e03492d30 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:06.316324 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c2ec4-5eb7-4a43-9d1e-634e03492d30 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:06.321236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8b2df-9595-40c7-a29d-9175029a4f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:06.321854 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8b2df-9595-40c7-a29d-9175029a4f16 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:06.322140 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8b2df-9595-40c7-a29d-9175029a4f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:06.322417 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8b2df-9595-40c7-a29d-9175029a4f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:06.323073 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df8b2df-9595-40c7-a29d-9175029a4f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:06.324718 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df8b2df-9595-40c7-a29d-9175029a4f16 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:06.335915 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 963/1926] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:06.339718 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8b2df-9595-40c7-a29d-9175029a4f16 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:06.349548 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8b2df-9595-40c7-a29d-9175029a4f16 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:06.354360 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112ad6f-e624-4c3e-bf47-5b39751d962c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:06.355054 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112ad6f-e624-4c3e-bf47-5b39751d962c admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:06.355552 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112ad6f-e624-4c3e-bf47-5b39751d962c admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:06.355840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112ad6f-e624-4c3e-bf47-5b39751d962c admin admin] PATH_INFO: `/v3/projects/3485f2b7256e47d28e35dabf41c0794a/users/c19308868f0542baaa1a7bfb4f4b11e6/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:06.371984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112ad6f-e624-4c3e-bf47-5b39751d962c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3485f2b7256e47d28e35dabf41c0794a, user_id=c19308868f0542baaa1a7bfb4f4b11e6, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:06.374836 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112ad6f-e624-4c3e-bf47-5b39751d962c admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:06.459170 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 964/1927] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:06 2022] PUT /identity/v3/projects/3a53b411c67045b1af520e2d5a64e83d/users/5947b1299e95423c8a89b39961d42112/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:06.470737 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c8e18-0358-4ad3-a5f7-5f764c588d1c None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:06.471042 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c8e18-0358-4ad3-a5f7-5f764c588d1c None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:06.471295 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c8e18-0358-4ad3-a5f7-5f764c588d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:06.480499 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 964/1928] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:06 2022] PUT /identity/v3/projects/3485f2b7256e47d28e35dabf41c0794a/users/c19308868f0542baaa1a7bfb4f4b11e6/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:25:06.492740 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f28c1-ac4d-474f-ab4a-16521cdf8545 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:06.493033 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f28c1-ac4d-474f-ab4a-16521cdf8545 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:06.493344 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f28c1-ac4d-474f-ab4a-16521cdf8545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:06.504243 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-018c8e18-0358-4ad3-a5f7-5f764c588d1c None None] MFA Rules not processed for user `5947b1299e95423c8a89b39961d42112`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:06.505541 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-018c8e18-0358-4ad3-a5f7-5f764c588d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:06.528881 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-759f28c1-ac4d-474f-ab4a-16521cdf8545 None None] MFA Rules not processed for user `c19308868f0542baaa1a7bfb4f4b11e6`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:06.530333 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-759f28c1-ac4d-474f-ab4a-16521cdf8545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:06.581337 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 965/1929] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:06.611702 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 965/1930] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:25:06.629907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c8e18-0358-4ad3-a5f7-5f764c588d1c None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:06.631286 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-018c8e18-0358-4ad3-a5f7-5f764c588d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:06.659248 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f28c1-ac4d-474f-ab4a-16521cdf8545 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:06.661014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-759f28c1-ac4d-474f-ab4a-16521cdf8545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:06.732525 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c8e18-0358-4ad3-a5f7-5f764c588d1c None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:06.734796 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f28c1-ac4d-474f-ab4a-16521cdf8545 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:06.737438 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650afbd-9799-49be-8928-13a2153cf5e9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '020af86302e447a6b3973df4abbabafa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:06.738058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650afbd-9799-49be-8928-13a2153cf5e9 service glance] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:06.738390 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650afbd-9799-49be-8928-13a2153cf5e9 service glance] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:06.738633 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650afbd-9799-49be-8928-13a2153cf5e9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:06.740152 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba093167-4e0b-45fc-b94b-754219826792 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:06.741344 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba093167-4e0b-45fc-b94b-754219826792 service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:06.741736 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba093167-4e0b-45fc-b94b-754219826792 service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:06.741906 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba093167-4e0b-45fc-b94b-754219826792 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:06.747884 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650afbd-9799-49be-8928-13a2153cf5e9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:06.749371 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650afbd-9799-49be-8928-13a2153cf5e9 service glance] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:06.754620 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba093167-4e0b-45fc-b94b-754219826792 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:06.756343 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba093167-4e0b-45fc-b94b-754219826792 service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:06.758765 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 966/1931] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:25:06.766458 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 966/1932] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:25:06.790127 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650afbd-9799-49be-8928-13a2153cf5e9 service glance] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:06.876021 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650afbd-9799-49be-8928-13a2153cf5e9 service glance] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:06.880867 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb400192-ebeb-4075-8146-ef7016464f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:06.881551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb400192-ebeb-4075-8146-ef7016464f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:06.881965 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb400192-ebeb-4075-8146-ef7016464f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:06.882129 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb400192-ebeb-4075-8146-ef7016464f1d admin admin] PATH_INFO: `/v3/users/5947b1299e95423c8a89b39961d42112` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:06.884157 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb400192-ebeb-4075-8146-ef7016464f1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5947b1299e95423c8a89b39961d42112)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:06.885853 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb400192-ebeb-4075-8146-ef7016464f1d admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:06.947366 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba093167-4e0b-45fc-b94b-754219826792 service cinder] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:06.948937 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-ba093167-4e0b-45fc-b94b-754219826792 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:06.977287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba093167-4e0b-45fc-b94b-754219826792 service cinder] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:06.985067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:06.985886 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2ca2c-153b-4a63-9dc9-2433eb6d6948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:06.986868 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2ca2c-153b-4a63-9dc9-2433eb6d6948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:06.987410 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2ca2c-153b-4a63-9dc9-2433eb6d6948 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:06.987790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2ca2c-153b-4a63-9dc9-2433eb6d6948 admin admin] PATH_INFO: `/v3/users/a688c764791a47fbaad552af3ce9d8b9` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:06.989125 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e2ca2c-153b-4a63-9dc9-2433eb6d6948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a688c764791a47fbaad552af3ce9d8b9)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:06.991413 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e2ca2c-153b-4a63-9dc9-2433eb6d6948 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:07.049449 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-fb400192-ebeb-4075-8146-ef7016464f1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5947b1299e95423c8a89b39961d42112'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:07.116869 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-fb400192-ebeb-4075-8146-ef7016464f1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5947b1299e95423c8a89b39961d42112'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:07.124667 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-fb400192-ebeb-4075-8146-ef7016464f1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5947b1299e95423c8a89b39961d42112'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:07.136357 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-fb400192-ebeb-4075-8146-ef7016464f1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5947b1299e95423c8a89b39961d42112'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:07.137047 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-fb400192-ebeb-4075-8146-ef7016464f1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5947b1299e95423c8a89b39961d42112'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:07.143445 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 967/1933] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:25:06 2022] DELETE /identity/v3/users/5947b1299e95423c8a89b39961d42112 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:07.147973 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cc71a-e267-4601-a11d-44d2910fdc0a None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:07.148261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cc71a-e267-4601-a11d-44d2910fdc0a None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:07.148538 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cc71a-e267-4601-a11d-44d2910fdc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:07.167860 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-700cc71a-e267-4601-a11d-44d2910fdc0a None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:07.169048 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-700cc71a-e267-4601-a11d-44d2910fdc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:07.211720 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-f6e2ca2c-153b-4a63-9dc9-2433eb6d6948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a688c764791a47fbaad552af3ce9d8b9'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:07.212497 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-f6e2ca2c-153b-4a63-9dc9-2433eb6d6948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a688c764791a47fbaad552af3ce9d8b9'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:07.220486 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-f6e2ca2c-153b-4a63-9dc9-2433eb6d6948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a688c764791a47fbaad552af3ce9d8b9'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:07.221243 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-f6e2ca2c-153b-4a63-9dc9-2433eb6d6948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a688c764791a47fbaad552af3ce9d8b9'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:07.233981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-f6e2ca2c-153b-4a63-9dc9-2433eb6d6948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a688c764791a47fbaad552af3ce9d8b9'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:07.238214 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 968/1934] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:25:07.247890 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700cc71a-e267-4601-a11d-44d2910fdc0a None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:07.249303 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-700cc71a-e267-4601-a11d-44d2910fdc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:07.320491 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700cc71a-e267-4601-a11d-44d2910fdc0a None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:07.324098 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7351d59-dcce-43c0-b634-eaa84b998791 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:07.324728 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7351d59-dcce-43c0-b634-eaa84b998791 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:07.324999 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7351d59-dcce-43c0-b634-eaa84b998791 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:07.325306 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7351d59-dcce-43c0-b634-eaa84b998791 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:07.334801 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7351d59-dcce-43c0-b634-eaa84b998791 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:07.336222 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7351d59-dcce-43c0-b634-eaa84b998791 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:07.344815 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 967/1935] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:25:06 2022] DELETE /identity/v3/users/a688c764791a47fbaad552af3ce9d8b9 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:25:07.349390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c386cb-c4ad-449c-8237-09009c6e5f7a None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:07.349527 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 969/1936] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:25:07.349704 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c386cb-c4ad-449c-8237-09009c6e5f7a None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:07.350041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c386cb-c4ad-449c-8237-09009c6e5f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:07.372250 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-07c386cb-c4ad-449c-8237-09009c6e5f7a None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:07.372250 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-07c386cb-c4ad-449c-8237-09009c6e5f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:07.430693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 968/1937] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:25:07.442605 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7351d59-dcce-43c0-b634-eaa84b998791 service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:07.444388 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-d7351d59-dcce-43c0-b634-eaa84b998791 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:07.455996 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7351d59-dcce-43c0-b634-eaa84b998791 service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:07.464882 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:07.508184 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb83e0-7ae0-41a0-9044-73e130f2aab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:07.508850 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb83e0-7ae0-41a0-9044-73e130f2aab1 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:07.509273 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb83e0-7ae0-41a0-9044-73e130f2aab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:07.509548 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb83e0-7ae0-41a0-9044-73e130f2aab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:07.519633 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb83e0-7ae0-41a0-9044-73e130f2aab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:07.521423 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb83e0-7ae0-41a0-9044-73e130f2aab1 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:07.533984 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 970/1938] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:25:07.776245 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c386cb-c4ad-449c-8237-09009c6e5f7a None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:07.778329 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-07c386cb-c4ad-449c-8237-09009c6e5f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:07.795461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c386cb-c4ad-449c-8237-09009c6e5f7a None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:07.803042 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a9145-d828-4b2e-b261-fc17fe36d64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:07.803867 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a9145-d828-4b2e-b261-fc17fe36d64d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:07.804215 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a9145-d828-4b2e-b261-fc17fe36d64d admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:07.804577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a9145-d828-4b2e-b261-fc17fe36d64d admin admin] PATH_INFO: `/v3/projects/3a53b411c67045b1af520e2d5a64e83d` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:07.806129 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a9145-d828-4b2e-b261-fc17fe36d64d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a53b411c67045b1af520e2d5a64e83d)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:07.808173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a9145-d828-4b2e-b261-fc17fe36d64d admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:07.848215 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:07.988625 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-8d0a9145-d828-4b2e-b261-fc17fe36d64d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a53b411c67045b1af520e2d5a64e83d', 'request_id': 'req-8d0a9145-d828-4b2e-b261-fc17fe36d64d'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:08.003062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-8d0a9145-d828-4b2e-b261-fc17fe36d64d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a53b411c67045b1af520e2d5a64e83d', 'request_id': 'req-8d0a9145-d828-4b2e-b261-fc17fe36d64d'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:08.019761 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-8d0a9145-d828-4b2e-b261-fc17fe36d64d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a53b411c67045b1af520e2d5a64e83d', 'request_id': 'req-8d0a9145-d828-4b2e-b261-fc17fe36d64d'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:08.131958 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-8d0a9145-d828-4b2e-b261-fc17fe36d64d admin admin] The token cache is being invalidate because project 3a53b411c67045b1af520e2d5a64e83d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:25:08.132255 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-8d0a9145-d828-4b2e-b261-fc17fe36d64d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:08.132894 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-8d0a9145-d828-4b2e-b261-fc17fe36d64d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:08.134456 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 969/1939] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:25:07 2022] DELETE /identity/v3/projects/3a53b411c67045b1af520e2d5a64e83d => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:08.139456 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb4b80-6241-49b7-b81a-2b01a650fa21 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:08.139944 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb4b80-6241-49b7-b81a-2b01a650fa21 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:08.140343 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb4b80-6241-49b7-b81a-2b01a650fa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:08.162362 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a9145-d828-4b2e-b261-fc17fe36d64d admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:08.164163 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-8d0a9145-d828-4b2e-b261-fc17fe36d64d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:08.191881 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-ffcb4b80-6241-49b7-b81a-2b01a650fa21 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:08.194811 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-ffcb4b80-6241-49b7-b81a-2b01a650fa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:08.292329 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 971/1940] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:08.304072 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6674f42-964c-4d15-84d2-c12b2445978a None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:08.304389 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6674f42-964c-4d15-84d2-c12b2445978a None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:08.304674 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6674f42-964c-4d15-84d2-c12b2445978a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:08.311852 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a9145-d828-4b2e-b261-fc17fe36d64d admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:08.311852 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb286d-4615-404b-b29b-9ffd16d3474a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:08.312350 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb286d-4615-404b-b29b-9ffd16d3474a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:08.312641 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb286d-4615-404b-b29b-9ffd16d3474a admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:08.313032 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb286d-4615-404b-b29b-9ffd16d3474a admin admin] PATH_INFO: `/v3/projects/a1ec800c9d0f471e84e5b003f7f9f967` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:08.314273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb286d-4615-404b-b29b-9ffd16d3474a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1ec800c9d0f471e84e5b003f7f9f967)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:08.316499 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb286d-4615-404b-b29b-9ffd16d3474a admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:08.330508 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-c6674f42-964c-4d15-84d2-c12b2445978a None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:08.341359 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c6674f42-964c-4d15-84d2-c12b2445978a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:08.354949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 972/1941] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:08.359922 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6674f42-964c-4d15-84d2-c12b2445978a None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:08.377268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6674f42-964c-4d15-84d2-c12b2445978a None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:08.379398 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b554f42-a6c3-4b88-94ee-c60beb877f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:08.380059 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b554f42-a6c3-4b88-94ee-c60beb877f44 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:08.380347 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b554f42-a6c3-4b88-94ee-c60beb877f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:08.380629 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b554f42-a6c3-4b88-94ee-c60beb877f44 admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:08.381329 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b554f42-a6c3-4b88-94ee-c60beb877f44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:25:08.381642 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b554f42-a6c3-4b88-94ee-c60beb877f44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:08.383385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b554f42-a6c3-4b88-94ee-c60beb877f44 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:08.401440 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 973/1942] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:25:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:25:08.402529 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b554f42-a6c3-4b88-94ee-c60beb877f44 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:08.414908 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b554f42-a6c3-4b88-94ee-c60beb877f44 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:08.420478 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f30f6-190c-40cf-82f9-d3ccd6fa7248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:08.421330 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f30f6-190c-40cf-82f9-d3ccd6fa7248 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:08.421601 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f30f6-190c-40cf-82f9-d3ccd6fa7248 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:08.422082 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f30f6-190c-40cf-82f9-d3ccd6fa7248 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:08.422974 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f30f6-190c-40cf-82f9-d3ccd6fa7248 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:08.425175 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f30f6-190c-40cf-82f9-d3ccd6fa7248 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:08.467434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:08.493404 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-0ccb286d-4615-404b-b29b-9ffd16d3474a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1ec800c9d0f471e84e5b003f7f9f967', 'request_id': 'req-0ccb286d-4615-404b-b29b-9ffd16d3474a'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:08.502318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-0ccb286d-4615-404b-b29b-9ffd16d3474a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1ec800c9d0f471e84e5b003f7f9f967', 'request_id': 'req-0ccb286d-4615-404b-b29b-9ffd16d3474a'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:08.523899 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-0ccb286d-4615-404b-b29b-9ffd16d3474a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1ec800c9d0f471e84e5b003f7f9f967', 'request_id': 'req-0ccb286d-4615-404b-b29b-9ffd16d3474a'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:08.543041 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 974/1943] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:25:08 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:25:08.553404 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f30f6-190c-40cf-82f9-d3ccd6fa7248 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:08.634039 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-0ccb286d-4615-404b-b29b-9ffd16d3474a admin admin] The token cache is being invalidate because project a1ec800c9d0f471e84e5b003f7f9f967 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:25:08.634337 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-0ccb286d-4615-404b-b29b-9ffd16d3474a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:08.634564 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f30f6-190c-40cf-82f9-d3ccd6fa7248 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:08.637147 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-0ccb286d-4615-404b-b29b-9ffd16d3474a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:08.642450 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 970/1944] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:25:08 2022] DELETE /identity/v3/projects/a1ec800c9d0f471e84e5b003f7f9f967 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:08.643820 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb286d-4615-404b-b29b-9ffd16d3474a admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:08.645661 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-0ccb286d-4615-404b-b29b-9ffd16d3474a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:08.650211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02abfa-a380-4549-97d7-5f2b4a9f3877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:08.656603 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02abfa-a380-4549-97d7-5f2b4a9f3877 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:08.656603 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02abfa-a380-4549-97d7-5f2b4a9f3877 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:08.656603 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02abfa-a380-4549-97d7-5f2b4a9f3877 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:08.656603 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02abfa-a380-4549-97d7-5f2b4a9f3877 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:08.656603 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02abfa-a380-4549-97d7-5f2b4a9f3877 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:08.758733 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb286d-4615-404b-b29b-9ffd16d3474a admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:08.776646 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3992c0f-336e-468e-9c48-a609e9692ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:08.777342 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3992c0f-336e-468e-9c48-a609e9692ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:08.777628 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3992c0f-336e-468e-9c48-a609e9692ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:08.777912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3992c0f-336e-468e-9c48-a609e9692ac2 admin admin] PATH_INFO: `/v3/users/acd6bc6adea34fe1b4cd36654e5c9623` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:08.779081 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3992c0f-336e-468e-9c48-a609e9692ac2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acd6bc6adea34fe1b4cd36654e5c9623)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:08.781100 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3992c0f-336e-468e-9c48-a609e9692ac2 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:08.817465 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 975/1945] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:25:08 2022] POST /identity/v3/users => generated 289 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:25:08.821534 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02abfa-a380-4549-97d7-5f2b4a9f3877 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:08.825664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-cc02abfa-a380-4549-97d7-5f2b4a9f3877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:08.844248 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02abfa-a380-4549-97d7-5f2b4a9f3877 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:08.867388 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2246417-b25f-4465-a464-f9321dd498ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:08.868217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2246417-b25f-4465-a464-f9321dd498ba admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:08.868509 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2246417-b25f-4465-a464-f9321dd498ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:08.868829 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2246417-b25f-4465-a464-f9321dd498ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:08.869517 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2246417-b25f-4465-a464-f9321dd498ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:08.871134 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2246417-b25f-4465-a464-f9321dd498ba admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:08.881842 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 976/1946] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:25:08.893685 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2246417-b25f-4465-a464-f9321dd498ba admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:08.910401 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:08.913958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2246417-b25f-4465-a464-f9321dd498ba admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:08.918882 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445373d-182c-41e3-83d5-3e4f80005ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:08.919498 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445373d-182c-41e3-83d5-3e4f80005ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:08.919781 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445373d-182c-41e3-83d5-3e4f80005ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:08.920058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445373d-182c-41e3-83d5-3e4f80005ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:08.920712 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445373d-182c-41e3-83d5-3e4f80005ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:08.922500 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445373d-182c-41e3-83d5-3e4f80005ee4 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:08.934374 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 977/1947] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:25:08.949867 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445373d-182c-41e3-83d5-3e4f80005ee4 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:08.961852 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445373d-182c-41e3-83d5-3e4f80005ee4 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:08.971719 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88683108-86bb-40b8-9d7e-26454acfa392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:08.976129 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88683108-86bb-40b8-9d7e-26454acfa392 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:08.976651 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88683108-86bb-40b8-9d7e-26454acfa392 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:08.977181 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88683108-86bb-40b8-9d7e-26454acfa392 admin admin] PATH_INFO: `/v3/projects/ea18a68ecd8d4cef87ecc74384b38250/users/70e8097f04db49448231882ceb58ee5a/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:08.996297 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88683108-86bb-40b8-9d7e-26454acfa392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea18a68ecd8d4cef87ecc74384b38250, user_id=70e8097f04db49448231882ceb58ee5a, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:08.999505 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88683108-86bb-40b8-9d7e-26454acfa392 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:09.051225 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:09.051964 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-f3992c0f-336e-468e-9c48-a609e9692ac2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acd6bc6adea34fe1b4cd36654e5c9623'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:09.052747 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-f3992c0f-336e-468e-9c48-a609e9692ac2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acd6bc6adea34fe1b4cd36654e5c9623'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:09.061392 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-f3992c0f-336e-468e-9c48-a609e9692ac2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acd6bc6adea34fe1b4cd36654e5c9623'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:09.062226 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-f3992c0f-336e-468e-9c48-a609e9692ac2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acd6bc6adea34fe1b4cd36654e5c9623'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:09.092063 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-f3992c0f-336e-468e-9c48-a609e9692ac2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acd6bc6adea34fe1b4cd36654e5c9623'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:09.100438 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 978/1948] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:08 2022] PUT /identity/v3/projects/ea18a68ecd8d4cef87ecc74384b38250/users/70e8097f04db49448231882ceb58ee5a/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:09.111257 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d499b4-ac60-4c3a-a7f8-5c2344b12919 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:09.111548 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d499b4-ac60-4c3a-a7f8-5c2344b12919 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:09.111801 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d499b4-ac60-4c3a-a7f8-5c2344b12919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:09.142386 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-81d499b4-ac60-4c3a-a7f8-5c2344b12919 None None] MFA Rules not processed for user `70e8097f04db49448231882ceb58ee5a`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:09.143720 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-81d499b4-ac60-4c3a-a7f8-5c2344b12919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:09.203722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 971/1949] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:25:08 2022] DELETE /identity/v3/users/acd6bc6adea34fe1b4cd36654e5c9623 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:09.213400 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 979/1950] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:09.218287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3992c0f-336e-468e-9c48-a609e9692ac2 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:09.220835 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-f3992c0f-336e-468e-9c48-a609e9692ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:09.309171 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3992c0f-336e-468e-9c48-a609e9692ac2 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:09.314773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671e2dc-12e7-4237-922e-2afe571a4722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:09.315286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671e2dc-12e7-4237-922e-2afe571a4722 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:09.315574 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671e2dc-12e7-4237-922e-2afe571a4722 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:09.316168 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671e2dc-12e7-4237-922e-2afe571a4722 admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:09.317072 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671e2dc-12e7-4237-922e-2afe571a4722 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:09.318648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671e2dc-12e7-4237-922e-2afe571a4722 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:09.433783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 972/1951] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:25:09 2022] POST /identity/v3/projects => generated 373 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:25:09.437973 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d499b4-ac60-4c3a-a7f8-5c2344b12919 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:09.518282 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d499b4-ac60-4c3a-a7f8-5c2344b12919 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:09.580466 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138472a-6d4f-43ea-bbc4-c8f8554da8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:09.581166 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138472a-6d4f-43ea-bbc4-c8f8554da8e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:09.581560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138472a-6d4f-43ea-bbc4-c8f8554da8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:09.581869 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138472a-6d4f-43ea-bbc4-c8f8554da8e6 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:09.582519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138472a-6d4f-43ea-bbc4-c8f8554da8e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:09.589185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138472a-6d4f-43ea-bbc4-c8f8554da8e6 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:09.702351 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 980/1952] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:25:09 2022] POST /identity/v3/users => generated 287 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:25:09.704622 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671e2dc-12e7-4237-922e-2afe571a4722 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:09.715022 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671e2dc-12e7-4237-922e-2afe571a4722 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:09.719749 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa594e-a4b0-4ffe-8869-1caba140572d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:09.720442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa594e-a4b0-4ffe-8869-1caba140572d admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:09.720732 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa594e-a4b0-4ffe-8869-1caba140572d admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:09.721057 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa594e-a4b0-4ffe-8869-1caba140572d admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:09.721748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa594e-a4b0-4ffe-8869-1caba140572d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:09.723416 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa594e-a4b0-4ffe-8869-1caba140572d admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:09.735031 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 973/1953] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:09.738904 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138472a-6d4f-43ea-bbc4-c8f8554da8e6 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:09.749115 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138472a-6d4f-43ea-bbc4-c8f8554da8e6 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:09.754583 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c8b29-bfda-431d-869e-5068adc689c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:09.755161 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c8b29-bfda-431d-869e-5068adc689c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:09.755469 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c8b29-bfda-431d-869e-5068adc689c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:09.755769 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c8b29-bfda-431d-869e-5068adc689c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:09.757781 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c8b29-bfda-431d-869e-5068adc689c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:09.763930 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c8b29-bfda-431d-869e-5068adc689c2 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:09.767532 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa594e-a4b0-4ffe-8869-1caba140572d admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:09.770133 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-a9aa594e-a4b0-4ffe-8869-1caba140572d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:09.782711 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 981/1954] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:09.787151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c8b29-bfda-431d-869e-5068adc689c2 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:09.793849 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa594e-a4b0-4ffe-8869-1caba140572d admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:09.797765 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c8b29-bfda-431d-869e-5068adc689c2 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:09.801710 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b0cfb-2738-4533-9381-f366b9c83087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:09.802433 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b0cfb-2738-4533-9381-f366b9c83087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:09.802681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054f38e-91ed-4f35-9077-1a3c98836c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:09.802823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b0cfb-2738-4533-9381-f366b9c83087 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:09.803232 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b0cfb-2738-4533-9381-f366b9c83087 admin admin] PATH_INFO: `/v3/projects/0e75d100459748a3b0ae7e8f0004862e` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:09.803339 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054f38e-91ed-4f35-9077-1a3c98836c59 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:09.803608 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054f38e-91ed-4f35-9077-1a3c98836c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:09.803959 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054f38e-91ed-4f35-9077-1a3c98836c59 admin admin] PATH_INFO: `/v3/projects/0e6e09fbc90341829b9bb0fb95a66601/users/4575662a410247af81e11a160ca198a0/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:09.805188 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b0cfb-2738-4533-9381-f366b9c83087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e75d100459748a3b0ae7e8f0004862e)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:09.807796 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b0cfb-2738-4533-9381-f366b9c83087 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:09.820662 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054f38e-91ed-4f35-9077-1a3c98836c59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e6e09fbc90341829b9bb0fb95a66601, user_id=4575662a410247af81e11a160ca198a0, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:09.823496 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054f38e-91ed-4f35-9077-1a3c98836c59 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:09.936201 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 982/1955] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:09 2022] PUT /identity/v3/projects/0e6e09fbc90341829b9bb0fb95a66601/users/4575662a410247af81e11a160ca198a0/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:09.950772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a8b16-0ffb-4a93-b036-d4dc5015ed05 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:09.951086 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a8b16-0ffb-4a93-b036-d4dc5015ed05 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:09.951370 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a8b16-0ffb-4a93-b036-d4dc5015ed05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:09.965361 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-e79b0cfb-2738-4533-9381-f366b9c83087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e75d100459748a3b0ae7e8f0004862e', 'request_id': 'req-e79b0cfb-2738-4533-9381-f366b9c83087'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:09.974442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-e79b0cfb-2738-4533-9381-f366b9c83087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e75d100459748a3b0ae7e8f0004862e', 'request_id': 'req-e79b0cfb-2738-4533-9381-f366b9c83087'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:09.982460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:09.983917 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-e79b0cfb-2738-4533-9381-f366b9c83087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e75d100459748a3b0ae7e8f0004862e', 'request_id': 'req-e79b0cfb-2738-4533-9381-f366b9c83087'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:09.990153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-945a8b16-0ffb-4a93-b036-d4dc5015ed05 None None] MFA Rules not processed for user `4575662a410247af81e11a160ca198a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:09.991400 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-945a8b16-0ffb-4a93-b036-d4dc5015ed05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:10.061134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-e79b0cfb-2738-4533-9381-f366b9c83087 admin admin] The token cache is being invalidate because project 0e75d100459748a3b0ae7e8f0004862e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:25:10.061134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-e79b0cfb-2738-4533-9381-f366b9c83087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:10.061134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-e79b0cfb-2738-4533-9381-f366b9c83087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:10.062792 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 974/1956] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:25:09 2022] DELETE /identity/v3/projects/0e75d100459748a3b0ae7e8f0004862e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:25:10.068729 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1492ed4-a651-4754-843f-030c8db18db6 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:10.069397 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1492ed4-a651-4754-843f-030c8db18db6 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:10.069837 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1492ed4-a651-4754-843f-030c8db18db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:10.101355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 983/1957] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:10.110566 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a8b16-0ffb-4a93-b036-d4dc5015ed05 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:10.113059 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:10.116320 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-945a8b16-0ffb-4a93-b036-d4dc5015ed05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:10.121414 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-c1492ed4-a651-4754-843f-030c8db18db6 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:10.123222 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-c1492ed4-a651-4754-843f-030c8db18db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:10.214260 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 975/1958] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:25:10.219554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b763c-a8c2-4c77-9e12-10729f40d839 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:10.219851 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b763c-a8c2-4c77-9e12-10729f40d839 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:10.220185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b763c-a8c2-4c77-9e12-10729f40d839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:10.221503 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a8b16-0ffb-4a93-b036-d4dc5015ed05 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:10.226518 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b6c03-b731-43da-a23e-15449e9f225c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:10.227266 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b6c03-b731-43da-a23e-15449e9f225c admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:10.230510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b6c03-b731-43da-a23e-15449e9f225c admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:10.230510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b6c03-b731-43da-a23e-15449e9f225c admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:10.230510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b6c03-b731-43da-a23e-15449e9f225c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:10.230510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b6c03-b731-43da-a23e-15449e9f225c admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:10.240675 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-b80b763c-a8c2-4c77-9e12-10729f40d839 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:10.241911 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-b80b763c-a8c2-4c77-9e12-10729f40d839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:10.250278 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 976/1959] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:10.254857 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b763c-a8c2-4c77-9e12-10729f40d839 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:10.264351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b763c-a8c2-4c77-9e12-10729f40d839 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:10.269611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090c3cf-77e8-4af9-a992-2216a36d684e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:10.270242 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090c3cf-77e8-4af9-a992-2216a36d684e admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:10.270528 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090c3cf-77e8-4af9-a992-2216a36d684e admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:10.270941 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090c3cf-77e8-4af9-a992-2216a36d684e admin admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:10.271514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090c3cf-77e8-4af9-a992-2216a36d684e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:25:10.271831 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090c3cf-77e8-4af9-a992-2216a36d684e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:10.273641 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090c3cf-77e8-4af9-a992-2216a36d684e admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:10.287473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 977/1960] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:25:10.291911 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090c3cf-77e8-4af9-a992-2216a36d684e admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:10.303045 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090c3cf-77e8-4af9-a992-2216a36d684e admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:10.307943 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35737227-2ae8-4fc8-bf03-22c1a47a0989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:10.308582 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35737227-2ae8-4fc8-bf03-22c1a47a0989 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:10.308862 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35737227-2ae8-4fc8-bf03-22c1a47a0989 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:10.309186 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35737227-2ae8-4fc8-bf03-22c1a47a0989 admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:10.309815 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35737227-2ae8-4fc8-bf03-22c1a47a0989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:10.311723 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35737227-2ae8-4fc8-bf03-22c1a47a0989 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:10.333112 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 984/1961] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:25:10 2022] POST /identity/v3/projects => generated 377 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:25:10.335005 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b6c03-b731-43da-a23e-15449e9f225c admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:10.400461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 978/1962] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:25:10 2022] POST /identity/v3/projects => generated 389 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:25:10.405302 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35737227-2ae8-4fc8-bf03-22c1a47a0989 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:10.444936 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b6c03-b731-43da-a23e-15449e9f225c admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:10.539993 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bab8a-0442-40e5-ad1c-c45fca367255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:10.540782 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bab8a-0442-40e5-ad1c-c45fca367255 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:10.541190 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bab8a-0442-40e5-ad1c-c45fca367255 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:10.541560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bab8a-0442-40e5-ad1c-c45fca367255 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:10.542355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3bab8a-0442-40e5-ad1c-c45fca367255 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:10.544635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3bab8a-0442-40e5-ad1c-c45fca367255 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:10.551500 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35737227-2ae8-4fc8-bf03-22c1a47a0989 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:10.556973 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46da8ee-04cc-4460-affe-e3dffd89702a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:10.557681 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46da8ee-04cc-4460-affe-e3dffd89702a admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:10.557962 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46da8ee-04cc-4460-affe-e3dffd89702a admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:10.558519 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46da8ee-04cc-4460-affe-e3dffd89702a admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:10.558960 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46da8ee-04cc-4460-affe-e3dffd89702a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:10.561383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46da8ee-04cc-4460-affe-e3dffd89702a admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:10.614910 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:10.639856 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 985/1963] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:25:10 2022] POST /identity/v3/users => generated 295 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:25:10.648141 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bab8a-0442-40e5-ad1c-c45fca367255 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:10.660534 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bab8a-0442-40e5-ad1c-c45fca367255 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:10.663147 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 979/1964] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:25:10 2022] POST /identity/v3/users => generated 295 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:25:10.666356 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46da8ee-04cc-4460-affe-e3dffd89702a admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:10.668000 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283f903-1448-4a25-8807-0ae0d6b00fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:10.668719 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283f903-1448-4a25-8807-0ae0d6b00fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:10.669253 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283f903-1448-4a25-8807-0ae0d6b00fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:10.670058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283f903-1448-4a25-8807-0ae0d6b00fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:10.671425 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283f903-1448-4a25-8807-0ae0d6b00fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:10.674152 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283f903-1448-4a25-8807-0ae0d6b00fd9 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:10.689151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 986/1965] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:25:10.691849 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283f903-1448-4a25-8807-0ae0d6b00fd9 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:10.695206 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46da8ee-04cc-4460-affe-e3dffd89702a admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:10.698668 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160b1f5-d8cc-44b3-80ba-2b09452245ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:10.699308 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160b1f5-d8cc-44b3-80ba-2b09452245ca admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:10.699592 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160b1f5-d8cc-44b3-80ba-2b09452245ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:10.699869 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160b1f5-d8cc-44b3-80ba-2b09452245ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:10.700531 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a160b1f5-d8cc-44b3-80ba-2b09452245ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:10.702390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a160b1f5-d8cc-44b3-80ba-2b09452245ca admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:10.706476 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283f903-1448-4a25-8807-0ae0d6b00fd9 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:10.712298 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0c730-ae43-4358-9edb-9b80b71a570c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:10.712958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0c730-ae43-4358-9edb-9b80b71a570c admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:10.713268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0c730-ae43-4358-9edb-9b80b71a570c admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:10.713489 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 980/1966] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:25:10.713976 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0c730-ae43-4358-9edb-9b80b71a570c admin admin] PATH_INFO: `/v3/projects/da6cee4f92a54714b96ca33f738ac6a5/users/549fffc55a8b48faa811cf4d06009c42/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:10.717815 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160b1f5-d8cc-44b3-80ba-2b09452245ca admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:10.730539 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160b1f5-d8cc-44b3-80ba-2b09452245ca admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:10.732893 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d0c730-ae43-4358-9edb-9b80b71a570c admin admin] RBAC: Authorizing `identity:create_grant(project_id=da6cee4f92a54714b96ca33f738ac6a5, user_id=549fffc55a8b48faa811cf4d06009c42, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:10.735721 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e4237-6c97-4d0f-b470-8a6a21ac7681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:10.736338 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e4237-6c97-4d0f-b470-8a6a21ac7681 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:10.736620 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e4237-6c97-4d0f-b470-8a6a21ac7681 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:10.736844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d0c730-ae43-4358-9edb-9b80b71a570c admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:10.736973 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e4237-6c97-4d0f-b470-8a6a21ac7681 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:10.737655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e4237-6c97-4d0f-b470-8a6a21ac7681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:10.739275 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e4237-6c97-4d0f-b470-8a6a21ac7681 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:10.753921 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 981/1967] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:25:10.755113 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e4237-6c97-4d0f-b470-8a6a21ac7681 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:10.767005 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e4237-6c97-4d0f-b470-8a6a21ac7681 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:10.773726 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ec7c9-5dd9-4390-aa3c-b1b36e75754a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:10.774544 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ec7c9-5dd9-4390-aa3c-b1b36e75754a admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:10.777384 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ec7c9-5dd9-4390-aa3c-b1b36e75754a admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:10.777384 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ec7c9-5dd9-4390-aa3c-b1b36e75754a admin admin] PATH_INFO: `/v3/projects/83577f4f769a40e996272f93af83e7fa/users/d70af2a335ff4472873373a3c0c12c9c/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:10.792628 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ec7c9-5dd9-4390-aa3c-b1b36e75754a admin admin] RBAC: Authorizing `identity:create_grant(project_id=83577f4f769a40e996272f93af83e7fa, user_id=d70af2a335ff4472873373a3c0c12c9c, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:10.795479 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ec7c9-5dd9-4390-aa3c-b1b36e75754a admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:10.808985 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 987/1968] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:10 2022] PUT /identity/v3/projects/da6cee4f92a54714b96ca33f738ac6a5/users/549fffc55a8b48faa811cf4d06009c42/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:25:10.812374 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0c730-ae43-4358-9edb-9b80b71a570c admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:10.876313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 982/1969] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:10 2022] PUT /identity/v3/projects/83577f4f769a40e996272f93af83e7fa/users/d70af2a335ff4472873373a3c0c12c9c/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:10.890754 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702ec4f-477b-4ea7-8e69-8834f8d1597e None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:10.891004 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702ec4f-477b-4ea7-8e69-8834f8d1597e None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:10.891871 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702ec4f-477b-4ea7-8e69-8834f8d1597e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:10.910893 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0c730-ae43-4358-9edb-9b80b71a570c admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:10.928118 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-7702ec4f-477b-4ea7-8e69-8834f8d1597e None None] MFA Rules not processed for user `d70af2a335ff4472873373a3c0c12c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:10.929887 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-7702ec4f-477b-4ea7-8e69-8834f8d1597e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:10.947635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:10.982357 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d291cd6-f5af-41dd-a710-ccd8476c1012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:10.983025 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d291cd6-f5af-41dd-a710-ccd8476c1012 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:10.983593 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d291cd6-f5af-41dd-a710-ccd8476c1012 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:10.983877 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d291cd6-f5af-41dd-a710-ccd8476c1012 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:10.984533 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d291cd6-f5af-41dd-a710-ccd8476c1012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:10.986317 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d291cd6-f5af-41dd-a710-ccd8476c1012 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:10.997852 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 988/1970] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:11.003295 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d291cd6-f5af-41dd-a710-ccd8476c1012 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:11.018050 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d291cd6-f5af-41dd-a710-ccd8476c1012 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:11.027771 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371a5f6-d00d-487b-ba10-954ae68b641b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:11.028457 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371a5f6-d00d-487b-ba10-954ae68b641b admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:11.028748 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371a5f6-d00d-487b-ba10-954ae68b641b admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:11.029173 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371a5f6-d00d-487b-ba10-954ae68b641b admin admin] PATH_INFO: `/v3/projects/da6cee4f92a54714b96ca33f738ac6a5/users/549fffc55a8b48faa811cf4d06009c42/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:11.031024 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371a5f6-d00d-487b-ba10-954ae68b641b admin admin] RBAC: Authorizing `identity:create_grant(project_id=da6cee4f92a54714b96ca33f738ac6a5, user_id=549fffc55a8b48faa811cf4d06009c42, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:11.033885 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371a5f6-d00d-487b-ba10-954ae68b641b admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:11.040739 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 983/1971] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:11.045329 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702ec4f-477b-4ea7-8e69-8834f8d1597e None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:11.047161 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 989/1972] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:11 2022] PUT /identity/v3/projects/da6cee4f92a54714b96ca33f738ac6a5/users/549fffc55a8b48faa811cf4d06009c42/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:11.058036 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82499ecf-261f-40d7-8f09-7c6dd789275f None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:11.058181 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702ec4f-477b-4ea7-8e69-8834f8d1597e None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:11.058789 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82499ecf-261f-40d7-8f09-7c6dd789275f None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:11.059126 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82499ecf-261f-40d7-8f09-7c6dd789275f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:11.094011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-82499ecf-261f-40d7-8f09-7c6dd789275f None None] MFA Rules not processed for user `549fffc55a8b48faa811cf4d06009c42`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:11.098621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-82499ecf-261f-40d7-8f09-7c6dd789275f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:11.152291 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c704ca-7660-482e-b1b7-780f4c51040e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:11.152972 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c704ca-7660-482e-b1b7-780f4c51040e admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:11.153297 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c704ca-7660-482e-b1b7-780f4c51040e admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:11.153571 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c704ca-7660-482e-b1b7-780f4c51040e admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:11.154199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c704ca-7660-482e-b1b7-780f4c51040e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:11.156195 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c704ca-7660-482e-b1b7-780f4c51040e admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:11.192808 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 990/1973] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:25:11.202046 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82499ecf-261f-40d7-8f09-7c6dd789275f None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:11.203646 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-82499ecf-261f-40d7-8f09-7c6dd789275f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:11.260876 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 984/1974] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:25:11 2022] POST /identity/v3/projects => generated 387 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:25:11.265526 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c704ca-7660-482e-b1b7-780f4c51040e admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:11.271298 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82499ecf-261f-40d7-8f09-7c6dd789275f None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:11.324715 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513770e5-e1e6-4f1e-8d3a-02e512cd387a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:11.325419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513770e5-e1e6-4f1e-8d3a-02e512cd387a service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:11.325806 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513770e5-e1e6-4f1e-8d3a-02e512cd387a service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:11.326084 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513770e5-e1e6-4f1e-8d3a-02e512cd387a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:11.327890 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-513770e5-e1e6-4f1e-8d3a-02e512cd387a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:11.337227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c704ca-7660-482e-b1b7-780f4c51040e admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:11.341892 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebccbf1-c172-454d-ad69-549dd4875900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:11.342506 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebccbf1-c172-454d-ad69-549dd4875900 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:11.346559 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebccbf1-c172-454d-ad69-549dd4875900 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:11.346889 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebccbf1-c172-454d-ad69-549dd4875900 admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:11.347569 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebccbf1-c172-454d-ad69-549dd4875900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:11.349581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebccbf1-c172-454d-ad69-549dd4875900 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:11.388285 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513770e5-e1e6-4f1e-8d3a-02e512cd387a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:11.389765 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513770e5-e1e6-4f1e-8d3a-02e512cd387a service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:11.398677 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 991/1975] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:25:11.478247 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 985/1976] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:25:11 2022] POST /identity/v3/users => generated 300 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:25:11.484171 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:11.484849 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513770e5-e1e6-4f1e-8d3a-02e512cd387a service cinder] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:11.496097 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513770e5-e1e6-4f1e-8d3a-02e512cd387a service cinder] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:11.502458 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b96cbe-6d8c-4249-a376-8b3feaa2a007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:11.502982 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b96cbe-6d8c-4249-a376-8b3feaa2a007 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:11.503349 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b96cbe-6d8c-4249-a376-8b3feaa2a007 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:11.503528 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b96cbe-6d8c-4249-a376-8b3feaa2a007 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:11.504656 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b96cbe-6d8c-4249-a376-8b3feaa2a007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:11.506156 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b96cbe-6d8c-4249-a376-8b3feaa2a007 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:11.520286 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 992/1977] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:25:11.524913 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebccbf1-c172-454d-ad69-549dd4875900 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:11.535840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebccbf1-c172-454d-ad69-549dd4875900 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:11.540925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ff915-a6ab-4343-952d-68fe1a13f110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:11.541711 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ff915-a6ab-4343-952d-68fe1a13f110 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:11.542060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ff915-a6ab-4343-952d-68fe1a13f110 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:11.542409 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ff915-a6ab-4343-952d-68fe1a13f110 admin admin] PATH_INFO: `/v3/projects/4372763087d742c1a3b8fceb15cfef5a/users/d80db5690b894a3d82e6406d09d6708d/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:11.561049 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928ff915-a6ab-4343-952d-68fe1a13f110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4372763087d742c1a3b8fceb15cfef5a, user_id=d80db5690b894a3d82e6406d09d6708d, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:11.564270 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928ff915-a6ab-4343-952d-68fe1a13f110 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:11.597165 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:11.636469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 986/1978] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:11 2022] PUT /identity/v3/projects/4372763087d742c1a3b8fceb15cfef5a/users/d80db5690b894a3d82e6406d09d6708d/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:11.641068 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b96cbe-6d8c-4249-a376-8b3feaa2a007 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:11.655152 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b96cbe-6d8c-4249-a376-8b3feaa2a007 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:11.731812 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46acd6c3-c2f4-4d84-ade1-32e77669162f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:11.732553 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acd6c3-c2f4-4d84-ade1-32e77669162f admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:11.732911 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acd6c3-c2f4-4d84-ade1-32e77669162f admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:11.735789 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acd6c3-c2f4-4d84-ade1-32e77669162f admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:11.735789 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46acd6c3-c2f4-4d84-ade1-32e77669162f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:11.735789 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46acd6c3-c2f4-4d84-ade1-32e77669162f admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:11.745888 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 993/1979] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:25:11.750131 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ff915-a6ab-4343-952d-68fe1a13f110 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:11.761553 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ff915-a6ab-4343-952d-68fe1a13f110 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:11.766240 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c1a9b-54db-4c4d-ad5c-b2812b3a2864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:11.767402 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c1a9b-54db-4c4d-ad5c-b2812b3a2864 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:11.767681 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c1a9b-54db-4c4d-ad5c-b2812b3a2864 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:11.767953 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c1a9b-54db-4c4d-ad5c-b2812b3a2864 admin admin] PATH_INFO: `/v3/projects/4372763087d742c1a3b8fceb15cfef5a/users/d80db5690b894a3d82e6406d09d6708d/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:11.769899 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c1a9b-54db-4c4d-ad5c-b2812b3a2864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4372763087d742c1a3b8fceb15cfef5a, user_id=d80db5690b894a3d82e6406d09d6708d, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:11.772578 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c1a9b-54db-4c4d-ad5c-b2812b3a2864 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:11.788122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 987/1980] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:11 2022] PUT /identity/v3/projects/4372763087d742c1a3b8fceb15cfef5a/users/d80db5690b894a3d82e6406d09d6708d/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:11.802991 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e5f1a-2852-40e3-9c24-fab9d1192a67 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:11.803288 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e5f1a-2852-40e3-9c24-fab9d1192a67 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:11.803567 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e5f1a-2852-40e3-9c24-fab9d1192a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:11.840683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-9b3e5f1a-2852-40e3-9c24-fab9d1192a67 None None] MFA Rules not processed for user `d80db5690b894a3d82e6406d09d6708d`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:11.842112 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-9b3e5f1a-2852-40e3-9c24-fab9d1192a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:11.914773 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 994/1981] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:11 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:12.048698 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c1a9b-54db-4c4d-ad5c-b2812b3a2864 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:12.115121 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c1a9b-54db-4c4d-ad5c-b2812b3a2864 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:12.118781 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35b0e6-1ff1-4c49-947b-8edc3dc83999 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:12.119419 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35b0e6-1ff1-4c49-947b-8edc3dc83999 service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:12.119680 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35b0e6-1ff1-4c49-947b-8edc3dc83999 service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:12.119950 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35b0e6-1ff1-4c49-947b-8edc3dc83999 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:12.130580 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab35b0e6-1ff1-4c49-947b-8edc3dc83999 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:12.132114 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab35b0e6-1ff1-4c49-947b-8edc3dc83999 service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:12.143707 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 988/1982] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:12 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:25:12.276296 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:12.673119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e5f1a-2852-40e3-9c24-fab9d1192a67 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:12.744334 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e5f1a-2852-40e3-9c24-fab9d1192a67 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:12.752784 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d9930-36b7-40ca-a3fe-a6ba7475f44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:12.753544 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d9930-36b7-40ca-a3fe-a6ba7475f44a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:12.753828 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d9930-36b7-40ca-a3fe-a6ba7475f44a admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:12.754168 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d9930-36b7-40ca-a3fe-a6ba7475f44a admin admin] PATH_INFO: `/v3/users/d70af2a335ff4472873373a3c0c12c9c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:12.755584 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d9930-36b7-40ca-a3fe-a6ba7475f44a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d70af2a335ff4472873373a3c0c12c9c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:12.758410 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d9930-36b7-40ca-a3fe-a6ba7475f44a admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:12.888035 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:13.004934 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-022d9930-36b7-40ca-a3fe-a6ba7475f44a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd70af2a335ff4472873373a3c0c12c9c'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:13.077003 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-022d9930-36b7-40ca-a3fe-a6ba7475f44a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd70af2a335ff4472873373a3c0c12c9c'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:13.086107 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-022d9930-36b7-40ca-a3fe-a6ba7475f44a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd70af2a335ff4472873373a3c0c12c9c'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:13.099512 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-022d9930-36b7-40ca-a3fe-a6ba7475f44a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd70af2a335ff4472873373a3c0c12c9c'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:13.100221 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-022d9930-36b7-40ca-a3fe-a6ba7475f44a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd70af2a335ff4472873373a3c0c12c9c'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:13.106341 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 995/1983] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:25:12 2022] DELETE /identity/v3/users/d70af2a335ff4472873373a3c0c12c9c => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:13.111201 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274c621-8d0f-4356-a5ba-3804f1d461a6 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:13.111706 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274c621-8d0f-4356-a5ba-3804f1d461a6 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:13.114192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274c621-8d0f-4356-a5ba-3804f1d461a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:13.136119 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-3274c621-8d0f-4356-a5ba-3804f1d461a6 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:13.137376 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-3274c621-8d0f-4356-a5ba-3804f1d461a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:13.199796 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 989/1984] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:13.210443 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d9930-36b7-40ca-a3fe-a6ba7475f44a admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:13.212051 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-022d9930-36b7-40ca-a3fe-a6ba7475f44a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:13.286574 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d9930-36b7-40ca-a3fe-a6ba7475f44a admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:13.292440 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d085b-f72a-46c7-abbc-65dec1df7d34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:13.298597 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d085b-f72a-46c7-abbc-65dec1df7d34 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:13.298597 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d085b-f72a-46c7-abbc-65dec1df7d34 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:13.298597 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d085b-f72a-46c7-abbc-65dec1df7d34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:13.311556 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d085b-f72a-46c7-abbc-65dec1df7d34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:13.312166 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d085b-f72a-46c7-abbc-65dec1df7d34 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:13.333596 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 996/1985] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:25:13.574682 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:13.782938 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274c621-8d0f-4356-a5ba-3804f1d461a6 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:13.784477 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-3274c621-8d0f-4356-a5ba-3804f1d461a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:13.863460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274c621-8d0f-4356-a5ba-3804f1d461a6 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:13.867357 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc539a5-9ee1-43e5-b52d-650565823e90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:13.870219 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc539a5-9ee1-43e5-b52d-650565823e90 service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:13.870617 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc539a5-9ee1-43e5-b52d-650565823e90 service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:13.872300 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc539a5-9ee1-43e5-b52d-650565823e90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:13.872898 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-2cc539a5-9ee1-43e5-b52d-650565823e90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:13.950884 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc539a5-9ee1-43e5-b52d-650565823e90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:13.952599 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc539a5-9ee1-43e5-b52d-650565823e90 service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:13.964402 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 990/1986] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:25:14.025163 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d085b-f72a-46c7-abbc-65dec1df7d34 service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:14.026838 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-495d085b-f72a-46c7-abbc-65dec1df7d34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:14.041658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d085b-f72a-46c7-abbc-65dec1df7d34 service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:14.048239 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802179f-00b2-4e42-abb0-d208993f9956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:14.048963 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802179f-00b2-4e42-abb0-d208993f9956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:14.049290 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802179f-00b2-4e42-abb0-d208993f9956 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:14.049572 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802179f-00b2-4e42-abb0-d208993f9956 admin admin] PATH_INFO: `/v3/projects/83577f4f769a40e996272f93af83e7fa` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:14.051371 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802179f-00b2-4e42-abb0-d208993f9956 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83577f4f769a40e996272f93af83e7fa)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:14.053394 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802179f-00b2-4e42-abb0-d208993f9956 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:14.122064 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:14.180599 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-8802179f-00b2-4e42-abb0-d208993f9956 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83577f4f769a40e996272f93af83e7fa', 'request_id': 'req-8802179f-00b2-4e42-abb0-d208993f9956'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:14.188382 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-8802179f-00b2-4e42-abb0-d208993f9956 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83577f4f769a40e996272f93af83e7fa', 'request_id': 'req-8802179f-00b2-4e42-abb0-d208993f9956'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:14.198257 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-8802179f-00b2-4e42-abb0-d208993f9956 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83577f4f769a40e996272f93af83e7fa', 'request_id': 'req-8802179f-00b2-4e42-abb0-d208993f9956'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:14.321781 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-8802179f-00b2-4e42-abb0-d208993f9956 admin admin] The token cache is being invalidate because project 83577f4f769a40e996272f93af83e7fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:25:14.322375 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-8802179f-00b2-4e42-abb0-d208993f9956 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:14.323214 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-8802179f-00b2-4e42-abb0-d208993f9956 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:14.328110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 997/1987] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:25:14 2022] DELETE /identity/v3/projects/83577f4f769a40e996272f93af83e7fa => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:14.330091 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc539a5-9ee1-43e5-b52d-650565823e90 service cinder] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:14.341895 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc539a5-9ee1-43e5-b52d-650565823e90 service cinder] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:14.416992 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7646fc3-cbcc-4da8-9b0a-415fdb9ca1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:14.417884 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7646fc3-cbcc-4da8-9b0a-415fdb9ca1e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:14.418372 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7646fc3-cbcc-4da8-9b0a-415fdb9ca1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:14.418807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7646fc3-cbcc-4da8-9b0a-415fdb9ca1e7 admin admin] PATH_INFO: `/v3/users/d80db5690b894a3d82e6406d09d6708d` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:14.423250 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7646fc3-cbcc-4da8-9b0a-415fdb9ca1e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d80db5690b894a3d82e6406d09d6708d)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:14.423250 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7646fc3-cbcc-4da8-9b0a-415fdb9ca1e7 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:14.664348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-d7646fc3-cbcc-4da8-9b0a-415fdb9ca1e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd80db5690b894a3d82e6406d09d6708d'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:14.665436 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-d7646fc3-cbcc-4da8-9b0a-415fdb9ca1e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd80db5690b894a3d82e6406d09d6708d'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:14.681954 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-d7646fc3-cbcc-4da8-9b0a-415fdb9ca1e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd80db5690b894a3d82e6406d09d6708d'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:14.682658 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-d7646fc3-cbcc-4da8-9b0a-415fdb9ca1e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd80db5690b894a3d82e6406d09d6708d'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:14.695320 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-d7646fc3-cbcc-4da8-9b0a-415fdb9ca1e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd80db5690b894a3d82e6406d09d6708d'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:14.799625 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 991/1988] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:25:14 2022] DELETE /identity/v3/users/d80db5690b894a3d82e6406d09d6708d => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:14.992067 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:15.355080 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802179f-00b2-4e42-abb0-d208993f9956 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:15.356663 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-8802179f-00b2-4e42-abb0-d208993f9956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:15.375787 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802179f-00b2-4e42-abb0-d208993f9956 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:15.420409 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:15.454907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713097b4-26cd-44f8-b6aa-dae5547eacb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:15.455637 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713097b4-26cd-44f8-b6aa-dae5547eacb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:15.455947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713097b4-26cd-44f8-b6aa-dae5547eacb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:15.456223 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713097b4-26cd-44f8-b6aa-dae5547eacb4 admin admin] PATH_INFO: `/v3/projects/4372763087d742c1a3b8fceb15cfef5a` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:15.457423 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713097b4-26cd-44f8-b6aa-dae5547eacb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4372763087d742c1a3b8fceb15cfef5a)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:15.459343 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713097b4-26cd-44f8-b6aa-dae5547eacb4 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:15.612642 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-713097b4-26cd-44f8-b6aa-dae5547eacb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4372763087d742c1a3b8fceb15cfef5a', 'request_id': 'req-713097b4-26cd-44f8-b6aa-dae5547eacb4'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:15.619254 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-713097b4-26cd-44f8-b6aa-dae5547eacb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4372763087d742c1a3b8fceb15cfef5a', 'request_id': 'req-713097b4-26cd-44f8-b6aa-dae5547eacb4'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:15.626848 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-713097b4-26cd-44f8-b6aa-dae5547eacb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4372763087d742c1a3b8fceb15cfef5a', 'request_id': 'req-713097b4-26cd-44f8-b6aa-dae5547eacb4'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:15.756814 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-713097b4-26cd-44f8-b6aa-dae5547eacb4 admin admin] The token cache is being invalidate because project 4372763087d742c1a3b8fceb15cfef5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:25:15.757152 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-713097b4-26cd-44f8-b6aa-dae5547eacb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:15.757794 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-713097b4-26cd-44f8-b6aa-dae5547eacb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:15.762795 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 998/1989] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:25:15 2022] DELETE /identity/v3/projects/4372763087d742c1a3b8fceb15cfef5a => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:15.764490 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f3eca-dcc5-4606-b67c-6a4019166279 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:15.764924 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f3eca-dcc5-4606-b67c-6a4019166279 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:15.765148 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f3eca-dcc5-4606-b67c-6a4019166279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:15.796361 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-e26f3eca-dcc5-4606-b67c-6a4019166279 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:15.798201 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-e26f3eca-dcc5-4606-b67c-6a4019166279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:15.874603 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 992/1990] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:25:15.882806 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b6ea1-80ff-4f73-a42d-ae4a7b4cd1f8 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:15.883117 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b6ea1-80ff-4f73-a42d-ae4a7b4cd1f8 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:15.883399 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b6ea1-80ff-4f73-a42d-ae4a7b4cd1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:15.907431 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-476b6ea1-80ff-4f73-a42d-ae4a7b4cd1f8 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:15.908769 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-476b6ea1-80ff-4f73-a42d-ae4a7b4cd1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:15.919845 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 999/1991] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:25:15.924463 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f3eca-dcc5-4606-b67c-6a4019166279 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:15.936372 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f3eca-dcc5-4606-b67c-6a4019166279 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:15.942346 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c685e58-b7e5-498e-98ab-c45f6cde5576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:15.947030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c685e58-b7e5-498e-98ab-c45f6cde5576 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:15.947850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c685e58-b7e5-498e-98ab-c45f6cde5576 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:15.947850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c685e58-b7e5-498e-98ab-c45f6cde5576 admin admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:15.949977 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c685e58-b7e5-498e-98ab-c45f6cde5576 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:25:15.949977 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c685e58-b7e5-498e-98ab-c45f6cde5576 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:15.951818 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c685e58-b7e5-498e-98ab-c45f6cde5576 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:15.989804 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 993/1992] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:25:15.996065 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b6ea1-80ff-4f73-a42d-ae4a7b4cd1f8 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:16.013984 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b6ea1-80ff-4f73-a42d-ae4a7b4cd1f8 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:16.019740 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc251f-7509-49a0-8c77-f42a0a859618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:16.020466 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc251f-7509-49a0-8c77-f42a0a859618 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:16.020816 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc251f-7509-49a0-8c77-f42a0a859618 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:16.021211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc251f-7509-49a0-8c77-f42a0a859618 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:16.021926 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc251f-7509-49a0-8c77-f42a0a859618 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:16.023901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc251f-7509-49a0-8c77-f42a0a859618 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:16.121172 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1000/1993] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:25:15 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:25:16.126256 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c685e58-b7e5-498e-98ab-c45f6cde5576 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:16.149623 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c685e58-b7e5-498e-98ab-c45f6cde5576 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:16.255005 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17216bfe-e0a6-448d-9f34-3d6300919f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:16.255634 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17216bfe-e0a6-448d-9f34-3d6300919f81 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:16.255915 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17216bfe-e0a6-448d-9f34-3d6300919f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:16.256206 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17216bfe-e0a6-448d-9f34-3d6300919f81 admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:16.256850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17216bfe-e0a6-448d-9f34-3d6300919f81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:16.259817 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17216bfe-e0a6-448d-9f34-3d6300919f81 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:16.333131 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc251f-7509-49a0-8c77-f42a0a859618 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:16.334867 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-9ebc251f-7509-49a0-8c77-f42a0a859618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:16.407281 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc251f-7509-49a0-8c77-f42a0a859618 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:16.412307 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 994/1994] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:25:16 2022] POST /identity/v3/users => generated 286 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:25:16.413986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17216bfe-e0a6-448d-9f34-3d6300919f81 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:16.415618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc00bf-8181-4b01-86a3-8db737b4feb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:16.416271 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc00bf-8181-4b01-86a3-8db737b4feb8 service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:16.416551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc00bf-8181-4b01-86a3-8db737b4feb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:16.416830 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc00bf-8181-4b01-86a3-8db737b4feb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:16.418668 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c1dc00bf-8181-4b01-86a3-8db737b4feb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:16.435021 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17216bfe-e0a6-448d-9f34-3d6300919f81 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:16.440842 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ee60b-fefa-44c6-8555-2d136321ea2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:16.441389 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ee60b-fefa-44c6-8555-2d136321ea2a admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:16.441670 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ee60b-fefa-44c6-8555-2d136321ea2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:16.441947 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ee60b-fefa-44c6-8555-2d136321ea2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:16.442608 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ee60b-fefa-44c6-8555-2d136321ea2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:16.444320 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ee60b-fefa-44c6-8555-2d136321ea2a admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:16.471673 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 995/1995] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:16.472857 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ee60b-fefa-44c6-8555-2d136321ea2a admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:16.502883 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ee60b-fefa-44c6-8555-2d136321ea2a admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:16.530623 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb099f7-2d24-4bfb-b29f-6c0d1096d211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:16.535246 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb099f7-2d24-4bfb-b29f-6c0d1096d211 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:16.535246 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb099f7-2d24-4bfb-b29f-6c0d1096d211 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:16.535246 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb099f7-2d24-4bfb-b29f-6c0d1096d211 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:16.535783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb099f7-2d24-4bfb-b29f-6c0d1096d211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:16.541203 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb099f7-2d24-4bfb-b29f-6c0d1096d211 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:16.542449 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc00bf-8181-4b01-86a3-8db737b4feb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:16.543955 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc00bf-8181-4b01-86a3-8db737b4feb8 service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:16.577250 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 996/1996] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:16.579285 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb099f7-2d24-4bfb-b29f-6c0d1096d211 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:16.589682 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1001/1997] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:25:16.591554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb099f7-2d24-4bfb-b29f-6c0d1096d211 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:16.597388 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fbfcc-cd26-48a4-aa19-b95350c371d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:16.598061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fbfcc-cd26-48a4-aa19-b95350c371d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:16.598353 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fbfcc-cd26-48a4-aa19-b95350c371d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:16.598611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fbfcc-cd26-48a4-aa19-b95350c371d2 admin admin] PATH_INFO: `/v3/projects/8f0cf14066894b85995392016b540803/users/dcd0b362e80e4d9ea0f9dd0169fdcc7b/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:16.637493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20fbfcc-cd26-48a4-aa19-b95350c371d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f0cf14066894b85995392016b540803, user_id=dcd0b362e80e4d9ea0f9dd0169fdcc7b, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:16.641345 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20fbfcc-cd26-48a4-aa19-b95350c371d2 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:16.753127 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 997/1998] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:16 2022] PUT /identity/v3/projects/8f0cf14066894b85995392016b540803/users/dcd0b362e80e4d9ea0f9dd0169fdcc7b/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:16.758305 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff6c3a-20a3-4491-96f7-a672d098dc0a None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:16.758605 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff6c3a-20a3-4491-96f7-a672d098dc0a None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:16.758880 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff6c3a-20a3-4491-96f7-a672d098dc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:16.781338 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-b4ff6c3a-20a3-4491-96f7-a672d098dc0a None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:16.783579 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-b4ff6c3a-20a3-4491-96f7-a672d098dc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:16.859059 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:16.867000 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1002/1999] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:16.896510 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fbfcc-cd26-48a4-aa19-b95350c371d2 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:16.898410 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-d20fbfcc-cd26-48a4-aa19-b95350c371d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:16.972277 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff6c3a-20a3-4491-96f7-a672d098dc0a None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:16.972582 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fbfcc-cd26-48a4-aa19-b95350c371d2 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:16.973754 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-b4ff6c3a-20a3-4491-96f7-a672d098dc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:16.978071 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939fdf1d-9d8c-4d87-99db-f9731b6467e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:16.979427 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fdf1d-9d8c-4d87-99db-f9731b6467e5 service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:16.979722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fdf1d-9d8c-4d87-99db-f9731b6467e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:16.979999 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fdf1d-9d8c-4d87-99db-f9731b6467e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:16.987489 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff6c3a-20a3-4491-96f7-a672d098dc0a None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:16.992685 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedbeb9-8bef-4ec4-8763-61abf8fb4b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:16.995750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedbeb9-8bef-4ec4-8763-61abf8fb4b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:16.995750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedbeb9-8bef-4ec4-8763-61abf8fb4b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:16.996102 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939fdf1d-9d8c-4d87-99db-f9731b6467e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:16.996200 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedbeb9-8bef-4ec4-8763-61abf8fb4b25 admin admin] PATH_INFO: `/v3/users/9c5b3e1c775449cbbb49c12e3eff2013` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:16.996200 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedbeb9-8bef-4ec4-8763-61abf8fb4b25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c5b3e1c775449cbbb49c12e3eff2013)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:16.996383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939fdf1d-9d8c-4d87-99db-f9731b6467e5 service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:16.997010 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedbeb9-8bef-4ec4-8763-61abf8fb4b25 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:17.007597 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 998/2000] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:25:17.031486 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:17.202658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-ddedbeb9-8bef-4ec4-8763-61abf8fb4b25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c5b3e1c775449cbbb49c12e3eff2013'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:17.322319 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-ddedbeb9-8bef-4ec4-8763-61abf8fb4b25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c5b3e1c775449cbbb49c12e3eff2013'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:17.335106 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-ddedbeb9-8bef-4ec4-8763-61abf8fb4b25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c5b3e1c775449cbbb49c12e3eff2013'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:17.351253 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-ddedbeb9-8bef-4ec4-8763-61abf8fb4b25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c5b3e1c775449cbbb49c12e3eff2013'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:17.352035 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-ddedbeb9-8bef-4ec4-8763-61abf8fb4b25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c5b3e1c775449cbbb49c12e3eff2013'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:17.363050 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1003/2001] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:25:16 2022] DELETE /identity/v3/users/9c5b3e1c775449cbbb49c12e3eff2013 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:17.364687 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874d2a6-b0ab-49d8-afc6-8016571d95ef None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:17.364983 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874d2a6-b0ab-49d8-afc6-8016571d95ef None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:17.365321 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874d2a6-b0ab-49d8-afc6-8016571d95ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:17.389811 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-6874d2a6-b0ab-49d8-afc6-8016571d95ef None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:17.391305 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-6874d2a6-b0ab-49d8-afc6-8016571d95ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:17.477278 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 999/2002] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:17.492778 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedbeb9-8bef-4ec4-8763-61abf8fb4b25 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:17.494965 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-ddedbeb9-8bef-4ec4-8763-61abf8fb4b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:17.618547 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedbeb9-8bef-4ec4-8763-61abf8fb4b25 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:17.629173 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b4e16-2452-4233-a833-e623005e3625 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:17.631375 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b4e16-2452-4233-a833-e623005e3625 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:17.631767 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b4e16-2452-4233-a833-e623005e3625 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:17.632409 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b4e16-2452-4233-a833-e623005e3625 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:17.663509 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b4e16-2452-4233-a833-e623005e3625 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:17.665273 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b4e16-2452-4233-a833-e623005e3625 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:17.682661 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1004/2003] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:25:18.251789 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874d2a6-b0ab-49d8-afc6-8016571d95ef None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:18.255903 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-6874d2a6-b0ab-49d8-afc6-8016571d95ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:18.291787 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874d2a6-b0ab-49d8-afc6-8016571d95ef None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:18.296466 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4e6f3-78b0-48d9-bc5d-d65b2b1b0f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:18.297798 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4e6f3-78b0-48d9-bc5d-d65b2b1b0f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:18.298213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4e6f3-78b0-48d9-bc5d-d65b2b1b0f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:18.298497 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4e6f3-78b0-48d9-bc5d-d65b2b1b0f07 admin admin] PATH_INFO: `/v3/projects/e11ec05b91de4886a6d18e8ab9cbc133` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:18.299628 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4e6f3-78b0-48d9-bc5d-d65b2b1b0f07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e11ec05b91de4886a6d18e8ab9cbc133)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:18.301869 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4e6f3-78b0-48d9-bc5d-d65b2b1b0f07 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:18.445578 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-9cf4e6f3-78b0-48d9-bc5d-d65b2b1b0f07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e11ec05b91de4886a6d18e8ab9cbc133', 'request_id': 'req-9cf4e6f3-78b0-48d9-bc5d-d65b2b1b0f07'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:18.451733 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-9cf4e6f3-78b0-48d9-bc5d-d65b2b1b0f07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e11ec05b91de4886a6d18e8ab9cbc133', 'request_id': 'req-9cf4e6f3-78b0-48d9-bc5d-d65b2b1b0f07'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:18.460526 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-9cf4e6f3-78b0-48d9-bc5d-d65b2b1b0f07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e11ec05b91de4886a6d18e8ab9cbc133', 'request_id': 'req-9cf4e6f3-78b0-48d9-bc5d-d65b2b1b0f07'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:18.626607 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-9cf4e6f3-78b0-48d9-bc5d-d65b2b1b0f07 admin admin] The token cache is being invalidate because project e11ec05b91de4886a6d18e8ab9cbc133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:25:18.627151 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-9cf4e6f3-78b0-48d9-bc5d-d65b2b1b0f07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:18.628832 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-9cf4e6f3-78b0-48d9-bc5d-d65b2b1b0f07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:18.632725 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1000/2004] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:25:18 2022] DELETE /identity/v3/projects/e11ec05b91de4886a6d18e8ab9cbc133 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:18.637336 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b4e16-2452-4233-a833-e623005e3625 service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:18.656924 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b4e16-2452-4233-a833-e623005e3625 service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:18.662133 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c0740-599f-4ed2-8b0e-5dba652d8048 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:18.662446 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c0740-599f-4ed2-8b0e-5dba652d8048 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:18.662728 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c0740-599f-4ed2-8b0e-5dba652d8048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:18.717573 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-e14c0740-599f-4ed2-8b0e-5dba652d8048 None None] MFA Rules not processed for user `dcd0b362e80e4d9ea0f9dd0169fdcc7b`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:18.719994 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-e14c0740-599f-4ed2-8b0e-5dba652d8048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:18.723318 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:18.781102 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d8e83-048c-4c95-8533-71811473d970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:18.782289 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d8e83-048c-4c95-8533-71811473d970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:18.782571 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d8e83-048c-4c95-8533-71811473d970 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:18.782845 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d8e83-048c-4c95-8533-71811473d970 admin admin] PATH_INFO: `/v3/users/e000b375d94a4c91a6eb13b78f709bf9` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:18.784010 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d8e83-048c-4c95-8533-71811473d970 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e000b375d94a4c91a6eb13b78f709bf9)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:18.785998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d8e83-048c-4c95-8533-71811473d970 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:18.818448 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1001/2005] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:25:18.822900 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c0740-599f-4ed2-8b0e-5dba652d8048 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:18.826364 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-e14c0740-599f-4ed2-8b0e-5dba652d8048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:18.837619 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c0740-599f-4ed2-8b0e-5dba652d8048 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:18.842283 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204155bc-8ced-40a3-80c0-4112ca1b29d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:18.842896 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204155bc-8ced-40a3-80c0-4112ca1b29d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:18.843178 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204155bc-8ced-40a3-80c0-4112ca1b29d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:18.843448 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204155bc-8ced-40a3-80c0-4112ca1b29d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:18.844581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204155bc-8ced-40a3-80c0-4112ca1b29d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:18.846551 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204155bc-8ced-40a3-80c0-4112ca1b29d4 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:18.988923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1002/2006] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:25:18 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:25:18.990387 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204155bc-8ced-40a3-80c0-4112ca1b29d4 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:19.027446 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-052d8e83-048c-4c95-8533-71811473d970 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e000b375d94a4c91a6eb13b78f709bf9'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:19.057927 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204155bc-8ced-40a3-80c0-4112ca1b29d4 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:19.062879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c52d3d-d840-445e-9ecb-c76a8f8639a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:19.063507 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c52d3d-d840-445e-9ecb-c76a8f8639a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:19.063787 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c52d3d-d840-445e-9ecb-c76a8f8639a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:19.064063 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c52d3d-d840-445e-9ecb-c76a8f8639a5 admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:19.064700 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c52d3d-d840-445e-9ecb-c76a8f8639a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:19.066652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c52d3d-d840-445e-9ecb-c76a8f8639a5 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:19.093302 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:19.121238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-052d8e83-048c-4c95-8533-71811473d970 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e000b375d94a4c91a6eb13b78f709bf9'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:19.128902 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-052d8e83-048c-4c95-8533-71811473d970 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e000b375d94a4c91a6eb13b78f709bf9'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:19.141939 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-052d8e83-048c-4c95-8533-71811473d970 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e000b375d94a4c91a6eb13b78f709bf9'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:19.142698 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-052d8e83-048c-4c95-8533-71811473d970 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e000b375d94a4c91a6eb13b78f709bf9'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:19.150463 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1005/2007] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:25:18 2022] DELETE /identity/v3/users/e000b375d94a4c91a6eb13b78f709bf9 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:19.157020 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1003/2008] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:25:18 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:25:19.165774 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d8e83-048c-4c95-8533-71811473d970 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:19.167225 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-052d8e83-048c-4c95-8533-71811473d970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:19.232704 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d8e83-048c-4c95-8533-71811473d970 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:19.237919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb0efe-6115-4360-8d2c-82bd34c35998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:19.238545 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb0efe-6115-4360-8d2c-82bd34c35998 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:19.238838 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb0efe-6115-4360-8d2c-82bd34c35998 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:19.239124 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb0efe-6115-4360-8d2c-82bd34c35998 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:19.239912 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb0efe-6115-4360-8d2c-82bd34c35998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:19.242080 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb0efe-6115-4360-8d2c-82bd34c35998 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:19.253113 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1006/2009] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:19.258084 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c52d3d-d840-445e-9ecb-c76a8f8639a5 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:19.270325 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c52d3d-d840-445e-9ecb-c76a8f8639a5 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:19.274991 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca2517-caca-48eb-b86b-86327f79ea87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:19.275658 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca2517-caca-48eb-b86b-86327f79ea87 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:19.275985 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca2517-caca-48eb-b86b-86327f79ea87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:19.276269 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca2517-caca-48eb-b86b-86327f79ea87 admin admin] PATH_INFO: `/v3/projects/ffabc5b248d041a5a84cbf4d0b404ee0/users/5a27570c413943368f831f74badeb8b8/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:19.290711 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca2517-caca-48eb-b86b-86327f79ea87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffabc5b248d041a5a84cbf4d0b404ee0, user_id=5a27570c413943368f831f74badeb8b8, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:19.293481 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca2517-caca-48eb-b86b-86327f79ea87 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:19.410593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1004/2010] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:19 2022] PUT /identity/v3/projects/ffabc5b248d041a5a84cbf4d0b404ee0/users/5a27570c413943368f831f74badeb8b8/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:19.414569 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb0efe-6115-4360-8d2c-82bd34c35998 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:19.425281 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb0efe-6115-4360-8d2c-82bd34c35998 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:19.485788 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f3ad2-e90e-4680-86db-31cdc73daab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:19.486774 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f3ad2-e90e-4680-86db-31cdc73daab5 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:19.487095 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f3ad2-e90e-4680-86db-31cdc73daab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:19.487349 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f3ad2-e90e-4680-86db-31cdc73daab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:19.488015 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f3ad2-e90e-4680-86db-31cdc73daab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:19.490448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f3ad2-e90e-4680-86db-31cdc73daab5 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:19.506916 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1007/2011] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:19.511504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca2517-caca-48eb-b86b-86327f79ea87 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:19.538815 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca2517-caca-48eb-b86b-86327f79ea87 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:19.545915 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854f954-5f4d-43a2-9d5c-e864542ed232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:19.546998 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854f954-5f4d-43a2-9d5c-e864542ed232 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:19.547795 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854f954-5f4d-43a2-9d5c-e864542ed232 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:19.548388 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854f954-5f4d-43a2-9d5c-e864542ed232 admin admin] PATH_INFO: `/v3/projects/ffabc5b248d041a5a84cbf4d0b404ee0/users/5a27570c413943368f831f74badeb8b8/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:19.551501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854f954-5f4d-43a2-9d5c-e864542ed232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffabc5b248d041a5a84cbf4d0b404ee0, user_id=5a27570c413943368f831f74badeb8b8, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:19.556692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854f954-5f4d-43a2-9d5c-e864542ed232 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:19.571587 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1005/2012] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:19 2022] PUT /identity/v3/projects/ffabc5b248d041a5a84cbf4d0b404ee0/users/5a27570c413943368f831f74badeb8b8/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:19.627760 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f3ad2-e90e-4680-86db-31cdc73daab5 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:19.631466 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-de9f3ad2-e90e-4680-86db-31cdc73daab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:19.644947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f3ad2-e90e-4680-86db-31cdc73daab5 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:19.705450 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6fcb3-8605-48d9-99d1-6ea30e7f74cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:19.706091 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6fcb3-8605-48d9-99d1-6ea30e7f74cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:19.706377 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6fcb3-8605-48d9-99d1-6ea30e7f74cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:19.706661 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6fcb3-8605-48d9-99d1-6ea30e7f74cd admin admin] PATH_INFO: `/v3/projects/f07f44994adb437ca2ad248c7abbb4ef` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:19.707922 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6fcb3-8605-48d9-99d1-6ea30e7f74cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f07f44994adb437ca2ad248c7abbb4ef)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:19.709911 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6fcb3-8605-48d9-99d1-6ea30e7f74cd admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:19.802810 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:19.837320 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-edc6fcb3-8605-48d9-99d1-6ea30e7f74cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f07f44994adb437ca2ad248c7abbb4ef', 'request_id': 'req-edc6fcb3-8605-48d9-99d1-6ea30e7f74cd'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:19.837320 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-edc6fcb3-8605-48d9-99d1-6ea30e7f74cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f07f44994adb437ca2ad248c7abbb4ef', 'request_id': 'req-edc6fcb3-8605-48d9-99d1-6ea30e7f74cd'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:19.841542 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-edc6fcb3-8605-48d9-99d1-6ea30e7f74cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f07f44994adb437ca2ad248c7abbb4ef', 'request_id': 'req-edc6fcb3-8605-48d9-99d1-6ea30e7f74cd'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:19.945693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-edc6fcb3-8605-48d9-99d1-6ea30e7f74cd admin admin] The token cache is being invalidate because project f07f44994adb437ca2ad248c7abbb4ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:25:19.946211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-edc6fcb3-8605-48d9-99d1-6ea30e7f74cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:19.947162 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-edc6fcb3-8605-48d9-99d1-6ea30e7f74cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:19.949721 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1008/2013] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:25:19 2022] DELETE /identity/v3/projects/f07f44994adb437ca2ad248c7abbb4ef => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:19.958448 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc46627-2405-4a13-a916-b9fb1d5c6370 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:19.958749 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc46627-2405-4a13-a916-b9fb1d5c6370 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:19.959019 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc46627-2405-4a13-a916-b9fb1d5c6370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:19.993976 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-3dc46627-2405-4a13-a916-b9fb1d5c6370 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:19.995559 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-3dc46627-2405-4a13-a916-b9fb1d5c6370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:20.065369 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1006/2014] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:25:20.074489 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f802d4-b389-45c7-89a4-e8ab6b8e91a8 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:20.074766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f802d4-b389-45c7-89a4-e8ab6b8e91a8 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:20.075309 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f802d4-b389-45c7-89a4-e8ab6b8e91a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:20.100700 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-86f802d4-b389-45c7-89a4-e8ab6b8e91a8 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:20.101946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-86f802d4-b389-45c7-89a4-e8ab6b8e91a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:20.110457 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1009/2015] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:20.115512 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc46627-2405-4a13-a916-b9fb1d5c6370 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:20.133001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc46627-2405-4a13-a916-b9fb1d5c6370 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:20.141080 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce07ad-8eb4-4443-a05e-1131199b19f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:20.142149 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce07ad-8eb4-4443-a05e-1131199b19f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:20.142655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce07ad-8eb4-4443-a05e-1131199b19f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:20.143193 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce07ad-8eb4-4443-a05e-1131199b19f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:20.146757 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce07ad-8eb4-4443-a05e-1131199b19f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:25:20.146757 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce07ad-8eb4-4443-a05e-1131199b19f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:20.148097 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce07ad-8eb4-4443-a05e-1131199b19f1 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:20.170670 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1007/2016] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:25:20.175951 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f802d4-b389-45c7-89a4-e8ab6b8e91a8 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:20.185736 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f802d4-b389-45c7-89a4-e8ab6b8e91a8 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:20.195388 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a95a1-fb46-404d-bf10-16a409ba76ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:20.198691 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a95a1-fb46-404d-bf10-16a409ba76ee admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:20.198691 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a95a1-fb46-404d-bf10-16a409ba76ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:20.198691 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a95a1-fb46-404d-bf10-16a409ba76ee admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:20.198691 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a95a1-fb46-404d-bf10-16a409ba76ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:20.200049 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a95a1-fb46-404d-bf10-16a409ba76ee admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:20.334072 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1010/2017] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:25:20 2022] POST /identity/v3/projects => generated 375 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:25:20.338629 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce07ad-8eb4-4443-a05e-1131199b19f1 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:20.350768 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce07ad-8eb4-4443-a05e-1131199b19f1 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:20.412880 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42170100-d352-4c92-b496-80dceb97a81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:20.413793 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42170100-d352-4c92-b496-80dceb97a81b admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:20.414087 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42170100-d352-4c92-b496-80dceb97a81b admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:20.414343 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42170100-d352-4c92-b496-80dceb97a81b admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:20.414992 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42170100-d352-4c92-b496-80dceb97a81b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:20.416996 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42170100-d352-4c92-b496-80dceb97a81b admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:20.520941 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1008/2018] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:25:20 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:25:20.524942 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a95a1-fb46-404d-bf10-16a409ba76ee admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:20.546096 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a95a1-fb46-404d-bf10-16a409ba76ee admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:20.551606 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccba81b-762e-4e86-93c5-1aaff4517452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:20.554343 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccba81b-762e-4e86-93c5-1aaff4517452 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:20.554343 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccba81b-762e-4e86-93c5-1aaff4517452 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:20.554343 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccba81b-762e-4e86-93c5-1aaff4517452 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:20.554343 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccba81b-762e-4e86-93c5-1aaff4517452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:20.555205 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccba81b-762e-4e86-93c5-1aaff4517452 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:20.565603 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1011/2019] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:20.569626 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42170100-d352-4c92-b496-80dceb97a81b admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:20.580815 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42170100-d352-4c92-b496-80dceb97a81b admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:20.585613 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51aedd-275e-441e-8d9a-0bb386b9880a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:20.586232 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51aedd-275e-441e-8d9a-0bb386b9880a admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:20.586512 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51aedd-275e-441e-8d9a-0bb386b9880a admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:20.586787 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51aedd-275e-441e-8d9a-0bb386b9880a admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:20.587437 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51aedd-275e-441e-8d9a-0bb386b9880a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:20.589040 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51aedd-275e-441e-8d9a-0bb386b9880a admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:20.601040 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1009/2020] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:20.605535 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccba81b-762e-4e86-93c5-1aaff4517452 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:20.615650 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccba81b-762e-4e86-93c5-1aaff4517452 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:20.619111 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:20.621434 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a8789-1fff-4f1c-bd67-7442d6f527db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:20.622101 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a8789-1fff-4f1c-bd67-7442d6f527db admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:20.622383 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a8789-1fff-4f1c-bd67-7442d6f527db admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:20.622657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a8789-1fff-4f1c-bd67-7442d6f527db admin admin] PATH_INFO: `/v3/projects/02da051d498e4310932eec215ba382f5/users/2171499fca0a443a8f42ef1579dcb34e/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:20.638008 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a8789-1fff-4f1c-bd67-7442d6f527db admin admin] RBAC: Authorizing `identity:create_grant(project_id=02da051d498e4310932eec215ba382f5, user_id=2171499fca0a443a8f42ef1579dcb34e, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:20.641846 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a8789-1fff-4f1c-bd67-7442d6f527db admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:20.727514 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1012/2021] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:20 2022] PUT /identity/v3/projects/02da051d498e4310932eec215ba382f5/users/2171499fca0a443a8f42ef1579dcb34e/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:20.737893 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f28f60-85e5-4082-b93b-60a5a5ce976c None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:20.738168 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f28f60-85e5-4082-b93b-60a5a5ce976c None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:20.738442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f28f60-85e5-4082-b93b-60a5a5ce976c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:20.767431 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-17f28f60-85e5-4082-b93b-60a5a5ce976c None None] MFA Rules not processed for user `2171499fca0a443a8f42ef1579dcb34e`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:20.768558 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-17f28f60-85e5-4082-b93b-60a5a5ce976c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:20.834074 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1010/2022] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:20.838665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a8789-1fff-4f1c-bd67-7442d6f527db admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:20.915961 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a8789-1fff-4f1c-bd67-7442d6f527db admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:20.920726 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfab9e7-a1ba-4035-82c5-38f3ce38272c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:20.921376 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfab9e7-a1ba-4035-82c5-38f3ce38272c admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:20.921662 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfab9e7-a1ba-4035-82c5-38f3ce38272c admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:20.921937 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfab9e7-a1ba-4035-82c5-38f3ce38272c admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:20.922743 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfab9e7-a1ba-4035-82c5-38f3ce38272c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:20.924663 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfab9e7-a1ba-4035-82c5-38f3ce38272c admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:20.977430 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:20.986856 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b81f1-7348-45e6-8a5b-7b14b49663fb None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:20.987393 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b81f1-7348-45e6-8a5b-7b14b49663fb None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:20.987666 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b81f1-7348-45e6-8a5b-7b14b49663fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:21.025194 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-1c6b81f1-7348-45e6-8a5b-7b14b49663fb None None] MFA Rules not processed for user `5a27570c413943368f831f74badeb8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:21.026522 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-1c6b81f1-7348-45e6-8a5b-7b14b49663fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:21.072385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1013/2023] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:25:20 2022] POST /identity/v3/projects => generated 375 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:25:21.077521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfab9e7-a1ba-4035-82c5-38f3ce38272c admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:21.113485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1011/2024] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:25:21.124761 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c52a28-f254-4762-8271-c91aa15ba2e5 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:21.125342 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c52a28-f254-4762-8271-c91aa15ba2e5 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:21.125806 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c52a28-f254-4762-8271-c91aa15ba2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:21.147568 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-86c52a28-f254-4762-8271-c91aa15ba2e5 None None] MFA Rules not processed for user `dcd0b362e80e4d9ea0f9dd0169fdcc7b`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:21.149894 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-86c52a28-f254-4762-8271-c91aa15ba2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:21.200129 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfab9e7-a1ba-4035-82c5-38f3ce38272c admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:21.207328 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a59fc4-f5a3-4aff-902e-1e9c2ac72084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:21.207965 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a59fc4-f5a3-4aff-902e-1e9c2ac72084 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:21.208248 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a59fc4-f5a3-4aff-902e-1e9c2ac72084 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:21.208522 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a59fc4-f5a3-4aff-902e-1e9c2ac72084 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:21.209206 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a59fc4-f5a3-4aff-902e-1e9c2ac72084 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:21.211148 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a59fc4-f5a3-4aff-902e-1e9c2ac72084 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:21.215386 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1012/2025] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:21.227031 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c52a28-f254-4762-8271-c91aa15ba2e5 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:21.228572 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-86c52a28-f254-4762-8271-c91aa15ba2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:21.319622 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1014/2026] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:25:21 2022] POST /identity/v3/users => generated 294 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:25:21.320664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a59fc4-f5a3-4aff-902e-1e9c2ac72084 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:21.320973 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c52a28-f254-4762-8271-c91aa15ba2e5 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:21.326921 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7ea6f-cba2-4574-bf80-43ce2b0cd3b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:21.327555 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7ea6f-cba2-4574-bf80-43ce2b0cd3b6 service nova] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:21.327837 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7ea6f-cba2-4574-bf80-43ce2b0cd3b6 service nova] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:21.328283 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7ea6f-cba2-4574-bf80-43ce2b0cd3b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:21.330252 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-28c7ea6f-cba2-4574-bf80-43ce2b0cd3b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:21.331789 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a59fc4-f5a3-4aff-902e-1e9c2ac72084 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:21.337181 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2bff6-e00b-4dae-b226-0c7a9914f3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:21.338124 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2bff6-e00b-4dae-b226-0c7a9914f3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:21.345355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2bff6-e00b-4dae-b226-0c7a9914f3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:21.345355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2bff6-e00b-4dae-b226-0c7a9914f3c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:21.345355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2bff6-e00b-4dae-b226-0c7a9914f3c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:21.345355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2bff6-e00b-4dae-b226-0c7a9914f3c3 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:21.345788 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7ea6f-cba2-4574-bf80-43ce2b0cd3b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:21.345788 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7ea6f-cba2-4574-bf80-43ce2b0cd3b6 service nova] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:21.354387 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1013/2027] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:25:21.356876 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1015/2028] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:21.361450 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7ea6f-cba2-4574-bf80-43ce2b0cd3b6 service nova] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:21.374738 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7ea6f-cba2-4574-bf80-43ce2b0cd3b6 service nova] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:21.380508 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1c0ca-60b9-499e-a339-29f93be5f737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:21.381216 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1c0ca-60b9-499e-a339-29f93be5f737 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:21.381498 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1c0ca-60b9-499e-a339-29f93be5f737 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:21.381773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1c0ca-60b9-499e-a339-29f93be5f737 admin admin] PATH_INFO: `/v3/projects/f89ca2c3e4e3457eb217ee3f42d300bb/users/4b14b64666be4d6fa9900c3280acce3c/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:21.400206 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae1c0ca-60b9-499e-a339-29f93be5f737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f89ca2c3e4e3457eb217ee3f42d300bb, user_id=4b14b64666be4d6fa9900c3280acce3c, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:21.404323 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae1c0ca-60b9-499e-a339-29f93be5f737 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:21.497905 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1014/2029] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:21 2022] PUT /identity/v3/projects/f89ca2c3e4e3457eb217ee3f42d300bb/users/4b14b64666be4d6fa9900c3280acce3c/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:25:21.501930 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2bff6-e00b-4dae-b226-0c7a9914f3c3 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:21.511656 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2bff6-e00b-4dae-b226-0c7a9914f3c3 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:21.598822 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51531af-8807-4b1c-a3f6-1489af56a4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:21.598955 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51531af-8807-4b1c-a3f6-1489af56a4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:21.599139 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51531af-8807-4b1c-a3f6-1489af56a4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:21.599415 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51531af-8807-4b1c-a3f6-1489af56a4c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:21.600128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51531af-8807-4b1c-a3f6-1489af56a4c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:21.601826 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51531af-8807-4b1c-a3f6-1489af56a4c7 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:21.618204 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1016/2030] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:21.619649 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:21.621115 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1c0ca-60b9-499e-a339-29f93be5f737 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:21.637579 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51531af-8807-4b1c-a3f6-1489af56a4c7 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:21.637865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1c0ca-60b9-499e-a339-29f93be5f737 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:21.639667 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-f51531af-8807-4b1c-a3f6-1489af56a4c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:21.643348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31df13-7714-4402-9642-f26cd9465f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:21.644662 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31df13-7714-4402-9642-f26cd9465f45 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:21.644662 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31df13-7714-4402-9642-f26cd9465f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:21.644857 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31df13-7714-4402-9642-f26cd9465f45 admin admin] PATH_INFO: `/v3/projects/f89ca2c3e4e3457eb217ee3f42d300bb/users/4b14b64666be4d6fa9900c3280acce3c/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:21.656904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31df13-7714-4402-9642-f26cd9465f45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f89ca2c3e4e3457eb217ee3f42d300bb, user_id=4b14b64666be4d6fa9900c3280acce3c, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:21.660879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31df13-7714-4402-9642-f26cd9465f45 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:21.671381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51531af-8807-4b1c-a3f6-1489af56a4c7 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:21.677451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1015/2031] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:21 2022] PUT /identity/v3/projects/f89ca2c3e4e3457eb217ee3f42d300bb/users/4b14b64666be4d6fa9900c3280acce3c/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:21.691135 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafde4b8-4f62-4401-88f6-e567eb7f66e5 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:21.691456 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafde4b8-4f62-4401-88f6-e567eb7f66e5 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:21.691706 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafde4b8-4f62-4401-88f6-e567eb7f66e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:21.730696 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-eafde4b8-4f62-4401-88f6-e567eb7f66e5 None None] MFA Rules not processed for user `4b14b64666be4d6fa9900c3280acce3c`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:21.731968 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-eafde4b8-4f62-4401-88f6-e567eb7f66e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:21.759766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e81ae0-94b8-4af7-ba98-3276b8dd7e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:21.760959 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e81ae0-94b8-4af7-ba98-3276b8dd7e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:21.761465 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e81ae0-94b8-4af7-ba98-3276b8dd7e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:21.761884 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e81ae0-94b8-4af7-ba98-3276b8dd7e53 admin admin] PATH_INFO: `/v3/users/70e8097f04db49448231882ceb58ee5a` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:21.765928 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e81ae0-94b8-4af7-ba98-3276b8dd7e53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70e8097f04db49448231882ceb58ee5a)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:21.767996 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e81ae0-94b8-4af7-ba98-3276b8dd7e53 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:21.804996 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:21.831078 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1016/2032] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:21.844732 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafde4b8-4f62-4401-88f6-e567eb7f66e5 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:21.847630 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-eafde4b8-4f62-4401-88f6-e567eb7f66e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:21.905240 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafde4b8-4f62-4401-88f6-e567eb7f66e5 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:21.909655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011fdc6-f4f5-40a5-b8f4-60b260b015b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:21.910340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011fdc6-f4f5-40a5-b8f4-60b260b015b4 service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:21.910561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011fdc6-f4f5-40a5-b8f4-60b260b015b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:21.910847 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011fdc6-f4f5-40a5-b8f4-60b260b015b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:21.927104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-47e81ae0-94b8-4af7-ba98-3276b8dd7e53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70e8097f04db49448231882ceb58ee5a'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:21.971294 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011fdc6-f4f5-40a5-b8f4-60b260b015b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:21.972745 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011fdc6-f4f5-40a5-b8f4-60b260b015b4 service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:21.982087 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1017/2033] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:25:22.007060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-47e81ae0-94b8-4af7-ba98-3276b8dd7e53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70e8097f04db49448231882ceb58ee5a'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:22.016785 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-47e81ae0-94b8-4af7-ba98-3276b8dd7e53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70e8097f04db49448231882ceb58ee5a'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:22.019962 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:22.034808 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-47e81ae0-94b8-4af7-ba98-3276b8dd7e53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70e8097f04db49448231882ceb58ee5a'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:22.035926 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-47e81ae0-94b8-4af7-ba98-3276b8dd7e53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70e8097f04db49448231882ceb58ee5a'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:22.053222 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1017/2034] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:25:21 2022] DELETE /identity/v3/users/70e8097f04db49448231882ceb58ee5a => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:25:22.053423 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eda59c-28d3-422c-89b8-639251efc16a None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:22.053423 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eda59c-28d3-422c-89b8-639251efc16a None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:22.053423 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eda59c-28d3-422c-89b8-639251efc16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:22.078642 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-f1eda59c-28d3-422c-89b8-639251efc16a None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:22.078642 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-f1eda59c-28d3-422c-89b8-639251efc16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:22.144658 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1018/2035] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:22.152457 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e81ae0-94b8-4af7-ba98-3276b8dd7e53 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:22.153901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-47e81ae0-94b8-4af7-ba98-3276b8dd7e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:22.246893 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e81ae0-94b8-4af7-ba98-3276b8dd7e53 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:22.252262 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066fe6a-489d-43d5-b804-97fec76d5464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:22.253179 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066fe6a-489d-43d5-b804-97fec76d5464 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:22.262132 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066fe6a-489d-43d5-b804-97fec76d5464 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:22.262132 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066fe6a-489d-43d5-b804-97fec76d5464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:22.262132 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:22.268898 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a066fe6a-489d-43d5-b804-97fec76d5464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:22.270959 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a066fe6a-489d-43d5-b804-97fec76d5464 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:22.286248 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1018/2036] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:25:22.761654 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:22.821405 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eda59c-28d3-422c-89b8-639251efc16a None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:22.822085 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-f1eda59c-28d3-422c-89b8-639251efc16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:22.848014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eda59c-28d3-422c-89b8-639251efc16a None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:22.867481 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d6efb-c19c-4afd-a989-53ea0b1562bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:22.868473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d6efb-c19c-4afd-a989-53ea0b1562bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:22.868952 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d6efb-c19c-4afd-a989-53ea0b1562bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:22.870971 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d6efb-c19c-4afd-a989-53ea0b1562bc admin admin] PATH_INFO: `/v3/projects/ea18a68ecd8d4cef87ecc74384b38250` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:22.872354 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3d6efb-c19c-4afd-a989-53ea0b1562bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea18a68ecd8d4cef87ecc74384b38250)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:22.874576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3d6efb-c19c-4afd-a989-53ea0b1562bc admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:23.004180 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2a3d6efb-c19c-4afd-a989-53ea0b1562bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea18a68ecd8d4cef87ecc74384b38250', 'request_id': 'req-2a3d6efb-c19c-4afd-a989-53ea0b1562bc'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:23.010695 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2a3d6efb-c19c-4afd-a989-53ea0b1562bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea18a68ecd8d4cef87ecc74384b38250', 'request_id': 'req-2a3d6efb-c19c-4afd-a989-53ea0b1562bc'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:23.017417 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2a3d6efb-c19c-4afd-a989-53ea0b1562bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea18a68ecd8d4cef87ecc74384b38250', 'request_id': 'req-2a3d6efb-c19c-4afd-a989-53ea0b1562bc'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:23.090603 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2a3d6efb-c19c-4afd-a989-53ea0b1562bc admin admin] The token cache is being invalidate because project ea18a68ecd8d4cef87ecc74384b38250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:25:23.091094 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2a3d6efb-c19c-4afd-a989-53ea0b1562bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:23.092041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2a3d6efb-c19c-4afd-a989-53ea0b1562bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:23.093727 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1019/2037] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:25:22 2022] DELETE /identity/v3/projects/ea18a68ecd8d4cef87ecc74384b38250 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:23.097737 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066fe6a-489d-43d5-b804-97fec76d5464 service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:23.112423 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066fe6a-489d-43d5-b804-97fec76d5464 service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:23.143560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:23.176848 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf823fe-d2b0-40b3-9276-278fba799434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:23.177670 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf823fe-d2b0-40b3-9276-278fba799434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:23.177985 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf823fe-d2b0-40b3-9276-278fba799434 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:23.178261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf823fe-d2b0-40b3-9276-278fba799434 admin admin] PATH_INFO: `/v3/users/4575662a410247af81e11a160ca198a0` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:23.180825 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf823fe-d2b0-40b3-9276-278fba799434 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4575662a410247af81e11a160ca198a0)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:23.182800 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf823fe-d2b0-40b3-9276-278fba799434 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:23.454268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6cf823fe-d2b0-40b3-9276-278fba799434 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4575662a410247af81e11a160ca198a0'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:23.549482 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6cf823fe-d2b0-40b3-9276-278fba799434 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4575662a410247af81e11a160ca198a0'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:23.557650 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6cf823fe-d2b0-40b3-9276-278fba799434 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4575662a410247af81e11a160ca198a0'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:23.570358 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6cf823fe-d2b0-40b3-9276-278fba799434 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4575662a410247af81e11a160ca198a0'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:23.571108 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6cf823fe-d2b0-40b3-9276-278fba799434 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4575662a410247af81e11a160ca198a0'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:23.577237 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1019/2038] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:25:23 2022] DELETE /identity/v3/users/4575662a410247af81e11a160ca198a0 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:23.709600 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:24.035631 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:24.051770 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d6efb-c19c-4afd-a989-53ea0b1562bc admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:24.053334 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-2a3d6efb-c19c-4afd-a989-53ea0b1562bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:24.068006 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d6efb-c19c-4afd-a989-53ea0b1562bc admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:24.135885 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf5507-7cad-4e17-958b-584412449345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:24.136574 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf5507-7cad-4e17-958b-584412449345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:24.137043 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf5507-7cad-4e17-958b-584412449345 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:24.137539 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf5507-7cad-4e17-958b-584412449345 admin admin] PATH_INFO: `/v3/projects/0e6e09fbc90341829b9bb0fb95a66601` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:24.145124 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf5507-7cad-4e17-958b-584412449345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e6e09fbc90341829b9bb0fb95a66601)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:24.145124 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf5507-7cad-4e17-958b-584412449345 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:24.285380 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-1aaf5507-7cad-4e17-958b-584412449345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e6e09fbc90341829b9bb0fb95a66601', 'request_id': 'req-1aaf5507-7cad-4e17-958b-584412449345'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:24.303036 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-1aaf5507-7cad-4e17-958b-584412449345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e6e09fbc90341829b9bb0fb95a66601', 'request_id': 'req-1aaf5507-7cad-4e17-958b-584412449345'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:24.308433 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-1aaf5507-7cad-4e17-958b-584412449345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e6e09fbc90341829b9bb0fb95a66601', 'request_id': 'req-1aaf5507-7cad-4e17-958b-584412449345'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:24.390004 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:24.424117 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-1aaf5507-7cad-4e17-958b-584412449345 admin admin] The token cache is being invalidate because project 0e6e09fbc90341829b9bb0fb95a66601 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:25:24.424219 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-1aaf5507-7cad-4e17-958b-584412449345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:24.425300 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-1aaf5507-7cad-4e17-958b-584412449345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:24.432642 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1020/2039] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:25:24 2022] DELETE /identity/v3/projects/0e6e09fbc90341829b9bb0fb95a66601 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:24.432729 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf823fe-d2b0-40b3-9276-278fba799434 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:24.434027 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-6cf823fe-d2b0-40b3-9276-278fba799434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:24.447535 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf823fe-d2b0-40b3-9276-278fba799434 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:24.506430 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9f0b0-5faa-4603-88c9-346bab507ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:24.507078 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9f0b0-5faa-4603-88c9-346bab507ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:24.507361 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9f0b0-5faa-4603-88c9-346bab507ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:24.507638 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9f0b0-5faa-4603-88c9-346bab507ad4 admin admin] PATH_INFO: `/v3/users/549fffc55a8b48faa811cf4d06009c42` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:24.508808 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e9f0b0-5faa-4603-88c9-346bab507ad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=549fffc55a8b48faa811cf4d06009c42)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:24.510773 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e9f0b0-5faa-4603-88c9-346bab507ad4 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:24.698100 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:24.716937 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-04e9f0b0-5faa-4603-88c9-346bab507ad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '549fffc55a8b48faa811cf4d06009c42'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:24.812760 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-04e9f0b0-5faa-4603-88c9-346bab507ad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '549fffc55a8b48faa811cf4d06009c42'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:24.820130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-04e9f0b0-5faa-4603-88c9-346bab507ad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '549fffc55a8b48faa811cf4d06009c42'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:24.834164 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-04e9f0b0-5faa-4603-88c9-346bab507ad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '549fffc55a8b48faa811cf4d06009c42'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:24.835064 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-04e9f0b0-5faa-4603-88c9-346bab507ad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '549fffc55a8b48faa811cf4d06009c42'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:24.841405 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1020/2040] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:25:24 2022] DELETE /identity/v3/users/549fffc55a8b48faa811cf4d06009c42 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:25.121579 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:25.346141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf5507-7cad-4e17-958b-584412449345 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:25.347679 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-1aaf5507-7cad-4e17-958b-584412449345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:25.363889 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf5507-7cad-4e17-958b-584412449345 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:25.430062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846982e1-aff7-49ba-aeb4-cbb3222bfa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:25.434559 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846982e1-aff7-49ba-aeb4-cbb3222bfa68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:25.434559 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846982e1-aff7-49ba-aeb4-cbb3222bfa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:25.434559 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846982e1-aff7-49ba-aeb4-cbb3222bfa68 admin admin] PATH_INFO: `/v3/projects/da6cee4f92a54714b96ca33f738ac6a5` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:25.434559 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846982e1-aff7-49ba-aeb4-cbb3222bfa68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da6cee4f92a54714b96ca33f738ac6a5)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:25.434559 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846982e1-aff7-49ba-aeb4-cbb3222bfa68 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:25.558302 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-846982e1-aff7-49ba-aeb4-cbb3222bfa68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da6cee4f92a54714b96ca33f738ac6a5', 'request_id': 'req-846982e1-aff7-49ba-aeb4-cbb3222bfa68'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:25.566815 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-846982e1-aff7-49ba-aeb4-cbb3222bfa68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da6cee4f92a54714b96ca33f738ac6a5', 'request_id': 'req-846982e1-aff7-49ba-aeb4-cbb3222bfa68'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:25.573478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-846982e1-aff7-49ba-aeb4-cbb3222bfa68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da6cee4f92a54714b96ca33f738ac6a5', 'request_id': 'req-846982e1-aff7-49ba-aeb4-cbb3222bfa68'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:25.576686 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9f0b0-5faa-4603-88c9-346bab507ad4 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:25.579053 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-04e9f0b0-5faa-4603-88c9-346bab507ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:25.613188 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:25.651190 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9f0b0-5faa-4603-88c9-346bab507ad4 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:25.664099 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-846982e1-aff7-49ba-aeb4-cbb3222bfa68 admin admin] The token cache is being invalidate because project da6cee4f92a54714b96ca33f738ac6a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:25:25.664392 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-846982e1-aff7-49ba-aeb4-cbb3222bfa68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:25.666066 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-846982e1-aff7-49ba-aeb4-cbb3222bfa68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:25.668704 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1021/2041] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:25:25 2022] DELETE /identity/v3/projects/da6cee4f92a54714b96ca33f738ac6a5 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:25.674030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0753d-a59c-4c83-bfd1-64f55d514da7 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:25.675541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0753d-a59c-4c83-bfd1-64f55d514da7 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:25.676058 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0753d-a59c-4c83-bfd1-64f55d514da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:25.698939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-32b0753d-a59c-4c83-bfd1-64f55d514da7 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:25.700173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-32b0753d-a59c-4c83-bfd1-64f55d514da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:25.711372 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca261cf-de71-4c43-9fd2-85b7a3dd2390 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:25.711999 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca261cf-de71-4c43-9fd2-85b7a3dd2390 service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:25.712338 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca261cf-de71-4c43-9fd2-85b7a3dd2390 service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:25.712615 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca261cf-de71-4c43-9fd2-85b7a3dd2390 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:25.714633 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-bca261cf-de71-4c43-9fd2-85b7a3dd2390 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:25.778272 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1022/2042] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:25:25.786967 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992d8b3-5442-4f2a-9838-986899932db1 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:25.787364 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992d8b3-5442-4f2a-9838-986899932db1 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:25.788577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992d8b3-5442-4f2a-9838-986899932db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:25.846293 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-1992d8b3-5442-4f2a-9838-986899932db1 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:25.847572 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-1992d8b3-5442-4f2a-9838-986899932db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:25.861467 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca261cf-de71-4c43-9fd2-85b7a3dd2390 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:25.863332 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca261cf-de71-4c43-9fd2-85b7a3dd2390 service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:25.877112 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1021/2043] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:25:25.889565 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1023/2044] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:25.893277 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca261cf-de71-4c43-9fd2-85b7a3dd2390 service cinder] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:25.932054 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca261cf-de71-4c43-9fd2-85b7a3dd2390 service cinder] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:25.940242 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d1451-8134-4108-84e1-8640a9c60e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:25.941296 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d1451-8134-4108-84e1-8640a9c60e7f admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:25.941776 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d1451-8134-4108-84e1-8640a9c60e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:25.942200 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d1451-8134-4108-84e1-8640a9c60e7f admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:25.945492 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d1451-8134-4108-84e1-8640a9c60e7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:25:25.945492 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d1451-8134-4108-84e1-8640a9c60e7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:25.946322 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d1451-8134-4108-84e1-8640a9c60e7f admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:25.963565 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1022/2045] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:25:25.967916 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992d8b3-5442-4f2a-9838-986899932db1 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:25.996691 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992d8b3-5442-4f2a-9838-986899932db1 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:26.008975 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5758c83-3a9e-4562-9218-85bbe38339cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:26.009659 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5758c83-3a9e-4562-9218-85bbe38339cc admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:26.009940 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5758c83-3a9e-4562-9218-85bbe38339cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:26.010234 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5758c83-3a9e-4562-9218-85bbe38339cc admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:26.013976 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5758c83-3a9e-4562-9218-85bbe38339cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:26.016935 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5758c83-3a9e-4562-9218-85bbe38339cc admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:26.098722 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:26.147135 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1024/2046] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:25:25 2022] POST /identity/v3/projects => generated 373 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:25:26.151609 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d1451-8134-4108-84e1-8640a9c60e7f admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:26.168056 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d1451-8134-4108-84e1-8640a9c60e7f admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:26.229849 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73eab85-963a-4782-bc13-f84f9ac7da39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:26.230474 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73eab85-963a-4782-bc13-f84f9ac7da39 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:26.230885 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73eab85-963a-4782-bc13-f84f9ac7da39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:26.231168 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73eab85-963a-4782-bc13-f84f9ac7da39 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:26.231806 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73eab85-963a-4782-bc13-f84f9ac7da39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:26.245975 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73eab85-963a-4782-bc13-f84f9ac7da39 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:26.346500 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5758c83-3a9e-4562-9218-85bbe38339cc admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:26.349309 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1023/2047] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:25:26 2022] POST /identity/v3/users => generated 287 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:25:26.367302 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:26.373494 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5758c83-3a9e-4562-9218-85bbe38339cc admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:26.383795 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb010b-b110-4bc6-b8ae-9872741494ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:26.384971 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb010b-b110-4bc6-b8ae-9872741494ae admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:26.385604 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb010b-b110-4bc6-b8ae-9872741494ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:26.386173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb010b-b110-4bc6-b8ae-9872741494ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:26.387024 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb010b-b110-4bc6-b8ae-9872741494ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:26.389882 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb010b-b110-4bc6-b8ae-9872741494ae admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:26.403393 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1025/2048] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:26.406926 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73eab85-963a-4782-bc13-f84f9ac7da39 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:26.417768 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73eab85-963a-4782-bc13-f84f9ac7da39 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:26.423212 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bf494-9e6c-4dfe-8d7d-f191d9437fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:26.425074 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bf494-9e6c-4dfe-8d7d-f191d9437fea admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:26.425074 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bf494-9e6c-4dfe-8d7d-f191d9437fea admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:26.425074 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bf494-9e6c-4dfe-8d7d-f191d9437fea admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:26.425432 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bf494-9e6c-4dfe-8d7d-f191d9437fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:26.428599 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bf494-9e6c-4dfe-8d7d-f191d9437fea admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:26.442506 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1024/2049] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:26.443481 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb010b-b110-4bc6-b8ae-9872741494ae admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:26.454932 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb010b-b110-4bc6-b8ae-9872741494ae admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:26.466865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a631b-9fc5-4efb-97ff-44ae10a31792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:26.466865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a631b-9fc5-4efb-97ff-44ae10a31792 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:26.466865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a631b-9fc5-4efb-97ff-44ae10a31792 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:26.467158 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a631b-9fc5-4efb-97ff-44ae10a31792 admin admin] PATH_INFO: `/v3/projects/228a5833a3f04415bb01d5a50dfcef89/users/c78d6f1e27a14dba8a9a4c81eb08b384/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:26.508123 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a631b-9fc5-4efb-97ff-44ae10a31792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=228a5833a3f04415bb01d5a50dfcef89, user_id=c78d6f1e27a14dba8a9a4c81eb08b384, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:26.512323 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a631b-9fc5-4efb-97ff-44ae10a31792 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:26.642737 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1026/2050] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:26 2022] PUT /identity/v3/projects/228a5833a3f04415bb01d5a50dfcef89/users/c78d6f1e27a14dba8a9a4c81eb08b384/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:26.648306 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ad24f-9397-4897-a5af-ab05bc0de857 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:26.648853 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ad24f-9397-4897-a5af-ab05bc0de857 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:26.648948 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ad24f-9397-4897-a5af-ab05bc0de857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:26.669560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-d69ad24f-9397-4897-a5af-ab05bc0de857 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:26.670705 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-d69ad24f-9397-4897-a5af-ab05bc0de857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:26.799959 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1025/2051] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:26.811829 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a631b-9fc5-4efb-97ff-44ae10a31792 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:26.816454 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-815a631b-9fc5-4efb-97ff-44ae10a31792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:26.835300 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a631b-9fc5-4efb-97ff-44ae10a31792 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:26.836002 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ad24f-9397-4897-a5af-ab05bc0de857 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:26.837520 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-d69ad24f-9397-4897-a5af-ab05bc0de857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:26.840960 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b469a05-78e8-4665-86b9-81ffb7b810f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:26.841858 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b469a05-78e8-4665-86b9-81ffb7b810f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:26.842035 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b469a05-78e8-4665-86b9-81ffb7b810f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:26.842185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b469a05-78e8-4665-86b9-81ffb7b810f7 admin admin] PATH_INFO: `/v3/users/86050b96970c4e9588763a30aab4929b` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:26.843514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b469a05-78e8-4665-86b9-81ffb7b810f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86050b96970c4e9588763a30aab4929b)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:26.845775 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b469a05-78e8-4665-86b9-81ffb7b810f7 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:26.917798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ad24f-9397-4897-a5af-ab05bc0de857 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:26.919444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e52e56-5a74-409f-ad17-d927b9cebdb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:26.920355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e52e56-5a74-409f-ad17-d927b9cebdb7 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:26.920678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e52e56-5a74-409f-ad17-d927b9cebdb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:26.921244 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e52e56-5a74-409f-ad17-d927b9cebdb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:26.961228 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e52e56-5a74-409f-ad17-d927b9cebdb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:26.963316 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e52e56-5a74-409f-ad17-d927b9cebdb7 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:26.976858 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1026/2052] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:25:27.044210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-6b469a05-78e8-4665-86b9-81ffb7b810f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86050b96970c4e9588763a30aab4929b'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:27.044897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-6b469a05-78e8-4665-86b9-81ffb7b810f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86050b96970c4e9588763a30aab4929b'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:27.053274 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-6b469a05-78e8-4665-86b9-81ffb7b810f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86050b96970c4e9588763a30aab4929b'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:27.053929 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-6b469a05-78e8-4665-86b9-81ffb7b810f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86050b96970c4e9588763a30aab4929b'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:27.069758 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-6b469a05-78e8-4665-86b9-81ffb7b810f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86050b96970c4e9588763a30aab4929b'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:27.157107 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1027/2053] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:25:26 2022] DELETE /identity/v3/users/86050b96970c4e9588763a30aab4929b => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:27.162189 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91df408-bbc7-4f59-9e76-a0664cd418fe None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:27.162816 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91df408-bbc7-4f59-9e76-a0664cd418fe None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:27.163405 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91df408-bbc7-4f59-9e76-a0664cd418fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:27.187270 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-c91df408-bbc7-4f59-9e76-a0664cd418fe None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:27.190054 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c91df408-bbc7-4f59-9e76-a0664cd418fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:27.263249 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1027/2054] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:27.285408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b469a05-78e8-4665-86b9-81ffb7b810f7 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:27.287173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-6b469a05-78e8-4665-86b9-81ffb7b810f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:27.392524 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b469a05-78e8-4665-86b9-81ffb7b810f7 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:27.397648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da3cd2-4ceb-4412-ae7a-8bf11e0c927b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:27.397957 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da3cd2-4ceb-4412-ae7a-8bf11e0c927b service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:27.398654 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da3cd2-4ceb-4412-ae7a-8bf11e0c927b service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:27.398654 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da3cd2-4ceb-4412-ae7a-8bf11e0c927b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:27.410309 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da3cd2-4ceb-4412-ae7a-8bf11e0c927b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:27.411892 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da3cd2-4ceb-4412-ae7a-8bf11e0c927b service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:27.425142 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1028/2055] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:25:27.592113 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:27.744455 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:28.731259 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91df408-bbc7-4f59-9e76-a0664cd418fe None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:28.733703 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c91df408-bbc7-4f59-9e76-a0664cd418fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:28.746258 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91df408-bbc7-4f59-9e76-a0664cd418fe None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:28.751646 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68653351-2262-43ec-aec8-1997a7298b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:28.752489 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68653351-2262-43ec-aec8-1997a7298b54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:28.752945 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68653351-2262-43ec-aec8-1997a7298b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:28.753603 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68653351-2262-43ec-aec8-1997a7298b54 admin admin] PATH_INFO: `/v3/projects/30d4a35d67644cad8bcc3d8717924ce0` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:28.755483 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68653351-2262-43ec-aec8-1997a7298b54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30d4a35d67644cad8bcc3d8717924ce0)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:28.756781 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68653351-2262-43ec-aec8-1997a7298b54 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:28.949266 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-68653351-2262-43ec-aec8-1997a7298b54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30d4a35d67644cad8bcc3d8717924ce0', 'request_id': 'req-68653351-2262-43ec-aec8-1997a7298b54'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:28.964651 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-68653351-2262-43ec-aec8-1997a7298b54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30d4a35d67644cad8bcc3d8717924ce0', 'request_id': 'req-68653351-2262-43ec-aec8-1997a7298b54'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:28.980214 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-68653351-2262-43ec-aec8-1997a7298b54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30d4a35d67644cad8bcc3d8717924ce0', 'request_id': 'req-68653351-2262-43ec-aec8-1997a7298b54'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:29.087269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-68653351-2262-43ec-aec8-1997a7298b54 admin admin] The token cache is being invalidate because project 30d4a35d67644cad8bcc3d8717924ce0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:25:29.087269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-68653351-2262-43ec-aec8-1997a7298b54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:29.087269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-68653351-2262-43ec-aec8-1997a7298b54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:29.087269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1028/2056] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:25:28 2022] DELETE /identity/v3/projects/30d4a35d67644cad8bcc3d8717924ce0 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:29.087605 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da3cd2-4ceb-4412-ae7a-8bf11e0c927b service neutron] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:29.098542 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da3cd2-4ceb-4412-ae7a-8bf11e0c927b service neutron] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:29.105228 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:29.178968 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2e5ec-3272-4c1e-9c05-aef90cddb348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:29.179611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2e5ec-3272-4c1e-9c05-aef90cddb348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:29.180035 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2e5ec-3272-4c1e-9c05-aef90cddb348 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:29.180463 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2e5ec-3272-4c1e-9c05-aef90cddb348 admin admin] PATH_INFO: `/v3/users/9baa85c817064dd2b4b0a7b12e7b74d2` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:29.181792 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2e5ec-3272-4c1e-9c05-aef90cddb348 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9baa85c817064dd2b4b0a7b12e7b74d2)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:29.183804 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2e5ec-3272-4c1e-9c05-aef90cddb348 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:29.351862 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-6af2e5ec-3272-4c1e-9c05-aef90cddb348 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9baa85c817064dd2b4b0a7b12e7b74d2'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:29.352534 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-6af2e5ec-3272-4c1e-9c05-aef90cddb348 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9baa85c817064dd2b4b0a7b12e7b74d2'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:29.361483 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-6af2e5ec-3272-4c1e-9c05-aef90cddb348 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9baa85c817064dd2b4b0a7b12e7b74d2'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:29.362556 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-6af2e5ec-3272-4c1e-9c05-aef90cddb348 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9baa85c817064dd2b4b0a7b12e7b74d2'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:29.378036 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-6af2e5ec-3272-4c1e-9c05-aef90cddb348 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9baa85c817064dd2b4b0a7b12e7b74d2'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:29.600367 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1029/2057] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:25:29 2022] DELETE /identity/v3/users/9baa85c817064dd2b4b0a7b12e7b74d2 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:25:30.179027 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e430dd-2419-4d7a-a20e-2e970a34c4a5 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:30.179520 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e430dd-2419-4d7a-a20e-2e970a34c4a5 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:30.179621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e430dd-2419-4d7a-a20e-2e970a34c4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:30.192811 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:30.237255 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-68e430dd-2419-4d7a-a20e-2e970a34c4a5 None None] MFA Rules not processed for user `c78d6f1e27a14dba8a9a4c81eb08b384`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:30.238510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-68e430dd-2419-4d7a-a20e-2e970a34c4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:30.322953 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1029/2058] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:30.334534 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2e5ec-3272-4c1e-9c05-aef90cddb348 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:30.336107 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-6af2e5ec-3272-4c1e-9c05-aef90cddb348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:30.408996 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e430dd-2419-4d7a-a20e-2e970a34c4a5 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:30.408996 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-68e430dd-2419-4d7a-a20e-2e970a34c4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:30.413229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2e5ec-3272-4c1e-9c05-aef90cddb348 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:30.418447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef9cba-f36d-4a60-a384-8df7a5869f66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:30.419596 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef9cba-f36d-4a60-a384-8df7a5869f66 service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:30.419596 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef9cba-f36d-4a60-a384-8df7a5869f66 service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:30.419596 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef9cba-f36d-4a60-a384-8df7a5869f66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:30.430657 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef9cba-f36d-4a60-a384-8df7a5869f66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:30.432768 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef9cba-f36d-4a60-a384-8df7a5869f66 service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:30.458355 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1030/2059] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:25:30.540068 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e430dd-2419-4d7a-a20e-2e970a34c4a5 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:30.546277 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24af02-5932-47da-8ec4-aba6d7ac274d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:30.547004 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24af02-5932-47da-8ec4-aba6d7ac274d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:30.557408 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24af02-5932-47da-8ec4-aba6d7ac274d admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:30.557980 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24af02-5932-47da-8ec4-aba6d7ac274d admin admin] PATH_INFO: `/v3/projects/9395a92fa15a442d872e48814108f5ba` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:30.559515 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24af02-5932-47da-8ec4-aba6d7ac274d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9395a92fa15a442d872e48814108f5ba)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:30.563216 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24af02-5932-47da-8ec4-aba6d7ac274d admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:30.716497 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-7b24af02-5932-47da-8ec4-aba6d7ac274d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9395a92fa15a442d872e48814108f5ba', 'request_id': 'req-7b24af02-5932-47da-8ec4-aba6d7ac274d'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:30.724410 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-7b24af02-5932-47da-8ec4-aba6d7ac274d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9395a92fa15a442d872e48814108f5ba', 'request_id': 'req-7b24af02-5932-47da-8ec4-aba6d7ac274d'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:30.731067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-7b24af02-5932-47da-8ec4-aba6d7ac274d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9395a92fa15a442d872e48814108f5ba', 'request_id': 'req-7b24af02-5932-47da-8ec4-aba6d7ac274d'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:30.789797 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-7b24af02-5932-47da-8ec4-aba6d7ac274d admin admin] The token cache is being invalidate because project 9395a92fa15a442d872e48814108f5ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:25:30.790106 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-7b24af02-5932-47da-8ec4-aba6d7ac274d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:30.790941 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-7b24af02-5932-47da-8ec4-aba6d7ac274d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:30.792571 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1030/2060] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:25:30 2022] DELETE /identity/v3/projects/9395a92fa15a442d872e48814108f5ba => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:25:30.799046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf39fb1-9f91-4186-b283-68beb223bb93 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:30.799329 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf39fb1-9f91-4186-b283-68beb223bb93 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:30.800276 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf39fb1-9f91-4186-b283-68beb223bb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:30.821713 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-cdf39fb1-9f91-4186-b283-68beb223bb93 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:30.823044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-cdf39fb1-9f91-4186-b283-68beb223bb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:30.913390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1031/2061] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:30.915302 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f6b67-68d8-4a44-b5f1-4aa6c43012fc None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:30.915302 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f6b67-68d8-4a44-b5f1-4aa6c43012fc None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:30.915302 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f6b67-68d8-4a44-b5f1-4aa6c43012fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:30.942398 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-fc9f6b67-68d8-4a44-b5f1-4aa6c43012fc None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:30.944894 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-fc9f6b67-68d8-4a44-b5f1-4aa6c43012fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:30.960906 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1031/2062] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:30.963485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf39fb1-9f91-4186-b283-68beb223bb93 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:30.974228 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf39fb1-9f91-4186-b283-68beb223bb93 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:30.979333 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7502de-49c0-44c6-b59d-0b2f739141a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:30.980095 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7502de-49c0-44c6-b59d-0b2f739141a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:30.980460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7502de-49c0-44c6-b59d-0b2f739141a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:30.980982 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7502de-49c0-44c6-b59d-0b2f739141a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:30.982011 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7502de-49c0-44c6-b59d-0b2f739141a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:25:30.982457 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7502de-49c0-44c6-b59d-0b2f739141a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:30.984901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7502de-49c0-44c6-b59d-0b2f739141a3 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:31.000165 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1032/2063] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:25:31.004920 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f6b67-68d8-4a44-b5f1-4aa6c43012fc None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:31.014553 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f6b67-68d8-4a44-b5f1-4aa6c43012fc None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:31.019497 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324161f-ed1a-43ff-8dfe-14d4ad82d6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:31.020187 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324161f-ed1a-43ff-8dfe-14d4ad82d6b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:31.020600 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324161f-ed1a-43ff-8dfe-14d4ad82d6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:31.020979 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324161f-ed1a-43ff-8dfe-14d4ad82d6b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:31.021772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324161f-ed1a-43ff-8dfe-14d4ad82d6b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:31.024188 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324161f-ed1a-43ff-8dfe-14d4ad82d6b3 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:31.095881 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1032/2064] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:25:31 2022] POST /identity/v3/projects => generated 371 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:25:31.099002 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7502de-49c0-44c6-b59d-0b2f739141a3 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:31.110590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7502de-49c0-44c6-b59d-0b2f739141a3 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:31.197205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9c843-11fe-4a35-9d17-ad28a5354f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:31.197205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9c843-11fe-4a35-9d17-ad28a5354f0d admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:31.197205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9c843-11fe-4a35-9d17-ad28a5354f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:31.197205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9c843-11fe-4a35-9d17-ad28a5354f0d admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:31.197725 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f9c843-11fe-4a35-9d17-ad28a5354f0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:31.197725 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f9c843-11fe-4a35-9d17-ad28a5354f0d admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:31.329469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1033/2065] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:25:31 2022] POST /identity/v3/users => generated 286 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:25:31.333263 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324161f-ed1a-43ff-8dfe-14d4ad82d6b3 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:31.351683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324161f-ed1a-43ff-8dfe-14d4ad82d6b3 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:31.357251 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c99df-fa95-45b6-bf81-3ec80405ba91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:31.362122 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c99df-fa95-45b6-bf81-3ec80405ba91 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:31.362122 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c99df-fa95-45b6-bf81-3ec80405ba91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:31.362122 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c99df-fa95-45b6-bf81-3ec80405ba91 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:31.362122 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c99df-fa95-45b6-bf81-3ec80405ba91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:31.362122 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c99df-fa95-45b6-bf81-3ec80405ba91 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:31.372751 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1033/2066] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:31.377472 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9c843-11fe-4a35-9d17-ad28a5354f0d admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:31.393356 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9c843-11fe-4a35-9d17-ad28a5354f0d admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:31.401007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314934c-b924-4ce9-90ee-a42438341a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:31.401677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314934c-b924-4ce9-90ee-a42438341a5b admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:31.402040 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314934c-b924-4ce9-90ee-a42438341a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:31.402476 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314934c-b924-4ce9-90ee-a42438341a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:31.403968 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314934c-b924-4ce9-90ee-a42438341a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:31.407174 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314934c-b924-4ce9-90ee-a42438341a5b admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:31.430033 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1034/2067] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:31.436311 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c99df-fa95-45b6-bf81-3ec80405ba91 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:31.447958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c99df-fa95-45b6-bf81-3ec80405ba91 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:31.453953 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666b85e-7f93-456f-8460-6e734b314f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:31.454659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666b85e-7f93-456f-8460-6e734b314f04 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:31.455075 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666b85e-7f93-456f-8460-6e734b314f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:31.455398 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666b85e-7f93-456f-8460-6e734b314f04 admin admin] PATH_INFO: `/v3/projects/0f1964babed24c2695cdc16f739d0df4/users/d2c9f4033f93486e827b2573c58a64c3/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:31.472623 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666b85e-7f93-456f-8460-6e734b314f04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f1964babed24c2695cdc16f739d0df4, user_id=d2c9f4033f93486e827b2573c58a64c3, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:31.475566 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666b85e-7f93-456f-8460-6e734b314f04 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:31.560706 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:31.608236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1034/2068] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:31 2022] PUT /identity/v3/projects/0f1964babed24c2695cdc16f739d0df4/users/d2c9f4033f93486e827b2573c58a64c3/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:31.629895 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b34178-184c-4c58-a54b-ec3a44222efb None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:31.630585 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b34178-184c-4c58-a54b-ec3a44222efb None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:31.631088 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b34178-184c-4c58-a54b-ec3a44222efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:31.652554 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:31.671798 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-20b34178-184c-4c58-a54b-ec3a44222efb None None] MFA Rules not processed for user `d2c9f4033f93486e827b2573c58a64c3`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:31.673372 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-20b34178-184c-4c58-a54b-ec3a44222efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:31.766560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666b85e-7f93-456f-8460-6e734b314f04 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:31.771521 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1035/2069] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:31.851759 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666b85e-7f93-456f-8460-6e734b314f04 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:31.873293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f386677-68d2-4c76-a8d1-c4d92ad4dfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:31.874005 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f386677-68d2-4c76-a8d1-c4d92ad4dfc7 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:31.874589 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f386677-68d2-4c76-a8d1-c4d92ad4dfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:31.874732 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f386677-68d2-4c76-a8d1-c4d92ad4dfc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:31.875808 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f386677-68d2-4c76-a8d1-c4d92ad4dfc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:31.880542 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f386677-68d2-4c76-a8d1-c4d92ad4dfc7 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:31.991752 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1035/2070] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:25:31 2022] POST /identity/v3/projects => generated 373 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:25:31.995322 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b34178-184c-4c58-a54b-ec3a44222efb None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:32.007381 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b34178-184c-4c58-a54b-ec3a44222efb None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:32.071820 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee37d5-76f5-4663-a824-2e22c6dff30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:32.072455 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee37d5-76f5-4663-a824-2e22c6dff30b admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:32.072833 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee37d5-76f5-4663-a824-2e22c6dff30b admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:32.073197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee37d5-76f5-4663-a824-2e22c6dff30b admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:32.073928 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee37d5-76f5-4663-a824-2e22c6dff30b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:32.075939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee37d5-76f5-4663-a824-2e22c6dff30b admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:32.214837 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1036/2071] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:25:31 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:25:32.216377 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f722e5f-48ed-40af-9525-90672191d726 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:32.216668 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f722e5f-48ed-40af-9525-90672191d726 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:32.216954 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f722e5f-48ed-40af-9525-90672191d726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:32.223430 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee37d5-76f5-4663-a824-2e22c6dff30b admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:32.255128 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee37d5-76f5-4663-a824-2e22c6dff30b admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:32.260427 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63685566-4772-4532-b0ac-d6efd02a94a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:32.261585 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63685566-4772-4532-b0ac-d6efd02a94a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:32.262049 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63685566-4772-4532-b0ac-d6efd02a94a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:32.262477 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63685566-4772-4532-b0ac-d6efd02a94a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:32.263492 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63685566-4772-4532-b0ac-d6efd02a94a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:32.266706 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63685566-4772-4532-b0ac-d6efd02a94a6 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:32.271985 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-7f722e5f-48ed-40af-9525-90672191d726 None None] MFA Rules not processed for user `c78d6f1e27a14dba8a9a4c81eb08b384`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:32.273372 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-7f722e5f-48ed-40af-9525-90672191d726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:32.287293 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1037/2072] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:32.292492 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63685566-4772-4532-b0ac-d6efd02a94a6 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:32.305034 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63685566-4772-4532-b0ac-d6efd02a94a6 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:32.310668 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21523d-38a2-484b-9714-542bace614c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:32.314587 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21523d-38a2-484b-9714-542bace614c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:32.315047 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21523d-38a2-484b-9714-542bace614c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:32.316499 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21523d-38a2-484b-9714-542bace614c9 admin admin] PATH_INFO: `/v3/projects/cb974cd6c5024a779176f69f3a699067/users/188fb5b5afd04df99aae27051ee38cab/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:32.359058 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21523d-38a2-484b-9714-542bace614c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb974cd6c5024a779176f69f3a699067, user_id=188fb5b5afd04df99aae27051ee38cab, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:32.374693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21523d-38a2-484b-9714-542bace614c9 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:32.381136 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1036/2073] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:25:32.521681 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1038/2074] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:32 2022] PUT /identity/v3/projects/cb974cd6c5024a779176f69f3a699067/users/188fb5b5afd04df99aae27051ee38cab/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:32.525648 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f722e5f-48ed-40af-9525-90672191d726 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:32.537437 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f722e5f-48ed-40af-9525-90672191d726 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:32.555791 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d01955-7799-4423-8eec-951af4904534 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:32.556137 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d01955-7799-4423-8eec-951af4904534 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:32.558535 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d01955-7799-4423-8eec-951af4904534 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:32.558535 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1039/2075] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 23 04:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:25:32.568017 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ca49c-26f4-40c5-bdeb-628dc56c0915 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:32.568375 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ca49c-26f4-40c5-bdeb-628dc56c0915 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:32.568818 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ca49c-26f4-40c5-bdeb-628dc56c0915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:32.609565 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-703ca49c-26f4-40c5-bdeb-628dc56c0915 None None] MFA Rules not processed for user `34794124b7234aeb98a15f0c2ae06a0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:32.611849 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-703ca49c-26f4-40c5-bdeb-628dc56c0915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:32.620698 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27178f2d-ba53-40e2-a223-7bc3122db5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:32.621392 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27178f2d-ba53-40e2-a223-7bc3122db5be admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:32.621673 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27178f2d-ba53-40e2-a223-7bc3122db5be admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:32.621949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27178f2d-ba53-40e2-a223-7bc3122db5be admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:32.622606 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27178f2d-ba53-40e2-a223-7bc3122db5be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:32.624244 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27178f2d-ba53-40e2-a223-7bc3122db5be admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:32.639165 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1037/2076] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:32.644083 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27178f2d-ba53-40e2-a223-7bc3122db5be admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:32.670798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27178f2d-ba53-40e2-a223-7bc3122db5be admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:32.678782 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd07f8-374b-4c83-931a-80c6cdca8baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:32.685049 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd07f8-374b-4c83-931a-80c6cdca8baa admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:32.685049 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd07f8-374b-4c83-931a-80c6cdca8baa admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:32.685049 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd07f8-374b-4c83-931a-80c6cdca8baa admin admin] PATH_INFO: `/v3/projects/cb974cd6c5024a779176f69f3a699067/users/188fb5b5afd04df99aae27051ee38cab/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:32.685049 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd07f8-374b-4c83-931a-80c6cdca8baa admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb974cd6c5024a779176f69f3a699067, user_id=188fb5b5afd04df99aae27051ee38cab, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:32.689124 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd07f8-374b-4c83-931a-80c6cdca8baa admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:32.704062 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1038/2077] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:32 2022] PUT /identity/v3/projects/cb974cd6c5024a779176f69f3a699067/users/188fb5b5afd04df99aae27051ee38cab/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:32.714603 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ba1d8-c56f-4f05-80a0-755e76238873 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:32.715242 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ba1d8-c56f-4f05-80a0-755e76238873 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:32.718615 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ba1d8-c56f-4f05-80a0-755e76238873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:32.725424 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1040/2078] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 23 04:25:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:25:32.737202 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ca49c-26f4-40c5-bdeb-628dc56c0915 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:32.741305 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-703ca49c-26f4-40c5-bdeb-628dc56c0915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:32.757065 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ca49c-26f4-40c5-bdeb-628dc56c0915 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:32.763060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-4e1ba1d8-c56f-4f05-80a0-755e76238873 None None] MFA Rules not processed for user `188fb5b5afd04df99aae27051ee38cab`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:32.765763 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-4e1ba1d8-c56f-4f05-80a0-755e76238873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:32.837669 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9672bb-b5e0-4dc1-b4ef-c5c867967504 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34794124b7234aeb98a15f0c2ae06a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:32.838281 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9672bb-b5e0-4dc1-b4ef-c5c867967504 service placement] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:32.838583 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9672bb-b5e0-4dc1-b4ef-c5c867967504 service placement] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:32.838897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9672bb-b5e0-4dc1-b4ef-c5c867967504 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:32.848358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9672bb-b5e0-4dc1-b4ef-c5c867967504 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:32.849988 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9672bb-b5e0-4dc1-b4ef-c5c867967504 service placement] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:32.857145 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1039/2079] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:32.859355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ba1d8-c56f-4f05-80a0-755e76238873 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:32.861006 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-4e1ba1d8-c56f-4f05-80a0-755e76238873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:32.861883 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1041/2080] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:25:32.875517 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9672bb-b5e0-4dc1-b4ef-c5c867967504 service placement] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:32.882755 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-1b9672bb-b5e0-4dc1-b4ef-c5c867967504 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:33.001455 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9672bb-b5e0-4dc1-b4ef-c5c867967504 service placement] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:33.006049 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc4b08-0fd5-47e3-a335-234fe7fd1071 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:33.006556 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc4b08-0fd5-47e3-a335-234fe7fd1071 service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:33.007549 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc4b08-0fd5-47e3-a335-234fe7fd1071 service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:33.007831 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc4b08-0fd5-47e3-a335-234fe7fd1071 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:33.018989 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ba1d8-c56f-4f05-80a0-755e76238873 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:33.027313 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea3664-5b7f-4200-a97a-94183a38fc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:33.027542 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc4b08-0fd5-47e3-a335-234fe7fd1071 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:33.027975 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea3664-5b7f-4200-a97a-94183a38fc41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:33.028255 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea3664-5b7f-4200-a97a-94183a38fc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:33.028533 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea3664-5b7f-4200-a97a-94183a38fc41 admin admin] PATH_INFO: `/v3/users/ce7828f322174fe5b3ee7d252010ccf7` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:33.029550 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc4b08-0fd5-47e3-a335-234fe7fd1071 service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:33.033309 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea3664-5b7f-4200-a97a-94183a38fc41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce7828f322174fe5b3ee7d252010ccf7)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:33.033309 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea3664-5b7f-4200-a97a-94183a38fc41 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:33.050464 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1042/2081] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:25:33.197395 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-c8ea3664-5b7f-4200-a97a-94183a38fc41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce7828f322174fe5b3ee7d252010ccf7'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:33.291887 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-c8ea3664-5b7f-4200-a97a-94183a38fc41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce7828f322174fe5b3ee7d252010ccf7'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:33.304138 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-c8ea3664-5b7f-4200-a97a-94183a38fc41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce7828f322174fe5b3ee7d252010ccf7'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:33.321743 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-c8ea3664-5b7f-4200-a97a-94183a38fc41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce7828f322174fe5b3ee7d252010ccf7'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:33.327662 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-c8ea3664-5b7f-4200-a97a-94183a38fc41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce7828f322174fe5b3ee7d252010ccf7'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:33.331451 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1040/2082] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:25:32 2022] DELETE /identity/v3/users/ce7828f322174fe5b3ee7d252010ccf7 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:33.612461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc4b08-0fd5-47e3-a335-234fe7fd1071 service cinder] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:33.630922 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc4b08-0fd5-47e3-a335-234fe7fd1071 service cinder] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:33.707156 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3f59b-2e0c-42ab-b91f-fbdfcb9d2857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:33.708104 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3f59b-2e0c-42ab-b91f-fbdfcb9d2857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:33.708662 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3f59b-2e0c-42ab-b91f-fbdfcb9d2857 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:33.708936 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3f59b-2e0c-42ab-b91f-fbdfcb9d2857 admin admin] PATH_INFO: `/v3/projects/de80b544f7954532acafbbfd2b69bde6` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:33.710130 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3f59b-2e0c-42ab-b91f-fbdfcb9d2857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de80b544f7954532acafbbfd2b69bde6)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:33.712039 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3f59b-2e0c-42ab-b91f-fbdfcb9d2857 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:33.824209 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c1e3f59b-2e0c-42ab-b91f-fbdfcb9d2857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de80b544f7954532acafbbfd2b69bde6', 'request_id': 'req-c1e3f59b-2e0c-42ab-b91f-fbdfcb9d2857'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:33.831166 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c1e3f59b-2e0c-42ab-b91f-fbdfcb9d2857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de80b544f7954532acafbbfd2b69bde6', 'request_id': 'req-c1e3f59b-2e0c-42ab-b91f-fbdfcb9d2857'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:33.836266 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:33.838573 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c1e3f59b-2e0c-42ab-b91f-fbdfcb9d2857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de80b544f7954532acafbbfd2b69bde6', 'request_id': 'req-c1e3f59b-2e0c-42ab-b91f-fbdfcb9d2857'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:33.904878 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c1e3f59b-2e0c-42ab-b91f-fbdfcb9d2857 admin admin] The token cache is being invalidate because project de80b544f7954532acafbbfd2b69bde6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:25:33.905269 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c1e3f59b-2e0c-42ab-b91f-fbdfcb9d2857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:33.905905 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c1e3f59b-2e0c-42ab-b91f-fbdfcb9d2857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:33.907654 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1043/2083] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:25:33 2022] DELETE /identity/v3/projects/de80b544f7954532acafbbfd2b69bde6 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:33.914005 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b32f04-d760-4622-b367-b3579309fe69 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:33.914915 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b32f04-d760-4622-b367-b3579309fe69 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:33.915380 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b32f04-d760-4622-b367-b3579309fe69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:33.937530 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-17b32f04-d760-4622-b367-b3579309fe69 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:33.938851 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-17b32f04-d760-4622-b367-b3579309fe69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:34.027470 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1041/2084] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:25:34.032656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f134fe-17bd-41d7-a1e5-bc3c38a65c82 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:34.032812 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:34.033222 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f134fe-17bd-41d7-a1e5-bc3c38a65c82 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:34.037804 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f134fe-17bd-41d7-a1e5-bc3c38a65c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:34.057172 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-67f134fe-17bd-41d7-a1e5-bc3c38a65c82 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:34.058618 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-67f134fe-17bd-41d7-a1e5-bc3c38a65c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:34.067282 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1044/2085] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:34.071716 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b32f04-d760-4622-b367-b3579309fe69 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:34.085162 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b32f04-d760-4622-b367-b3579309fe69 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:34.089958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b979003-3ac9-4eea-b1c4-ef8fab32579e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:34.090689 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b979003-3ac9-4eea-b1c4-ef8fab32579e admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:34.091594 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b979003-3ac9-4eea-b1c4-ef8fab32579e admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:34.091939 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b979003-3ac9-4eea-b1c4-ef8fab32579e admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:34.092710 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b979003-3ac9-4eea-b1c4-ef8fab32579e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:25:34.093154 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b979003-3ac9-4eea-b1c4-ef8fab32579e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:34.094797 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b979003-3ac9-4eea-b1c4-ef8fab32579e admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:34.113996 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1042/2086] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:25:34.117814 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f134fe-17bd-41d7-a1e5-bc3c38a65c82 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:34.127927 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f134fe-17bd-41d7-a1e5-bc3c38a65c82 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:34.133394 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e91e1-403a-4be6-9a60-4250be4e33f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:34.134040 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e91e1-403a-4be6-9a60-4250be4e33f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:34.134320 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e91e1-403a-4be6-9a60-4250be4e33f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:34.134590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e91e1-403a-4be6-9a60-4250be4e33f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:34.135460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e91e1-403a-4be6-9a60-4250be4e33f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:34.139026 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e91e1-403a-4be6-9a60-4250be4e33f3 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:34.190359 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b979003-3ac9-4eea-b1c4-ef8fab32579e admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:34.192137 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-7b979003-3ac9-4eea-b1c4-ef8fab32579e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:34.204794 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b979003-3ac9-4eea-b1c4-ef8fab32579e admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:34.209437 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301e41f-52a8-4152-bd13-fcf0fcc7e113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:34.210063 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301e41f-52a8-4152-bd13-fcf0fcc7e113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:34.210349 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301e41f-52a8-4152-bd13-fcf0fcc7e113 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:34.210628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301e41f-52a8-4152-bd13-fcf0fcc7e113 admin admin] PATH_INFO: `/v3/users/d2c9f4033f93486e827b2573c58a64c3` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:34.211762 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301e41f-52a8-4152-bd13-fcf0fcc7e113 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2c9f4033f93486e827b2573c58a64c3)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:34.213731 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301e41f-52a8-4152-bd13-fcf0fcc7e113 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:34.270934 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1045/2087] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:25:34 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:25:34.275646 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e91e1-403a-4be6-9a60-4250be4e33f3 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:34.348040 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e91e1-403a-4be6-9a60-4250be4e33f3 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:34.353080 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332904e2-292f-42e0-90af-a233d1b2fc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:34.353877 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332904e2-292f-42e0-90af-a233d1b2fc3b admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:34.359081 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332904e2-292f-42e0-90af-a233d1b2fc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:34.359081 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332904e2-292f-42e0-90af-a233d1b2fc3b admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:34.359081 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332904e2-292f-42e0-90af-a233d1b2fc3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:34.359081 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332904e2-292f-42e0-90af-a233d1b2fc3b admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:34.465896 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1046/2088] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:25:34 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:25:34.470780 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332904e2-292f-42e0-90af-a233d1b2fc3b admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:34.483082 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-2301e41f-52a8-4152-bd13-fcf0fcc7e113 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2c9f4033f93486e827b2573c58a64c3'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:34.489411 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332904e2-292f-42e0-90af-a233d1b2fc3b admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:34.503189 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ba3a6-bb56-4453-a391-81262b38e7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:34.503831 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ba3a6-bb56-4453-a391-81262b38e7d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:34.504167 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ba3a6-bb56-4453-a391-81262b38e7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:34.504452 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ba3a6-bb56-4453-a391-81262b38e7d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:34.505158 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ba3a6-bb56-4453-a391-81262b38e7d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:34.506866 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ba3a6-bb56-4453-a391-81262b38e7d8 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:34.520460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1047/2089] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:25:34.521540 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ba3a6-bb56-4453-a391-81262b38e7d8 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:34.531955 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ba3a6-bb56-4453-a391-81262b38e7d8 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:34.536626 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe900f3-3708-46c5-9d10-3597feda2e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:34.541424 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe900f3-3708-46c5-9d10-3597feda2e4a admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:34.541424 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe900f3-3708-46c5-9d10-3597feda2e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:34.541424 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe900f3-3708-46c5-9d10-3597feda2e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:34.541424 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe900f3-3708-46c5-9d10-3597feda2e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:34.541424 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe900f3-3708-46c5-9d10-3597feda2e4a admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:34.551404 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1048/2090] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:25:34.555502 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe900f3-3708-46c5-9d10-3597feda2e4a admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:34.560287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-2301e41f-52a8-4152-bd13-fcf0fcc7e113 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2c9f4033f93486e827b2573c58a64c3'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:34.565295 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe900f3-3708-46c5-9d10-3597feda2e4a admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:34.569580 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-2301e41f-52a8-4152-bd13-fcf0fcc7e113 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2c9f4033f93486e827b2573c58a64c3'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:34.570086 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298fcf0-1932-49ed-b6f3-382e3a2bd767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:34.570730 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298fcf0-1932-49ed-b6f3-382e3a2bd767 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:34.571009 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298fcf0-1932-49ed-b6f3-382e3a2bd767 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:34.571283 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298fcf0-1932-49ed-b6f3-382e3a2bd767 admin admin] PATH_INFO: `/v3/projects/9c5a2da9f32b41229ebee8a3cc2f6d54/users/34e3236e7dfc447fb287403a386d33da/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:34.581916 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-2301e41f-52a8-4152-bd13-fcf0fcc7e113 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2c9f4033f93486e827b2573c58a64c3'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:34.582702 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-2301e41f-52a8-4152-bd13-fcf0fcc7e113 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2c9f4033f93486e827b2573c58a64c3'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:34.586066 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298fcf0-1932-49ed-b6f3-382e3a2bd767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c5a2da9f32b41229ebee8a3cc2f6d54, user_id=34e3236e7dfc447fb287403a386d33da, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:34.589744 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298fcf0-1932-49ed-b6f3-382e3a2bd767 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:34.590962 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1043/2091] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:25:34 2022] DELETE /identity/v3/users/d2c9f4033f93486e827b2573c58a64c3 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:34.594396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716cf69-dc80-46d2-901d-b4a8fbab0400 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:34.594690 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716cf69-dc80-46d2-901d-b4a8fbab0400 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:34.594972 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716cf69-dc80-46d2-901d-b4a8fbab0400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:34.614367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-a716cf69-dc80-46d2-901d-b4a8fbab0400 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:34.615584 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-a716cf69-dc80-46d2-901d-b4a8fbab0400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:34.677207 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1044/2093] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:34.677405 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1049/2093] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:34 2022] PUT /identity/v3/projects/9c5a2da9f32b41229ebee8a3cc2f6d54/users/34e3236e7dfc447fb287403a386d33da/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:25:34.680329 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43630bd-8878-4c26-8166-a95077b49694 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:34.680621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43630bd-8878-4c26-8166-a95077b49694 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:34.680901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43630bd-8878-4c26-8166-a95077b49694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:34.685732 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298fcf0-1932-49ed-b6f3-382e3a2bd767 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:34.687402 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-7298fcf0-1932-49ed-b6f3-382e3a2bd767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:34.700127 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-a43630bd-8878-4c26-8166-a95077b49694 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:34.701350 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-a43630bd-8878-4c26-8166-a95077b49694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:34.767849 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298fcf0-1932-49ed-b6f3-382e3a2bd767 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:34.775215 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1045/2094] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:34.775482 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929432b-cc14-4fab-ae84-c2fc4a1f107b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:34.775482 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929432b-cc14-4fab-ae84-c2fc4a1f107b service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:34.775482 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929432b-cc14-4fab-ae84-c2fc4a1f107b service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:34.782718 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929432b-cc14-4fab-ae84-c2fc4a1f107b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:34.783553 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43630bd-8878-4c26-8166-a95077b49694 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:34.794890 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7929432b-cc14-4fab-ae84-c2fc4a1f107b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:34.797848 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7929432b-cc14-4fab-ae84-c2fc4a1f107b service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:34.813767 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1050/2095] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:25:34.814453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43630bd-8878-4c26-8166-a95077b49694 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:34.824739 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbaeb94-2d32-43c0-9c64-cd2471c98e6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:34.825275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbaeb94-2d32-43c0-9c64-cd2471c98e6f service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:34.825523 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbaeb94-2d32-43c0-9c64-cd2471c98e6f service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:34.825919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbaeb94-2d32-43c0-9c64-cd2471c98e6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:34.836605 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbaeb94-2d32-43c0-9c64-cd2471c98e6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:34.838076 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbaeb94-2d32-43c0-9c64-cd2471c98e6f service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:34.849199 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1046/2096] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:25:35.625234 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929432b-cc14-4fab-ae84-c2fc4a1f107b service neutron] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:35.633571 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-7929432b-cc14-4fab-ae84-c2fc4a1f107b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:35.648347 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929432b-cc14-4fab-ae84-c2fc4a1f107b service neutron] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:35.653560 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b255794-be4b-4f4b-b043-e50a4150a78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:35.661862 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b255794-be4b-4f4b-b043-e50a4150a78b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:35.661862 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b255794-be4b-4f4b-b043-e50a4150a78b admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:35.661862 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b255794-be4b-4f4b-b043-e50a4150a78b admin admin] PATH_INFO: `/v3/projects/0f1964babed24c2695cdc16f739d0df4` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:35.661862 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b255794-be4b-4f4b-b043-e50a4150a78b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f1964babed24c2695cdc16f739d0df4)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:35.661862 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b255794-be4b-4f4b-b043-e50a4150a78b admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:35.789601 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-0b255794-be4b-4f4b-b043-e50a4150a78b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f1964babed24c2695cdc16f739d0df4', 'request_id': 'req-0b255794-be4b-4f4b-b043-e50a4150a78b'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:35.797591 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-0b255794-be4b-4f4b-b043-e50a4150a78b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f1964babed24c2695cdc16f739d0df4', 'request_id': 'req-0b255794-be4b-4f4b-b043-e50a4150a78b'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:35.803557 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-0b255794-be4b-4f4b-b043-e50a4150a78b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f1964babed24c2695cdc16f739d0df4', 'request_id': 'req-0b255794-be4b-4f4b-b043-e50a4150a78b'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:35.920181 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-0b255794-be4b-4f4b-b043-e50a4150a78b admin admin] The token cache is being invalidate because project 0f1964babed24c2695cdc16f739d0df4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:25:35.920534 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-0b255794-be4b-4f4b-b043-e50a4150a78b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:35.921828 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-0b255794-be4b-4f4b-b043-e50a4150a78b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:35.923359 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1051/2097] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:25:35 2022] DELETE /identity/v3/projects/0f1964babed24c2695cdc16f739d0df4 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:35.927736 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbaeb94-2d32-43c0-9c64-cd2471c98e6f service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:35.938481 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbaeb94-2d32-43c0-9c64-cd2471c98e6f service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:36.000774 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19c262-e20e-4412-a7af-fa182c6288c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:36.001364 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19c262-e20e-4412-a7af-fa182c6288c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:36.001651 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19c262-e20e-4412-a7af-fa182c6288c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:36.001927 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19c262-e20e-4412-a7af-fa182c6288c4 admin admin] PATH_INFO: `/v3/users/188fb5b5afd04df99aae27051ee38cab` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:36.003049 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db19c262-e20e-4412-a7af-fa182c6288c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=188fb5b5afd04df99aae27051ee38cab)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:36.005023 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db19c262-e20e-4412-a7af-fa182c6288c4 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:36.181245 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-db19c262-e20e-4412-a7af-fa182c6288c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '188fb5b5afd04df99aae27051ee38cab'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:36.234978 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-db19c262-e20e-4412-a7af-fa182c6288c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '188fb5b5afd04df99aae27051ee38cab'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:36.242837 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-db19c262-e20e-4412-a7af-fa182c6288c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '188fb5b5afd04df99aae27051ee38cab'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:36.255312 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-db19c262-e20e-4412-a7af-fa182c6288c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '188fb5b5afd04df99aae27051ee38cab'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:36.255993 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-db19c262-e20e-4412-a7af-fa182c6288c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '188fb5b5afd04df99aae27051ee38cab'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:36.265910 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1047/2098] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:25:35 2022] DELETE /identity/v3/users/188fb5b5afd04df99aae27051ee38cab => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:36.919410 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b255794-be4b-4f4b-b043-e50a4150a78b admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:36.921899 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-0b255794-be4b-4f4b-b043-e50a4150a78b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:36.939057 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b255794-be4b-4f4b-b043-e50a4150a78b admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:36.975825 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:37.019186 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a9878-4b26-424c-8d97-6fa1ed03c6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:37.019989 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a9878-4b26-424c-8d97-6fa1ed03c6c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:37.020383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a9878-4b26-424c-8d97-6fa1ed03c6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:37.020804 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a9878-4b26-424c-8d97-6fa1ed03c6c0 admin admin] PATH_INFO: `/v3/projects/cb974cd6c5024a779176f69f3a699067` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:37.022251 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a9878-4b26-424c-8d97-6fa1ed03c6c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb974cd6c5024a779176f69f3a699067)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:37.025104 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a9878-4b26-424c-8d97-6fa1ed03c6c0 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:37.104107 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:37.187386 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-0c0a9878-4b26-424c-8d97-6fa1ed03c6c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb974cd6c5024a779176f69f3a699067', 'request_id': 'req-0c0a9878-4b26-424c-8d97-6fa1ed03c6c0'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:37.211713 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-0c0a9878-4b26-424c-8d97-6fa1ed03c6c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb974cd6c5024a779176f69f3a699067', 'request_id': 'req-0c0a9878-4b26-424c-8d97-6fa1ed03c6c0'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:37.225452 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-0c0a9878-4b26-424c-8d97-6fa1ed03c6c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb974cd6c5024a779176f69f3a699067', 'request_id': 'req-0c0a9878-4b26-424c-8d97-6fa1ed03c6c0'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:37.324404 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-0c0a9878-4b26-424c-8d97-6fa1ed03c6c0 admin admin] The token cache is being invalidate because project cb974cd6c5024a779176f69f3a699067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:25:37.325107 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-0c0a9878-4b26-424c-8d97-6fa1ed03c6c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:37.326446 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-0c0a9878-4b26-424c-8d97-6fa1ed03c6c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:37.330346 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1052/2099] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:25:36 2022] DELETE /identity/v3/projects/cb974cd6c5024a779176f69f3a699067 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:37.334351 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3ae15-e697-4dc9-a95e-779e5f87eb6e None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:37.334638 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3ae15-e697-4dc9-a95e-779e5f87eb6e None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:37.334912 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3ae15-e697-4dc9-a95e-779e5f87eb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:37.361863 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-41f3ae15-e697-4dc9-a95e-779e5f87eb6e None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:37.363363 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-41f3ae15-e697-4dc9-a95e-779e5f87eb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:37.430329 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1048/2100] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:37.439627 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acca165-cf5d-4673-9743-467cbd1ee798 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:37.440112 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acca165-cf5d-4673-9743-467cbd1ee798 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:37.440401 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acca165-cf5d-4673-9743-467cbd1ee798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:37.462921 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-9acca165-cf5d-4673-9743-467cbd1ee798 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:37.464317 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-9acca165-cf5d-4673-9743-467cbd1ee798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:37.490602 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1053/2101] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:25:37.495024 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3ae15-e697-4dc9-a95e-779e5f87eb6e None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:37.513786 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3ae15-e697-4dc9-a95e-779e5f87eb6e None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:37.523200 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68c9fe-57bd-495e-aae9-174e919e64ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:37.523837 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68c9fe-57bd-495e-aae9-174e919e64ab admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:37.524124 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68c9fe-57bd-495e-aae9-174e919e64ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:37.524401 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68c9fe-57bd-495e-aae9-174e919e64ab admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:37.525261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68c9fe-57bd-495e-aae9-174e919e64ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:25:37.525575 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68c9fe-57bd-495e-aae9-174e919e64ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:37.527211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68c9fe-57bd-495e-aae9-174e919e64ab admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:37.553422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1049/2102] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:25:37.557593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acca165-cf5d-4673-9743-467cbd1ee798 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:37.568003 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acca165-cf5d-4673-9743-467cbd1ee798 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:37.582972 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caffcad-eac8-4a93-a62b-ad6bd6fc3e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:37.583616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caffcad-eac8-4a93-a62b-ad6bd6fc3e59 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:37.583917 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caffcad-eac8-4a93-a62b-ad6bd6fc3e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:37.584174 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caffcad-eac8-4a93-a62b-ad6bd6fc3e59 admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:37.584842 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caffcad-eac8-4a93-a62b-ad6bd6fc3e59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:37.586924 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caffcad-eac8-4a93-a62b-ad6bd6fc3e59 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:37.679064 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1054/2103] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:25:37 2022] POST /identity/v3/projects => generated 367 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:25:37.683454 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68c9fe-57bd-495e-aae9-174e919e64ab admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:37.712107 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68c9fe-57bd-495e-aae9-174e919e64ab admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:37.888927 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6373b01-4ab3-4669-a246-1794f4a84af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:37.890298 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6373b01-4ab3-4669-a246-1794f4a84af6 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:37.890628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6373b01-4ab3-4669-a246-1794f4a84af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:37.890839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6373b01-4ab3-4669-a246-1794f4a84af6 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:37.891461 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6373b01-4ab3-4669-a246-1794f4a84af6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:37.893720 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6373b01-4ab3-4669-a246-1794f4a84af6 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:38.001555 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1050/2104] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:25:37 2022] POST /identity/v3/users => generated 284 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:25:38.005676 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caffcad-eac8-4a93-a62b-ad6bd6fc3e59 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:38.022465 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caffcad-eac8-4a93-a62b-ad6bd6fc3e59 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:38.037234 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dcd5d7-23ab-4f91-9eff-3f39fa844906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:38.038492 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcd5d7-23ab-4f91-9eff-3f39fa844906 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:38.039076 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcd5d7-23ab-4f91-9eff-3f39fa844906 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:38.039696 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcd5d7-23ab-4f91-9eff-3f39fa844906 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:38.041066 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dcd5d7-23ab-4f91-9eff-3f39fa844906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:38.043348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dcd5d7-23ab-4f91-9eff-3f39fa844906 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:38.059303 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1055/2105] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:25:38.064025 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6373b01-4ab3-4669-a246-1794f4a84af6 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:38.080319 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6373b01-4ab3-4669-a246-1794f4a84af6 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:38.088613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfefd7-16dc-4db9-af86-4be5c84c729b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:38.089755 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfefd7-16dc-4db9-af86-4be5c84c729b admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:38.090290 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfefd7-16dc-4db9-af86-4be5c84c729b admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:38.091191 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfefd7-16dc-4db9-af86-4be5c84c729b admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:38.092119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adfefd7-16dc-4db9-af86-4be5c84c729b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:38.094533 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adfefd7-16dc-4db9-af86-4be5c84c729b admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:38.116513 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1051/2106] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:25:38.126077 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dcd5d7-23ab-4f91-9eff-3f39fa844906 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:38.148232 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dcd5d7-23ab-4f91-9eff-3f39fa844906 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:38.156384 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09529dc4-bb07-49af-afc8-075a6703c12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:38.167106 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09529dc4-bb07-49af-afc8-075a6703c12b admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:38.167106 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09529dc4-bb07-49af-afc8-075a6703c12b admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:38.167106 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09529dc4-bb07-49af-afc8-075a6703c12b admin admin] PATH_INFO: `/v3/projects/7362f98d61594529abb9bd47ce16b85a/users/abbd6f20012b46e8b18bc8ceb5320cd1/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:38.194902 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09529dc4-bb07-49af-afc8-075a6703c12b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7362f98d61594529abb9bd47ce16b85a, user_id=abbd6f20012b46e8b18bc8ceb5320cd1, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:38.204405 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09529dc4-bb07-49af-afc8-075a6703c12b admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:38.294665 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1056/2107] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:38 2022] PUT /identity/v3/projects/7362f98d61594529abb9bd47ce16b85a/users/abbd6f20012b46e8b18bc8ceb5320cd1/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:38.309587 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62fe3b-b00d-4791-94b0-471690e231ba None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:38.310120 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62fe3b-b00d-4791-94b0-471690e231ba None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:38.310542 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62fe3b-b00d-4791-94b0-471690e231ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:38.363713 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-5f62fe3b-b00d-4791-94b0-471690e231ba None None] MFA Rules not processed for user `abbd6f20012b46e8b18bc8ceb5320cd1`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:38.365453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-5f62fe3b-b00d-4791-94b0-471690e231ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:38.466337 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1052/2108] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:38.475378 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09529dc4-bb07-49af-afc8-075a6703c12b admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:38.577969 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09529dc4-bb07-49af-afc8-075a6703c12b admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:38.591596 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600954aa-f81c-4777-8753-0d5aa2428536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:38.592243 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600954aa-f81c-4777-8753-0d5aa2428536 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:38.592564 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600954aa-f81c-4777-8753-0d5aa2428536 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:38.592840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600954aa-f81c-4777-8753-0d5aa2428536 admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:38.593658 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600954aa-f81c-4777-8753-0d5aa2428536 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:38.596430 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600954aa-f81c-4777-8753-0d5aa2428536 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:38.650409 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62fe3b-b00d-4791-94b0-471690e231ba None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:38.651903 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-5f62fe3b-b00d-4791-94b0-471690e231ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:38.669714 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62fe3b-b00d-4791-94b0-471690e231ba None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:38.679050 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583344f-cba4-440d-9ef7-03e27b166b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:38.680268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583344f-cba4-440d-9ef7-03e27b166b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:38.681909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583344f-cba4-440d-9ef7-03e27b166b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:38.682429 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583344f-cba4-440d-9ef7-03e27b166b81 admin admin] PATH_INFO: `/v3/users/c19308868f0542baaa1a7bfb4f4b11e6` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:38.685448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583344f-cba4-440d-9ef7-03e27b166b81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c19308868f0542baaa1a7bfb4f4b11e6)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:38.692010 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583344f-cba4-440d-9ef7-03e27b166b81 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:38.758368 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1057/2109] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:25:38 2022] POST /identity/v3/projects => generated 365 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:25:38.762593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600954aa-f81c-4777-8753-0d5aa2428536 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:38.884165 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600954aa-f81c-4777-8753-0d5aa2428536 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:38.897567 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81e1c9-0e89-40df-8c06-a0746dab4f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:38.898327 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81e1c9-0e89-40df-8c06-a0746dab4f60 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:38.898511 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81e1c9-0e89-40df-8c06-a0746dab4f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:38.898734 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81e1c9-0e89-40df-8c06-a0746dab4f60 admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:38.899372 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81e1c9-0e89-40df-8c06-a0746dab4f60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:38.901374 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81e1c9-0e89-40df-8c06-a0746dab4f60 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:38.990988 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1058/2110] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:25:38 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:25:38.995026 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81e1c9-0e89-40df-8c06-a0746dab4f60 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:39.001012 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-d583344f-cba4-440d-9ef7-03e27b166b81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c19308868f0542baaa1a7bfb4f4b11e6'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:39.006396 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81e1c9-0e89-40df-8c06-a0746dab4f60 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:39.011445 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245bf30-4510-4f77-b1cd-721515be11f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:39.012064 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245bf30-4510-4f77-b1cd-721515be11f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:39.012350 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245bf30-4510-4f77-b1cd-721515be11f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:39.012630 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245bf30-4510-4f77-b1cd-721515be11f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:39.013325 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245bf30-4510-4f77-b1cd-721515be11f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:39.015000 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245bf30-4510-4f77-b1cd-721515be11f8 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:39.026797 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1059/2111] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:39.030807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245bf30-4510-4f77-b1cd-721515be11f8 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:39.041693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245bf30-4510-4f77-b1cd-721515be11f8 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:39.048100 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8da8e3-8802-43cc-8705-b7e096982c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:39.048978 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8da8e3-8802-43cc-8705-b7e096982c53 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:39.050134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8da8e3-8802-43cc-8705-b7e096982c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:39.050518 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8da8e3-8802-43cc-8705-b7e096982c53 admin admin] PATH_INFO: `/v3/projects/54e3028c5d3c463bb2af34a28bb098a0/users/3a8a460a31ce4a67be6c64a7fcf67d94/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:39.067134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8da8e3-8802-43cc-8705-b7e096982c53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54e3028c5d3c463bb2af34a28bb098a0, user_id=3a8a460a31ce4a67be6c64a7fcf67d94, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:39.069953 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8da8e3-8802-43cc-8705-b7e096982c53 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:39.086189 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:39.109026 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-d583344f-cba4-440d-9ef7-03e27b166b81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c19308868f0542baaa1a7bfb4f4b11e6'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:39.120141 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-d583344f-cba4-440d-9ef7-03e27b166b81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c19308868f0542baaa1a7bfb4f4b11e6'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:39.147970 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-d583344f-cba4-440d-9ef7-03e27b166b81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c19308868f0542baaa1a7bfb4f4b11e6'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:39.148769 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-d583344f-cba4-440d-9ef7-03e27b166b81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c19308868f0542baaa1a7bfb4f4b11e6'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:39.161594 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1053/2112] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:25:38 2022] DELETE /identity/v3/users/c19308868f0542baaa1a7bfb4f4b11e6 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:39.173007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1060/2113] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:39 2022] PUT /identity/v3/projects/54e3028c5d3c463bb2af34a28bb098a0/users/3a8a460a31ce4a67be6c64a7fcf67d94/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:39.174460 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08bc52-bde0-4dda-bf14-ce59e5c71d40 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:39.175159 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08bc52-bde0-4dda-bf14-ce59e5c71d40 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:39.175159 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08bc52-bde0-4dda-bf14-ce59e5c71d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:39.177392 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8da8e3-8802-43cc-8705-b7e096982c53 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:39.180516 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-2f8da8e3-8802-43cc-8705-b7e096982c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:39.226522 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-cb08bc52-bde0-4dda-bf14-ce59e5c71d40 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:39.229296 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-cb08bc52-bde0-4dda-bf14-ce59e5c71d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:39.307465 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8da8e3-8802-43cc-8705-b7e096982c53 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:39.313793 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4b0b3-060a-47eb-8e42-816fd5d597b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:39.314781 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4b0b3-060a-47eb-8e42-816fd5d597b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:39.315228 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4b0b3-060a-47eb-8e42-816fd5d597b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:39.315686 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4b0b3-060a-47eb-8e42-816fd5d597b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:39.316805 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4b0b3-060a-47eb-8e42-816fd5d597b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:39.318839 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4b0b3-060a-47eb-8e42-816fd5d597b1 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:39.333454 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1061/2114] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:25:39.337488 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4b0b3-060a-47eb-8e42-816fd5d597b1 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:39.337635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1054/2115] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:39.348574 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08bc52-bde0-4dda-bf14-ce59e5c71d40 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:39.351484 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-cb08bc52-bde0-4dda-bf14-ce59e5c71d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:39.360243 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4b0b3-060a-47eb-8e42-816fd5d597b1 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:39.367591 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f86f76-f4bf-4e98-973b-c3a13cc7b372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:39.368956 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f86f76-f4bf-4e98-973b-c3a13cc7b372 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:39.370521 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f86f76-f4bf-4e98-973b-c3a13cc7b372 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:39.370638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f86f76-f4bf-4e98-973b-c3a13cc7b372 admin admin] PATH_INFO: `/v3/projects/54e3028c5d3c463bb2af34a28bb098a0/users/3a8a460a31ce4a67be6c64a7fcf67d94/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:39.375755 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f86f76-f4bf-4e98-973b-c3a13cc7b372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54e3028c5d3c463bb2af34a28bb098a0, user_id=3a8a460a31ce4a67be6c64a7fcf67d94, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:39.380325 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f86f76-f4bf-4e98-973b-c3a13cc7b372 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:39.407693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1062/2116] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:39 2022] PUT /identity/v3/projects/54e3028c5d3c463bb2af34a28bb098a0/users/3a8a460a31ce4a67be6c64a7fcf67d94/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:39.419983 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abec7fd-fa3f-4fa2-8b0a-bab6c2d04202 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:39.420274 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abec7fd-fa3f-4fa2-8b0a-bab6c2d04202 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:39.420581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abec7fd-fa3f-4fa2-8b0a-bab6c2d04202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:39.440968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:39.508492 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-1abec7fd-fa3f-4fa2-8b0a-bab6c2d04202 None None] MFA Rules not processed for user `3a8a460a31ce4a67be6c64a7fcf67d94`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:39.509833 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-1abec7fd-fa3f-4fa2-8b0a-bab6c2d04202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:39.552088 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08bc52-bde0-4dda-bf14-ce59e5c71d40 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:39.683635 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1063/2117] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:39 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:39.697993 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abec7fd-fa3f-4fa2-8b0a-bab6c2d04202 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:39.700260 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d4f05-6ac6-4ca7-9227-cf49ba762b68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:39.700901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d4f05-6ac6-4ca7-9227-cf49ba762b68 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:39.701075 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-1abec7fd-fa3f-4fa2-8b0a-bab6c2d04202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:39.701204 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d4f05-6ac6-4ca7-9227-cf49ba762b68 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:39.701479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d4f05-6ac6-4ca7-9227-cf49ba762b68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:39.824157 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abec7fd-fa3f-4fa2-8b0a-bab6c2d04202 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:39.834685 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d4f05-6ac6-4ca7-9227-cf49ba762b68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:39.836094 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19cf3b-ba18-4f38-bb6b-21e0645a99e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:39.836740 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19cf3b-ba18-4f38-bb6b-21e0645a99e5 service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:39.837022 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19cf3b-ba18-4f38-bb6b-21e0645a99e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:39.837325 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19cf3b-ba18-4f38-bb6b-21e0645a99e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:39.838681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d4f05-6ac6-4ca7-9227-cf49ba762b68 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:39.862620 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1055/2118] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:25:39.871410 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19cf3b-ba18-4f38-bb6b-21e0645a99e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:39.874292 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19cf3b-ba18-4f38-bb6b-21e0645a99e5 service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:39.891128 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1064/2119] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:39 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:25:40.333160 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:40.344708 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d4f05-6ac6-4ca7-9227-cf49ba762b68 service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:40.356175 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d4f05-6ac6-4ca7-9227-cf49ba762b68 service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:40.364246 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e16f8-e657-464b-ab61-a0f91cb1ec08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:40.365489 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e16f8-e657-464b-ab61-a0f91cb1ec08 service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:40.366178 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e16f8-e657-464b-ab61-a0f91cb1ec08 service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:40.366594 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e16f8-e657-464b-ab61-a0f91cb1ec08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:40.369650 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-b23e16f8-e657-464b-ab61-a0f91cb1ec08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:40.453501 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e16f8-e657-464b-ab61-a0f91cb1ec08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:40.456103 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e16f8-e657-464b-ab61-a0f91cb1ec08 service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:40.467704 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1056/2120] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:25:40.507779 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:40.688428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19cf3b-ba18-4f38-bb6b-21e0645a99e5 service cinder] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:40.690333 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-ab19cf3b-ba18-4f38-bb6b-21e0645a99e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:40.727487 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19cf3b-ba18-4f38-bb6b-21e0645a99e5 service cinder] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:40.751224 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44c670-0e66-477b-b932-65fcc1e4c7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:40.752222 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44c670-0e66-477b-b932-65fcc1e4c7aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:40.752569 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44c670-0e66-477b-b932-65fcc1e4c7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:40.752934 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44c670-0e66-477b-b932-65fcc1e4c7aa admin admin] PATH_INFO: `/v3/projects/3485f2b7256e47d28e35dabf41c0794a` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:40.755476 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44c670-0e66-477b-b932-65fcc1e4c7aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3485f2b7256e47d28e35dabf41c0794a)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:40.758430 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44c670-0e66-477b-b932-65fcc1e4c7aa admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:40.859217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e16f8-e657-464b-ab61-a0f91cb1ec08 service cinder] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:40.859626 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-b23e16f8-e657-464b-ab61-a0f91cb1ec08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:40.870905 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e16f8-e657-464b-ab61-a0f91cb1ec08 service cinder] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:40.875497 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df70e6-77f9-4784-ab34-f4f069007d73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:40.876300 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df70e6-77f9-4784-ab34-f4f069007d73 service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:40.876762 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df70e6-77f9-4784-ab34-f4f069007d73 service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:40.877033 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df70e6-77f9-4784-ab34-f4f069007d73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:40.886675 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c8df70e6-77f9-4784-ab34-f4f069007d73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:40.909445 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-fc44c670-0e66-477b-b932-65fcc1e4c7aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3485f2b7256e47d28e35dabf41c0794a', 'request_id': 'req-fc44c670-0e66-477b-b932-65fcc1e4c7aa'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:40.925165 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-fc44c670-0e66-477b-b932-65fcc1e4c7aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3485f2b7256e47d28e35dabf41c0794a', 'request_id': 'req-fc44c670-0e66-477b-b932-65fcc1e4c7aa'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:40.937548 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-fc44c670-0e66-477b-b932-65fcc1e4c7aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3485f2b7256e47d28e35dabf41c0794a', 'request_id': 'req-fc44c670-0e66-477b-b932-65fcc1e4c7aa'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:41.045848 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df70e6-77f9-4784-ab34-f4f069007d73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:41.047591 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df70e6-77f9-4784-ab34-f4f069007d73 service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:41.059850 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1057/2121] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:25:41.092500 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-fc44c670-0e66-477b-b932-65fcc1e4c7aa admin admin] The token cache is being invalidate because project 3485f2b7256e47d28e35dabf41c0794a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:25:41.093492 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-fc44c670-0e66-477b-b932-65fcc1e4c7aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:41.096075 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-fc44c670-0e66-477b-b932-65fcc1e4c7aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:41.100613 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1065/2122] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:25:40 2022] DELETE /identity/v3/projects/3485f2b7256e47d28e35dabf41c0794a => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:41.104841 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e42c5-0cdf-448b-94f3-692561584071 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:41.105180 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e42c5-0cdf-448b-94f3-692561584071 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:41.105482 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e42c5-0cdf-448b-94f3-692561584071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:41.131422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-669e42c5-0cdf-448b-94f3-692561584071 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:41.132890 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-669e42c5-0cdf-448b-94f3-692561584071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:41.224375 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1058/2123] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:41.232790 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882ebeb-648c-4e0b-b3e9-9b3b9120f026 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:41.233080 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882ebeb-648c-4e0b-b3e9-9b3b9120f026 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:41.233386 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882ebeb-648c-4e0b-b3e9-9b3b9120f026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:41.259031 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-b882ebeb-648c-4e0b-b3e9-9b3b9120f026 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:41.260555 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-b882ebeb-648c-4e0b-b3e9-9b3b9120f026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:41.276963 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1066/2124] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:41.278013 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e42c5-0cdf-448b-94f3-692561584071 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:41.290999 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e42c5-0cdf-448b-94f3-692561584071 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:41.305620 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8a7a8-b37e-41de-bbb4-9f9d74013400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:41.306286 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8a7a8-b37e-41de-bbb4-9f9d74013400 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:41.306681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8a7a8-b37e-41de-bbb4-9f9d74013400 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:41.307154 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8a7a8-b37e-41de-bbb4-9f9d74013400 admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:41.307863 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8a7a8-b37e-41de-bbb4-9f9d74013400 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:25:41.308176 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8a7a8-b37e-41de-bbb4-9f9d74013400 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:41.309868 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8a7a8-b37e-41de-bbb4-9f9d74013400 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:41.335160 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1059/2125] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:25:41.337811 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882ebeb-648c-4e0b-b3e9-9b3b9120f026 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:41.350494 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882ebeb-648c-4e0b-b3e9-9b3b9120f026 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:41.365197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6b8be-34ab-421a-b692-ea76c69cbd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:41.365902 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6b8be-34ab-421a-b692-ea76c69cbd91 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:41.366188 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6b8be-34ab-421a-b692-ea76c69cbd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:41.366453 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6b8be-34ab-421a-b692-ea76c69cbd91 admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:41.367256 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e6b8be-34ab-421a-b692-ea76c69cbd91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:41.369396 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e6b8be-34ab-421a-b692-ea76c69cbd91 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:41.569912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1067/2126] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:25:41 2022] POST /identity/v3/projects => generated 381 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:25:41.574381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8a7a8-b37e-41de-bbb4-9f9d74013400 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:41.585161 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8a7a8-b37e-41de-bbb4-9f9d74013400 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:41.647972 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c582ad-3016-446d-80e5-c5043ba7c12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:41.648527 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c582ad-3016-446d-80e5-c5043ba7c12f admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:41.648808 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c582ad-3016-446d-80e5-c5043ba7c12f admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:41.649110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c582ad-3016-446d-80e5-c5043ba7c12f admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:41.649757 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c582ad-3016-446d-80e5-c5043ba7c12f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:41.656066 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c582ad-3016-446d-80e5-c5043ba7c12f admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:41.757571 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1060/2127] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:25:41 2022] POST /identity/v3/users => generated 291 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:25:41.761516 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6b8be-34ab-421a-b692-ea76c69cbd91 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:41.779234 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6b8be-34ab-421a-b692-ea76c69cbd91 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:41.786554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cf168-d960-462b-9119-63c1edb59bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:41.787513 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cf168-d960-462b-9119-63c1edb59bde admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:41.787974 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cf168-d960-462b-9119-63c1edb59bde admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:41.788310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cf168-d960-462b-9119-63c1edb59bde admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:41.789382 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673cf168-d960-462b-9119-63c1edb59bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:41.791090 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673cf168-d960-462b-9119-63c1edb59bde admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:41.807827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1068/2128] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:41.809070 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c582ad-3016-446d-80e5-c5043ba7c12f admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:41.822032 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c582ad-3016-446d-80e5-c5043ba7c12f admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:41.827314 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93770d3-b33d-46d4-9a8a-57c051e6e9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:41.827947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93770d3-b33d-46d4-9a8a-57c051e6e9b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:41.828384 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93770d3-b33d-46d4-9a8a-57c051e6e9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:41.828673 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93770d3-b33d-46d4-9a8a-57c051e6e9b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:41.829383 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93770d3-b33d-46d4-9a8a-57c051e6e9b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:41.831022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93770d3-b33d-46d4-9a8a-57c051e6e9b9 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:41.851656 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1061/2129] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:41.855760 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cf168-d960-462b-9119-63c1edb59bde admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:41.871714 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cf168-d960-462b-9119-63c1edb59bde admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:41.878649 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382eab9-6791-4fdb-8df7-247e0e2a6102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:41.879465 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382eab9-6791-4fdb-8df7-247e0e2a6102 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:41.879822 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382eab9-6791-4fdb-8df7-247e0e2a6102 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:41.880154 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382eab9-6791-4fdb-8df7-247e0e2a6102 admin admin] PATH_INFO: `/v3/projects/29c2f5b9afa44942aaff5fe3ef11ad21/users/ccc08724cb7f4664b80c7ee493c8d5b6/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:41.907236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382eab9-6791-4fdb-8df7-247e0e2a6102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29c2f5b9afa44942aaff5fe3ef11ad21, user_id=ccc08724cb7f4664b80c7ee493c8d5b6, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:41.927445 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382eab9-6791-4fdb-8df7-247e0e2a6102 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:42.011660 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1069/2130] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:41 2022] PUT /identity/v3/projects/29c2f5b9afa44942aaff5fe3ef11ad21/users/ccc08724cb7f4664b80c7ee493c8d5b6/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:42.023847 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f9487-d8cc-4039-8d8d-7abb0d7bcb1f None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:42.027903 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f9487-d8cc-4039-8d8d-7abb0d7bcb1f None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:42.028461 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f9487-d8cc-4039-8d8d-7abb0d7bcb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:42.077359 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-b99f9487-d8cc-4039-8d8d-7abb0d7bcb1f None None] MFA Rules not processed for user `ccc08724cb7f4664b80c7ee493c8d5b6`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:42.078955 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-b99f9487-d8cc-4039-8d8d-7abb0d7bcb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:42.229534 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:42.259295 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1062/2131] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:42.272459 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382eab9-6791-4fdb-8df7-247e0e2a6102 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:42.274254 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-d382eab9-6791-4fdb-8df7-247e0e2a6102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:42.344652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a49f58-9b9b-4ab5-8170-f5dac650aca1 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:42.345307 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a49f58-9b9b-4ab5-8170-f5dac650aca1 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:42.345807 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a49f58-9b9b-4ab5-8170-f5dac650aca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:42.399365 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-e1a49f58-9b9b-4ab5-8170-f5dac650aca1 None None] MFA Rules not processed for user `34e3236e7dfc447fb287403a386d33da`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:42.400421 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382eab9-6791-4fdb-8df7-247e0e2a6102 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:42.401247 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-e1a49f58-9b9b-4ab5-8170-f5dac650aca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:42.405634 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b0031-1beb-49c8-b08a-adce46341caa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:42.406554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b0031-1beb-49c8-b08a-adce46341caa service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:42.406983 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b0031-1beb-49c8-b08a-adce46341caa service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:42.407398 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b0031-1beb-49c8-b08a-adce46341caa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:42.420196 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b0031-1beb-49c8-b08a-adce46341caa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:42.422220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b0031-1beb-49c8-b08a-adce46341caa service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:42.433994 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1070/2132] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:25:42.511102 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1063/2133] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:42.608955 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b0031-1beb-49c8-b08a-adce46341caa service cinder] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:42.610832 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-6c5b0031-1beb-49c8-b08a-adce46341caa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:42.735753 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b0031-1beb-49c8-b08a-adce46341caa service cinder] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:42.742132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92e750-a9ff-4af8-a6e6-f36af9afa29b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:42.742769 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92e750-a9ff-4af8-a6e6-f36af9afa29b service nova] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:42.743049 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92e750-a9ff-4af8-a6e6-f36af9afa29b service nova] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:42.743322 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92e750-a9ff-4af8-a6e6-f36af9afa29b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:42.752174 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c92e750-a9ff-4af8-a6e6-f36af9afa29b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:42.753813 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c92e750-a9ff-4af8-a6e6-f36af9afa29b service nova] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:42.765008 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1071/2134] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:25:43.040187 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:44.411818 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:44.658015 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a49f58-9b9b-4ab5-8170-f5dac650aca1 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:44.659581 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-e1a49f58-9b9b-4ab5-8170-f5dac650aca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:44.829979 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a49f58-9b9b-4ab5-8170-f5dac650aca1 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:44.850021 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57d2cc-61eb-4e09-9570-2feacd2c02f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:44.851104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57d2cc-61eb-4e09-9570-2feacd2c02f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:44.851572 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57d2cc-61eb-4e09-9570-2feacd2c02f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:44.852032 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57d2cc-61eb-4e09-9570-2feacd2c02f5 admin admin] PATH_INFO: `/v3/users/2171499fca0a443a8f42ef1579dcb34e` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:44.855776 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57d2cc-61eb-4e09-9570-2feacd2c02f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2171499fca0a443a8f42ef1579dcb34e)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:44.860014 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57d2cc-61eb-4e09-9570-2feacd2c02f5 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:45.133515 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-ce57d2cc-61eb-4e09-9570-2feacd2c02f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2171499fca0a443a8f42ef1579dcb34e'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:45.205580 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-ce57d2cc-61eb-4e09-9570-2feacd2c02f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2171499fca0a443a8f42ef1579dcb34e'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:45.215241 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-ce57d2cc-61eb-4e09-9570-2feacd2c02f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2171499fca0a443a8f42ef1579dcb34e'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:45.241611 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-ce57d2cc-61eb-4e09-9570-2feacd2c02f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2171499fca0a443a8f42ef1579dcb34e'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:45.242541 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-ce57d2cc-61eb-4e09-9570-2feacd2c02f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2171499fca0a443a8f42ef1579dcb34e'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:45.251008 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1064/2135] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:25:44 2022] DELETE /identity/v3/users/2171499fca0a443a8f42ef1579dcb34e => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:45.255653 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34590ed-d4b9-458a-97eb-48074715f5c2 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:45.256230 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34590ed-d4b9-458a-97eb-48074715f5c2 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:45.256515 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34590ed-d4b9-458a-97eb-48074715f5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:45.299760 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-f34590ed-d4b9-458a-97eb-48074715f5c2 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:45.302537 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-f34590ed-d4b9-458a-97eb-48074715f5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:45.413448 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1072/2136] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:25:45.450779 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57d2cc-61eb-4e09-9570-2feacd2c02f5 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:45.453974 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-ce57d2cc-61eb-4e09-9570-2feacd2c02f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:45.547856 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:45.603504 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57d2cc-61eb-4e09-9570-2feacd2c02f5 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:45.607655 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb68558-369b-46c9-9859-14686542dcdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:45.608426 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb68558-369b-46c9-9859-14686542dcdd service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:45.608716 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb68558-369b-46c9-9859-14686542dcdd service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:45.608990 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb68558-369b-46c9-9859-14686542dcdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:45.628534 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb68558-369b-46c9-9859-14686542dcdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:45.630995 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb68558-369b-46c9-9859-14686542dcdd service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:45.648681 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1065/2137] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:25:45.843286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89a45d-7e54-44e0-b757-de0c0c4ca9fd None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:45.853348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89a45d-7e54-44e0-b757-de0c0c4ca9fd None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:45.853348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89a45d-7e54-44e0-b757-de0c0c4ca9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:45.878859 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-ae89a45d-7e54-44e0-b757-de0c0c4ca9fd None None] MFA Rules not processed for user `34e3236e7dfc447fb287403a386d33da`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:45.882561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-ae89a45d-7e54-44e0-b757-de0c0c4ca9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:45.969879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1073/2138] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:45.981594 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb68558-369b-46c9-9859-14686542dcdd service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:45.984396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-2eb68558-369b-46c9-9859-14686542dcdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:46.002007 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb68558-369b-46c9-9859-14686542dcdd service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:46.009146 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af074b3-2a46-47d0-9a2a-a3339d543f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:46.010075 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af074b3-2a46-47d0-9a2a-a3339d543f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:46.010547 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af074b3-2a46-47d0-9a2a-a3339d543f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:46.010983 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af074b3-2a46-47d0-9a2a-a3339d543f73 admin admin] PATH_INFO: `/v3/users/ccc08724cb7f4664b80c7ee493c8d5b6` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:46.012537 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af074b3-2a46-47d0-9a2a-a3339d543f73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccc08724cb7f4664b80c7ee493c8d5b6)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:46.014975 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af074b3-2a46-47d0-9a2a-a3339d543f73 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:46.187374 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae89a45d-7e54-44e0-b757-de0c0c4ca9fd None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:46.189648 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-ae89a45d-7e54-44e0-b757-de0c0c4ca9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:46.218443 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae89a45d-7e54-44e0-b757-de0c0c4ca9fd None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:46.228236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe4fa0-8793-463d-b3fe-b082ae2c0293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:46.228907 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe4fa0-8793-463d-b3fe-b082ae2c0293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:46.229220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe4fa0-8793-463d-b3fe-b082ae2c0293 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:46.229501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe4fa0-8793-463d-b3fe-b082ae2c0293 admin admin] PATH_INFO: `/v3/projects/02da051d498e4310932eec215ba382f5` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:46.233006 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe4fa0-8793-463d-b3fe-b082ae2c0293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02da051d498e4310932eec215ba382f5)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:46.237912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe4fa0-8793-463d-b3fe-b082ae2c0293 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:46.289661 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-4af074b3-2a46-47d0-9a2a-a3339d543f73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccc08724cb7f4664b80c7ee493c8d5b6'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:46.413797 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-fdbe4fa0-8793-463d-b3fe-b082ae2c0293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02da051d498e4310932eec215ba382f5', 'request_id': 'req-fdbe4fa0-8793-463d-b3fe-b082ae2c0293'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:46.424527 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-fdbe4fa0-8793-463d-b3fe-b082ae2c0293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02da051d498e4310932eec215ba382f5', 'request_id': 'req-fdbe4fa0-8793-463d-b3fe-b082ae2c0293'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:46.424842 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-4af074b3-2a46-47d0-9a2a-a3339d543f73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccc08724cb7f4664b80c7ee493c8d5b6'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:46.434934 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-4af074b3-2a46-47d0-9a2a-a3339d543f73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccc08724cb7f4664b80c7ee493c8d5b6'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:46.450259 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-fdbe4fa0-8793-463d-b3fe-b082ae2c0293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02da051d498e4310932eec215ba382f5', 'request_id': 'req-fdbe4fa0-8793-463d-b3fe-b082ae2c0293'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:46.464737 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-4af074b3-2a46-47d0-9a2a-a3339d543f73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccc08724cb7f4664b80c7ee493c8d5b6'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:46.465537 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-4af074b3-2a46-47d0-9a2a-a3339d543f73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccc08724cb7f4664b80c7ee493c8d5b6'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:46.484537 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1066/2139] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:25:45 2022] DELETE /identity/v3/users/ccc08724cb7f4664b80c7ee493c8d5b6 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:46.490745 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e518d12-3166-4f79-be4e-9e6245f9286e None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:46.492187 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e518d12-3166-4f79-be4e-9e6245f9286e None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:46.492658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e518d12-3166-4f79-be4e-9e6245f9286e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:46.541067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-7e518d12-3166-4f79-be4e-9e6245f9286e None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:46.546868 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-7e518d12-3166-4f79-be4e-9e6245f9286e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:46.567375 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-fdbe4fa0-8793-463d-b3fe-b082ae2c0293 admin admin] The token cache is being invalidate because project 02da051d498e4310932eec215ba382f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:25:46.567682 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-fdbe4fa0-8793-463d-b3fe-b082ae2c0293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:46.568540 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-fdbe4fa0-8793-463d-b3fe-b082ae2c0293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:46.575907 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1074/2140] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:25:46 2022] DELETE /identity/v3/projects/02da051d498e4310932eec215ba382f5 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:46.579073 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe4fa0-8793-463d-b3fe-b082ae2c0293 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:46.580736 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-fdbe4fa0-8793-463d-b3fe-b082ae2c0293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:46.653752 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1067/2141] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:46.665593 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e518d12-3166-4f79-be4e-9e6245f9286e None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:46.667062 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-7e518d12-3166-4f79-be4e-9e6245f9286e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:46.715826 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe4fa0-8793-463d-b3fe-b082ae2c0293 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:46.733149 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a473f6-2692-4a0a-93dd-2171f7908021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:46.735011 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a473f6-2692-4a0a-93dd-2171f7908021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:46.735451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a473f6-2692-4a0a-93dd-2171f7908021 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:46.735738 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a473f6-2692-4a0a-93dd-2171f7908021 admin admin] PATH_INFO: `/v3/users/4b14b64666be4d6fa9900c3280acce3c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:46.737048 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a473f6-2692-4a0a-93dd-2171f7908021 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b14b64666be4d6fa9900c3280acce3c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:46.739161 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a473f6-2692-4a0a-93dd-2171f7908021 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:46.814933 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e518d12-3166-4f79-be4e-9e6245f9286e None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:46.819347 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204750c-0f73-4322-a0e4-1e46a6b1508f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:46.820288 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204750c-0f73-4322-a0e4-1e46a6b1508f service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:46.820835 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204750c-0f73-4322-a0e4-1e46a6b1508f service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:46.821348 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204750c-0f73-4322-a0e4-1e46a6b1508f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:46.834072 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204750c-0f73-4322-a0e4-1e46a6b1508f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:46.836595 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204750c-0f73-4322-a0e4-1e46a6b1508f service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:46.854314 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1068/2142] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:25:47.055097 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-e0a473f6-2692-4a0a-93dd-2171f7908021 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b14b64666be4d6fa9900c3280acce3c'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:47.055778 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-e0a473f6-2692-4a0a-93dd-2171f7908021 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b14b64666be4d6fa9900c3280acce3c'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:47.064260 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-e0a473f6-2692-4a0a-93dd-2171f7908021 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b14b64666be4d6fa9900c3280acce3c'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:47.064948 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-e0a473f6-2692-4a0a-93dd-2171f7908021 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b14b64666be4d6fa9900c3280acce3c'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:47.079273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-e0a473f6-2692-4a0a-93dd-2171f7908021 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b14b64666be4d6fa9900c3280acce3c'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:47.192560 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1075/2143] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:25:46 2022] DELETE /identity/v3/users/4b14b64666be4d6fa9900c3280acce3c => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:47.487643 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204750c-0f73-4322-a0e4-1e46a6b1508f service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:47.489205 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-3204750c-0f73-4322-a0e4-1e46a6b1508f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:47.503251 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204750c-0f73-4322-a0e4-1e46a6b1508f service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:47.605977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7246bc4-a956-4ad1-a055-f0b369cd488f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:47.606910 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7246bc4-a956-4ad1-a055-f0b369cd488f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:47.607785 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7246bc4-a956-4ad1-a055-f0b369cd488f admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:47.608070 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7246bc4-a956-4ad1-a055-f0b369cd488f admin admin] PATH_INFO: `/v3/projects/29c2f5b9afa44942aaff5fe3ef11ad21` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:47.609340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7246bc4-a956-4ad1-a055-f0b369cd488f admin admin] RBAC: Authorizing `identity:delete_project(project_id=29c2f5b9afa44942aaff5fe3ef11ad21)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:47.611307 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7246bc4-a956-4ad1-a055-f0b369cd488f admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:47.738890 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a473f6-2692-4a0a-93dd-2171f7908021 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:47.740685 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-e0a473f6-2692-4a0a-93dd-2171f7908021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:47.756868 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a473f6-2692-4a0a-93dd-2171f7908021 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:47.762056 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b7246bc4-a956-4ad1-a055-f0b369cd488f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29c2f5b9afa44942aaff5fe3ef11ad21', 'request_id': 'req-b7246bc4-a956-4ad1-a055-f0b369cd488f'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:47.770075 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b7246bc4-a956-4ad1-a055-f0b369cd488f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29c2f5b9afa44942aaff5fe3ef11ad21', 'request_id': 'req-b7246bc4-a956-4ad1-a055-f0b369cd488f'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:47.775587 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b7246bc4-a956-4ad1-a055-f0b369cd488f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29c2f5b9afa44942aaff5fe3ef11ad21', 'request_id': 'req-b7246bc4-a956-4ad1-a055-f0b369cd488f'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:47.828610 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa0a28-2c8b-4f9a-94b3-0dc3d4489477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:47.829360 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa0a28-2c8b-4f9a-94b3-0dc3d4489477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:47.829643 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa0a28-2c8b-4f9a-94b3-0dc3d4489477 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:47.830493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa0a28-2c8b-4f9a-94b3-0dc3d4489477 admin admin] PATH_INFO: `/v3/projects/f89ca2c3e4e3457eb217ee3f42d300bb` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:47.832184 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa0a28-2c8b-4f9a-94b3-0dc3d4489477 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f89ca2c3e4e3457eb217ee3f42d300bb)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:47.835516 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa0a28-2c8b-4f9a-94b3-0dc3d4489477 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:47.885289 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b7246bc4-a956-4ad1-a055-f0b369cd488f admin admin] The token cache is being invalidate because project 29c2f5b9afa44942aaff5fe3ef11ad21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:25:47.888315 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b7246bc4-a956-4ad1-a055-f0b369cd488f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:47.888315 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b7246bc4-a956-4ad1-a055-f0b369cd488f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:47.888315 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1069/2144] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:25:47 2022] DELETE /identity/v3/projects/29c2f5b9afa44942aaff5fe3ef11ad21 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:48.018700 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-5faa0a28-2c8b-4f9a-94b3-0dc3d4489477 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f89ca2c3e4e3457eb217ee3f42d300bb', 'request_id': 'req-5faa0a28-2c8b-4f9a-94b3-0dc3d4489477'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:48.027157 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-5faa0a28-2c8b-4f9a-94b3-0dc3d4489477 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f89ca2c3e4e3457eb217ee3f42d300bb', 'request_id': 'req-5faa0a28-2c8b-4f9a-94b3-0dc3d4489477'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:48.046296 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-5faa0a28-2c8b-4f9a-94b3-0dc3d4489477 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f89ca2c3e4e3457eb217ee3f42d300bb', 'request_id': 'req-5faa0a28-2c8b-4f9a-94b3-0dc3d4489477'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:48.142482 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-5faa0a28-2c8b-4f9a-94b3-0dc3d4489477 admin admin] The token cache is being invalidate because project f89ca2c3e4e3457eb217ee3f42d300bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:25:48.147126 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-5faa0a28-2c8b-4f9a-94b3-0dc3d4489477 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:48.147126 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-5faa0a28-2c8b-4f9a-94b3-0dc3d4489477 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:48.147126 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1076/2145] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:25:47 2022] DELETE /identity/v3/projects/f89ca2c3e4e3457eb217ee3f42d300bb => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:48.150071 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de5043-9383-42e4-9ab8-2b714d53a20c None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:48.150383 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de5043-9383-42e4-9ab8-2b714d53a20c None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:48.150751 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de5043-9383-42e4-9ab8-2b714d53a20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:48.173494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-26de5043-9383-42e4-9ab8-2b714d53a20c None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:48.175025 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-26de5043-9383-42e4-9ab8-2b714d53a20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:48.236542 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa0a28-2c8b-4f9a-94b3-0dc3d4489477 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:48.238605 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-5faa0a28-2c8b-4f9a-94b3-0dc3d4489477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:48.251954 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1070/2146] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:25:48.265881 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d649833-e26e-4b27-9e9f-7aaeacebd361 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:48.265881 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d649833-e26e-4b27-9e9f-7aaeacebd361 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:48.265881 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d649833-e26e-4b27-9e9f-7aaeacebd361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:48.295567 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-2d649833-e26e-4b27-9e9f-7aaeacebd361 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:48.297141 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-2d649833-e26e-4b27-9e9f-7aaeacebd361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:48.311780 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1071/2147] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:48.313382 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d649833-e26e-4b27-9e9f-7aaeacebd361 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:48.325674 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d649833-e26e-4b27-9e9f-7aaeacebd361 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:48.331378 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b4049-320f-402d-ae03-fc46ffe331f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:48.332154 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b4049-320f-402d-ae03-fc46ffe331f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:48.332433 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b4049-320f-402d-ae03-fc46ffe331f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:48.332695 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b4049-320f-402d-ae03-fc46ffe331f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:48.333480 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b4049-320f-402d-ae03-fc46ffe331f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:25:48.333711 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b4049-320f-402d-ae03-fc46ffe331f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:48.335457 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b4049-320f-402d-ae03-fc46ffe331f0 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:48.350947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1072/2148] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:25:48.355355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b4049-320f-402d-ae03-fc46ffe331f0 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:48.359242 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa0a28-2c8b-4f9a-94b3-0dc3d4489477 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:48.366441 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b4049-320f-402d-ae03-fc46ffe331f0 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:48.366938 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd0b66-c780-4dc7-87b5-6aded6912e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:48.367590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd0b66-c780-4dc7-87b5-6aded6912e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:48.367874 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd0b66-c780-4dc7-87b5-6aded6912e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:48.368145 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd0b66-c780-4dc7-87b5-6aded6912e4e admin admin] PATH_INFO: `/v3/users/abbd6f20012b46e8b18bc8ceb5320cd1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:48.369541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd0b66-c780-4dc7-87b5-6aded6912e4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=abbd6f20012b46e8b18bc8ceb5320cd1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:48.371622 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd0b66-c780-4dc7-87b5-6aded6912e4e admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:48.374728 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072184b-47bc-467f-9e5c-9876eb3014b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:48.374728 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072184b-47bc-467f-9e5c-9876eb3014b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:48.374728 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072184b-47bc-467f-9e5c-9876eb3014b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:48.374728 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072184b-47bc-467f-9e5c-9876eb3014b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:48.375187 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072184b-47bc-467f-9e5c-9876eb3014b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:48.376986 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072184b-47bc-467f-9e5c-9876eb3014b6 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:48.523950 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:48.531655 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1073/2149] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:25:48 2022] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:25:48.532641 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072184b-47bc-467f-9e5c-9876eb3014b6 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:48.594690 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072184b-47bc-467f-9e5c-9876eb3014b6 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:48.599429 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd35591-339b-430d-a89e-94ed3d9fbf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:48.600044 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd35591-339b-430d-a89e-94ed3d9fbf99 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:48.600329 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd35591-339b-430d-a89e-94ed3d9fbf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:48.600607 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd35591-339b-430d-a89e-94ed3d9fbf99 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:48.601272 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd35591-339b-430d-a89e-94ed3d9fbf99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:48.603280 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd35591-339b-430d-a89e-94ed3d9fbf99 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:48.649416 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-25cd0b66-c780-4dc7-87b5-6aded6912e4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abbd6f20012b46e8b18bc8ceb5320cd1'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:48.650075 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-25cd0b66-c780-4dc7-87b5-6aded6912e4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abbd6f20012b46e8b18bc8ceb5320cd1'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:48.657176 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-25cd0b66-c780-4dc7-87b5-6aded6912e4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abbd6f20012b46e8b18bc8ceb5320cd1'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:48.657813 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-25cd0b66-c780-4dc7-87b5-6aded6912e4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abbd6f20012b46e8b18bc8ceb5320cd1'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:48.662382 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:48.669708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-25cd0b66-c780-4dc7-87b5-6aded6912e4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abbd6f20012b46e8b18bc8ceb5320cd1'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:48.737654 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1074/2150] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:25:48 2022] POST /identity/v3/users => generated 292 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:25:48.741106 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd35591-339b-430d-a89e-94ed3d9fbf99 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:48.742762 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-fcd35591-339b-430d-a89e-94ed3d9fbf99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:48.754830 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd35591-339b-430d-a89e-94ed3d9fbf99 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:48.759381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42aa43-ba98-4638-80ed-8033df4a02e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:48.759956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42aa43-ba98-4638-80ed-8033df4a02e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:48.760236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42aa43-ba98-4638-80ed-8033df4a02e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:48.760507 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42aa43-ba98-4638-80ed-8033df4a02e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:48.761172 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad42aa43-ba98-4638-80ed-8033df4a02e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:48.762743 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad42aa43-ba98-4638-80ed-8033df4a02e7 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:48.771241 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1077/2151] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:25:48 2022] DELETE /identity/v3/users/abbd6f20012b46e8b18bc8ceb5320cd1 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:25:48.774863 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1075/2152] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:25:48.779116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd0b66-c780-4dc7-87b5-6aded6912e4e admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:48.779775 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac4ba8-975d-4190-8187-c53cf1cc8405 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:48.780089 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac4ba8-975d-4190-8187-c53cf1cc8405 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:48.780368 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac4ba8-975d-4190-8187-c53cf1cc8405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:48.799326 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-7eac4ba8-975d-4190-8187-c53cf1cc8405 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:48.800525 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-7eac4ba8-975d-4190-8187-c53cf1cc8405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:48.841188 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd0b66-c780-4dc7-87b5-6aded6912e4e admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:48.845852 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb6f57-50b5-4cd2-9286-e6807d7a37c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:48.846454 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb6f57-50b5-4cd2-9286-e6807d7a37c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:48.846733 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb6f57-50b5-4cd2-9286-e6807d7a37c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:48.847031 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb6f57-50b5-4cd2-9286-e6807d7a37c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:48.847676 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb6f57-50b5-4cd2-9286-e6807d7a37c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:48.849373 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb6f57-50b5-4cd2-9286-e6807d7a37c0 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:48.859775 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1078/2153] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:48.863325 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1076/2154] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:25:48.864519 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb6f57-50b5-4cd2-9286-e6807d7a37c0 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:48.870557 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac4ba8-975d-4190-8187-c53cf1cc8405 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:48.871948 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-7eac4ba8-975d-4190-8187-c53cf1cc8405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:48.874965 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb6f57-50b5-4cd2-9286-e6807d7a37c0 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:48.880817 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f249d-d62d-4fb5-8970-331742472242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:48.880817 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f249d-d62d-4fb5-8970-331742472242 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:48.881141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f249d-d62d-4fb5-8970-331742472242 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:48.881424 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f249d-d62d-4fb5-8970-331742472242 admin admin] PATH_INFO: `/v3/projects/8cacef9c56054f81bd83a7377b987c02/users/9f81e49388b948e8bc95dbb32bfe9462/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:48.897653 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f249d-d62d-4fb5-8970-331742472242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cacef9c56054f81bd83a7377b987c02, user_id=9f81e49388b948e8bc95dbb32bfe9462, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:48.900548 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f249d-d62d-4fb5-8970-331742472242 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:48.932020 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac4ba8-975d-4190-8187-c53cf1cc8405 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:48.936235 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361e633-a9d3-4852-abcc-cbdeb488ff2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:48.936846 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361e633-a9d3-4852-abcc-cbdeb488ff2a service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:48.937156 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361e633-a9d3-4852-abcc-cbdeb488ff2a service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:48.937436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361e633-a9d3-4852-abcc-cbdeb488ff2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:48.946873 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361e633-a9d3-4852-abcc-cbdeb488ff2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:48.948315 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361e633-a9d3-4852-abcc-cbdeb488ff2a service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:48.958472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1077/2155] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:25:49.017255 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1079/2156] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:48 2022] PUT /identity/v3/projects/8cacef9c56054f81bd83a7377b987c02/users/9f81e49388b948e8bc95dbb32bfe9462/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:49.028538 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f7002-3c78-493c-b38d-af3ee7109422 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:49.028832 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f7002-3c78-493c-b38d-af3ee7109422 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:49.029132 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f7002-3c78-493c-b38d-af3ee7109422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:49.064799 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-a61f7002-3c78-493c-b38d-af3ee7109422 None None] MFA Rules not processed for user `9f81e49388b948e8bc95dbb32bfe9462`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:49.065783 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-a61f7002-3c78-493c-b38d-af3ee7109422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:49.159363 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1078/2157] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:49.161112 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f249d-d62d-4fb5-8970-331742472242 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:49.244781 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f249d-d62d-4fb5-8970-331742472242 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:49.250979 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df14e2c-6bad-4d29-9fa2-fb7991a14583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:49.251609 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df14e2c-6bad-4d29-9fa2-fb7991a14583 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:49.251893 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df14e2c-6bad-4d29-9fa2-fb7991a14583 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:49.252169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df14e2c-6bad-4d29-9fa2-fb7991a14583 admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:49.252807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df14e2c-6bad-4d29-9fa2-fb7991a14583 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:49.254998 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df14e2c-6bad-4d29-9fa2-fb7991a14583 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:49.386330 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f7002-3c78-493c-b38d-af3ee7109422 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:49.397461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1080/2158] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:25:49 2022] POST /identity/v3/projects => generated 387 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:25:49.410897 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f7002-3c78-493c-b38d-af3ee7109422 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:49.483222 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ef8d0-6192-48b3-8717-459b2609edc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:49.483848 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ef8d0-6192-48b3-8717-459b2609edc0 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:49.484143 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ef8d0-6192-48b3-8717-459b2609edc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:49.484415 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ef8d0-6192-48b3-8717-459b2609edc0 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:49.485047 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ef8d0-6192-48b3-8717-459b2609edc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:49.487031 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ef8d0-6192-48b3-8717-459b2609edc0 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:49.568712 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1079/2159] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:25:49 2022] POST /identity/v3/users => generated 294 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:25:49.573039 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df14e2c-6bad-4d29-9fa2-fb7991a14583 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:49.573217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ef8d0-6192-48b3-8717-459b2609edc0 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:49.575197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-9df14e2c-6bad-4d29-9fa2-fb7991a14583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:49.584665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ef8d0-6192-48b3-8717-459b2609edc0 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:49.589917 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7359f-5d68-4c2c-a4f5-d5e1c5f4fa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:49.590534 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7359f-5d68-4c2c-a4f5-d5e1c5f4fa18 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:49.592626 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7359f-5d68-4c2c-a4f5-d5e1c5f4fa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:49.592626 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7359f-5d68-4c2c-a4f5-d5e1c5f4fa18 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:49.592910 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7359f-5d68-4c2c-a4f5-d5e1c5f4fa18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:49.594533 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7359f-5d68-4c2c-a4f5-d5e1c5f4fa18 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:49.611313 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1080/2160] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:49.612495 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7359f-5d68-4c2c-a4f5-d5e1c5f4fa18 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:49.615754 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df14e2c-6bad-4d29-9fa2-fb7991a14583 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:49.621361 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9f4ed-5825-40c4-8055-8b7c8870350c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:49.622449 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9f4ed-5825-40c4-8055-8b7c8870350c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:49.622876 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9f4ed-5825-40c4-8055-8b7c8870350c admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:49.623053 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9f4ed-5825-40c4-8055-8b7c8870350c admin admin] PATH_INFO: `/v3/projects/7362f98d61594529abb9bd47ce16b85a` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:49.624114 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7359f-5d68-4c2c-a4f5-d5e1c5f4fa18 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:49.624438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9f4ed-5825-40c4-8055-8b7c8870350c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7362f98d61594529abb9bd47ce16b85a)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:49.628637 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9f4ed-5825-40c4-8055-8b7c8870350c admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:49.630872 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06b430-ad59-4be0-bbeb-5bd2bf15b086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:49.631565 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06b430-ad59-4be0-bbeb-5bd2bf15b086 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:49.631984 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06b430-ad59-4be0-bbeb-5bd2bf15b086 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:49.632275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06b430-ad59-4be0-bbeb-5bd2bf15b086 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:49.637657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06b430-ad59-4be0-bbeb-5bd2bf15b086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:49.637657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06b430-ad59-4be0-bbeb-5bd2bf15b086 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:49.646412 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1081/2161] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:25:49.650891 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06b430-ad59-4be0-bbeb-5bd2bf15b086 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:49.661169 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06b430-ad59-4be0-bbeb-5bd2bf15b086 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:49.672427 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7b030-5ddb-4df4-bdaa-e7d905772e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:49.672427 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7b030-5ddb-4df4-bdaa-e7d905772e7b admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:49.672427 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7b030-5ddb-4df4-bdaa-e7d905772e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:49.672427 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7b030-5ddb-4df4-bdaa-e7d905772e7b admin admin] PATH_INFO: `/v3/projects/11f4e8bfff75458e86bc351356ef8169/users/1cedda7c857941098158eec1d1d140d0/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:49.685108 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7b030-5ddb-4df4-bdaa-e7d905772e7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=11f4e8bfff75458e86bc351356ef8169, user_id=1cedda7c857941098158eec1d1d140d0, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:49.687793 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7b030-5ddb-4df4-bdaa-e7d905772e7b admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:49.754331 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1082/2162] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:49 2022] PUT /identity/v3/projects/11f4e8bfff75458e86bc351356ef8169/users/1cedda7c857941098158eec1d1d140d0/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:25:49.763000 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-bbe9f4ed-5825-40c4-8055-8b7c8870350c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7362f98d61594529abb9bd47ce16b85a', 'request_id': 'req-bbe9f4ed-5825-40c4-8055-8b7c8870350c'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:49.765331 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932e43e-11f7-4075-8450-f474df7eceaf None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:49.765625 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932e43e-11f7-4075-8450-f474df7eceaf None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:49.765905 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932e43e-11f7-4075-8450-f474df7eceaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:49.770532 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-bbe9f4ed-5825-40c4-8055-8b7c8870350c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7362f98d61594529abb9bd47ce16b85a', 'request_id': 'req-bbe9f4ed-5825-40c4-8055-8b7c8870350c'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:49.776037 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-bbe9f4ed-5825-40c4-8055-8b7c8870350c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7362f98d61594529abb9bd47ce16b85a', 'request_id': 'req-bbe9f4ed-5825-40c4-8055-8b7c8870350c'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:49.798497 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-3932e43e-11f7-4075-8450-f474df7eceaf None None] MFA Rules not processed for user `1cedda7c857941098158eec1d1d140d0`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:49.798497 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-3932e43e-11f7-4075-8450-f474df7eceaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:49.855286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-bbe9f4ed-5825-40c4-8055-8b7c8870350c admin admin] The token cache is being invalidate because project 7362f98d61594529abb9bd47ce16b85a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:25:49.855584 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-bbe9f4ed-5825-40c4-8055-8b7c8870350c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:49.856254 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-bbe9f4ed-5825-40c4-8055-8b7c8870350c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:49.858089 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1081/2163] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:25:49 2022] DELETE /identity/v3/projects/7362f98d61594529abb9bd47ce16b85a => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:49.861803 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1083/2164] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:25:49.861936 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9f4ed-5825-40c4-8055-8b7c8870350c admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:49.863150 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-bbe9f4ed-5825-40c4-8055-8b7c8870350c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:49.866005 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932e43e-11f7-4075-8450-f474df7eceaf None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:49.928552 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9f4ed-5825-40c4-8055-8b7c8870350c admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:49.930715 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932e43e-11f7-4075-8450-f474df7eceaf None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:49.933216 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2e7a0-c06f-49cf-85be-0970e4f19468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:49.933851 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2e7a0-c06f-49cf-85be-0970e4f19468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:49.934134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2e7a0-c06f-49cf-85be-0970e4f19468 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:49.934410 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2e7a0-c06f-49cf-85be-0970e4f19468 admin admin] PATH_INFO: `/v3/users/3a8a460a31ce4a67be6c64a7fcf67d94` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:49.935265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e369f7-9420-4e5d-8f30-da84d42099d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:49.935530 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2e7a0-c06f-49cf-85be-0970e4f19468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a8a460a31ce4a67be6c64a7fcf67d94)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:49.935867 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e369f7-9420-4e5d-8f30-da84d42099d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:49.936153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e369f7-9420-4e5d-8f30-da84d42099d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:49.936421 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e369f7-9420-4e5d-8f30-da84d42099d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:49.937046 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e369f7-9420-4e5d-8f30-da84d42099d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:49.937508 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2e7a0-c06f-49cf-85be-0970e4f19468 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:49.938982 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e369f7-9420-4e5d-8f30-da84d42099d4 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:50.012874 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1084/2165] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:25:49 2022] POST /identity/v3/projects => generated 387 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:25:50.017232 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e369f7-9420-4e5d-8f30-da84d42099d4 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:50.018801 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-b5e369f7-9420-4e5d-8f30-da84d42099d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:50.081735 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e369f7-9420-4e5d-8f30-da84d42099d4 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:50.086254 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e60bcb-3294-4b47-8005-63d97741871e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:50.086863 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e60bcb-3294-4b47-8005-63d97741871e admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:50.087148 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e60bcb-3294-4b47-8005-63d97741871e admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:50.087431 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e60bcb-3294-4b47-8005-63d97741871e admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:50.088056 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e60bcb-3294-4b47-8005-63d97741871e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:50.090003 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e60bcb-3294-4b47-8005-63d97741871e admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:50.108014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-84c2e7a0-c06f-49cf-85be-0970e4f19468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a8a460a31ce4a67be6c64a7fcf67d94'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:50.108736 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-84c2e7a0-c06f-49cf-85be-0970e4f19468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a8a460a31ce4a67be6c64a7fcf67d94'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:50.116224 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-84c2e7a0-c06f-49cf-85be-0970e4f19468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a8a460a31ce4a67be6c64a7fcf67d94'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:50.116935 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-84c2e7a0-c06f-49cf-85be-0970e4f19468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a8a460a31ce4a67be6c64a7fcf67d94'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:50.129788 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-84c2e7a0-c06f-49cf-85be-0970e4f19468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a8a460a31ce4a67be6c64a7fcf67d94'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:50.164944 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1085/2166] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:25:50 2022] POST /identity/v3/users => generated 300 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:25:50.168992 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e60bcb-3294-4b47-8005-63d97741871e admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:50.170852 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-a0e60bcb-3294-4b47-8005-63d97741871e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:50.183049 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e60bcb-3294-4b47-8005-63d97741871e admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:50.188352 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39957802-9837-471f-97e0-f37bc8231172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:50.188932 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39957802-9837-471f-97e0-f37bc8231172 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:50.189248 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39957802-9837-471f-97e0-f37bc8231172 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:50.189523 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39957802-9837-471f-97e0-f37bc8231172 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:50.190199 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39957802-9837-471f-97e0-f37bc8231172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:50.191787 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39957802-9837-471f-97e0-f37bc8231172 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:50.202236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1086/2167] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:25:50.206330 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39957802-9837-471f-97e0-f37bc8231172 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:50.216439 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39957802-9837-471f-97e0-f37bc8231172 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:50.221043 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5d63e-2dd7-4b62-a4ec-8cb64c8a1acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:50.237158 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5d63e-2dd7-4b62-a4ec-8cb64c8a1acb admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:50.237276 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1082/2168] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:25:49 2022] DELETE /identity/v3/users/3a8a460a31ce4a67be6c64a7fcf67d94 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:25:50.237367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5d63e-2dd7-4b62-a4ec-8cb64c8a1acb admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:50.237367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5d63e-2dd7-4b62-a4ec-8cb64c8a1acb admin admin] PATH_INFO: `/v3/projects/56b7e7d5c56549d697269eb1772512ef/users/43b70c95aafe4151af6d0ade7ae8db23/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:50.237367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5d63e-2dd7-4b62-a4ec-8cb64c8a1acb admin admin] RBAC: Authorizing `identity:create_grant(project_id=56b7e7d5c56549d697269eb1772512ef, user_id=43b70c95aafe4151af6d0ade7ae8db23, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:50.239259 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5d63e-2dd7-4b62-a4ec-8cb64c8a1acb admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:50.359957 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1087/2169] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:50 2022] PUT /identity/v3/projects/56b7e7d5c56549d697269eb1772512ef/users/43b70c95aafe4151af6d0ade7ae8db23/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:25:50.362468 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2e7a0-c06f-49cf-85be-0970e4f19468 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:50.437310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2e7a0-c06f-49cf-85be-0970e4f19468 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:50.514041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b38ca8-f417-4f65-ac32-a1122dc6c96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:50.514685 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b38ca8-f417-4f65-ac32-a1122dc6c96a admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:50.515147 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b38ca8-f417-4f65-ac32-a1122dc6c96a admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:50.515434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b38ca8-f417-4f65-ac32-a1122dc6c96a admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:50.516103 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b38ca8-f417-4f65-ac32-a1122dc6c96a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:50.532440 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b38ca8-f417-4f65-ac32-a1122dc6c96a admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:50.547199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1083/2170] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:50.551331 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5d63e-2dd7-4b62-a4ec-8cb64c8a1acb admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:50.571618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5d63e-2dd7-4b62-a4ec-8cb64c8a1acb admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:50.577018 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c9caa-ddb2-4166-a5f3-f8f15bceda38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:50.577730 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c9caa-ddb2-4166-a5f3-f8f15bceda38 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:50.578025 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c9caa-ddb2-4166-a5f3-f8f15bceda38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:50.578292 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c9caa-ddb2-4166-a5f3-f8f15bceda38 admin admin] PATH_INFO: `/v3/projects/56b7e7d5c56549d697269eb1772512ef/users/43b70c95aafe4151af6d0ade7ae8db23/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:50.580179 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c9caa-ddb2-4166-a5f3-f8f15bceda38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56b7e7d5c56549d697269eb1772512ef, user_id=43b70c95aafe4151af6d0ade7ae8db23, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:50.582953 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c9caa-ddb2-4166-a5f3-f8f15bceda38 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:50.594517 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1088/2171] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:50 2022] PUT /identity/v3/projects/56b7e7d5c56549d697269eb1772512ef/users/43b70c95aafe4151af6d0ade7ae8db23/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:50.604836 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fca75-d5ee-4671-a84c-91ef6a6cb163 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:50.605150 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fca75-d5ee-4671-a84c-91ef6a6cb163 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:50.605433 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fca75-d5ee-4671-a84c-91ef6a6cb163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:50.639414 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-c07fca75-d5ee-4671-a84c-91ef6a6cb163 None None] MFA Rules not processed for user `43b70c95aafe4151af6d0ade7ae8db23`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:50.641030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-c07fca75-d5ee-4671-a84c-91ef6a6cb163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:50.786824 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1084/2172] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:50 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:25:50.921637 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c9caa-ddb2-4166-a5f3-f8f15bceda38 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:50.923447 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c57c9caa-ddb2-4166-a5f3-f8f15bceda38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:50.992001 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c9caa-ddb2-4166-a5f3-f8f15bceda38 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:50.996619 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92b70e-152c-41e5-9dac-977d2c11aaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:50.997286 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92b70e-152c-41e5-9dac-977d2c11aaba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:50.997588 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92b70e-152c-41e5-9dac-977d2c11aaba admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:50.997901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92b70e-152c-41e5-9dac-977d2c11aaba admin admin] PATH_INFO: `/v3/projects/54e3028c5d3c463bb2af34a28bb098a0` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:50.999020 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92b70e-152c-41e5-9dac-977d2c11aaba admin admin] RBAC: Authorizing `identity:delete_project(project_id=54e3028c5d3c463bb2af34a28bb098a0)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:51.000920 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92b70e-152c-41e5-9dac-977d2c11aaba admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:51.062178 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fca75-d5ee-4671-a84c-91ef6a6cb163 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:51.063651 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-c07fca75-d5ee-4671-a84c-91ef6a6cb163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:51.097894 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-0f92b70e-152c-41e5-9dac-977d2c11aaba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54e3028c5d3c463bb2af34a28bb098a0', 'request_id': 'req-0f92b70e-152c-41e5-9dac-977d2c11aaba'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:51.104683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-0f92b70e-152c-41e5-9dac-977d2c11aaba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54e3028c5d3c463bb2af34a28bb098a0', 'request_id': 'req-0f92b70e-152c-41e5-9dac-977d2c11aaba'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:51.112563 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-0f92b70e-152c-41e5-9dac-977d2c11aaba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54e3028c5d3c463bb2af34a28bb098a0', 'request_id': 'req-0f92b70e-152c-41e5-9dac-977d2c11aaba'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:51.124655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fca75-d5ee-4671-a84c-91ef6a6cb163 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:51.180593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e997d7-6929-4a5c-b4a9-32f201cca07c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:51.181263 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e997d7-6929-4a5c-b4a9-32f201cca07c service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:51.181651 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e997d7-6929-4a5c-b4a9-32f201cca07c service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:51.181871 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e997d7-6929-4a5c-b4a9-32f201cca07c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:51.207414 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:51.213732 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-0f92b70e-152c-41e5-9dac-977d2c11aaba admin admin] The token cache is being invalidate because project 54e3028c5d3c463bb2af34a28bb098a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:25:51.214169 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-0f92b70e-152c-41e5-9dac-977d2c11aaba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:51.215843 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-0f92b70e-152c-41e5-9dac-977d2c11aaba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:51.221800 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1089/2173] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:25:50 2022] DELETE /identity/v3/projects/54e3028c5d3c463bb2af34a28bb098a0 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:51.223767 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6b1b4-672d-4467-bfe0-2871b47375de None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:51.224161 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6b1b4-672d-4467-bfe0-2871b47375de None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:51.224703 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6b1b4-672d-4467-bfe0-2871b47375de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:51.254277 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-24e6b1b4-672d-4467-bfe0-2871b47375de None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:51.255834 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-24e6b1b4-672d-4467-bfe0-2871b47375de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:51.262819 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e997d7-6929-4a5c-b4a9-32f201cca07c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:51.264947 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e997d7-6929-4a5c-b4a9-32f201cca07c service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:51.286941 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1085/2174] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:51 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:25:51.322012 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:51.368982 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1090/2175] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:51.376887 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c31ca-1559-4119-98e3-277d6caed886 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:51.377214 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c31ca-1559-4119-98e3-277d6caed886 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:51.377498 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c31ca-1559-4119-98e3-277d6caed886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:51.415482 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-9e3c31ca-1559-4119-98e3-277d6caed886 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:51.417321 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-9e3c31ca-1559-4119-98e3-277d6caed886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:51.428613 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1086/2176] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:51.433025 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6b1b4-672d-4467-bfe0-2871b47375de None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:51.442750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6b1b4-672d-4467-bfe0-2871b47375de None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:51.447530 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dc49b-4625-419d-bb0c-aab91fa377a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:51.448141 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dc49b-4625-419d-bb0c-aab91fa377a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:51.448423 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dc49b-4625-419d-bb0c-aab91fa377a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:51.448699 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dc49b-4625-419d-bb0c-aab91fa377a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:51.449398 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70dc49b-4625-419d-bb0c-aab91fa377a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:25:51.449855 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70dc49b-4625-419d-bb0c-aab91fa377a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:51.452163 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70dc49b-4625-419d-bb0c-aab91fa377a7 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:51.464891 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1091/2177] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:25:51.470148 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c31ca-1559-4119-98e3-277d6caed886 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:51.479671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c31ca-1559-4119-98e3-277d6caed886 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:51.484426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e872000-9c38-4f2c-9d31-07da6d00c942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:51.485028 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e872000-9c38-4f2c-9d31-07da6d00c942 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:51.485343 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e872000-9c38-4f2c-9d31-07da6d00c942 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:51.485621 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e872000-9c38-4f2c-9d31-07da6d00c942 admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:51.486254 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e872000-9c38-4f2c-9d31-07da6d00c942 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:51.488168 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e872000-9c38-4f2c-9d31-07da6d00c942 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:51.610692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1087/2178] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:25:51 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:25:51.611886 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dc49b-4625-419d-bb0c-aab91fa377a7 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:51.623051 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dc49b-4625-419d-bb0c-aab91fa377a7 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:51.695001 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd9692-e607-4db8-9e42-a3e5d0365404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:51.695675 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd9692-e607-4db8-9e42-a3e5d0365404 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:51.695971 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd9692-e607-4db8-9e42-a3e5d0365404 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:51.696271 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd9692-e607-4db8-9e42-a3e5d0365404 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:51.697019 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd9692-e607-4db8-9e42-a3e5d0365404 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:51.698957 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd9692-e607-4db8-9e42-a3e5d0365404 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:51.833878 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1092/2179] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:25:51 2022] POST /identity/v3/users => generated 288 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:25:51.837374 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e872000-9c38-4f2c-9d31-07da6d00c942 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:51.849402 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e872000-9c38-4f2c-9d31-07da6d00c942 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:51.858240 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d5fc7-9f86-4a4d-af37-b888ae977cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:51.858240 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d5fc7-9f86-4a4d-af37-b888ae977cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:51.858240 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d5fc7-9f86-4a4d-af37-b888ae977cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:51.858240 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d5fc7-9f86-4a4d-af37-b888ae977cc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:51.858622 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d5fc7-9f86-4a4d-af37-b888ae977cc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:51.859010 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d5fc7-9f86-4a4d-af37-b888ae977cc6 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:51.877194 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1088/2180] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:51.879096 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd9692-e607-4db8-9e42-a3e5d0365404 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:51.890520 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd9692-e607-4db8-9e42-a3e5d0365404 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:51.896359 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0e8eb-b0df-445f-874e-1c65d2e30d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:51.897119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0e8eb-b0df-445f-874e-1c65d2e30d26 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:51.898367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0e8eb-b0df-445f-874e-1c65d2e30d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:51.898367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0e8eb-b0df-445f-874e-1c65d2e30d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:51.899134 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0e8eb-b0df-445f-874e-1c65d2e30d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:51.900876 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0e8eb-b0df-445f-874e-1c65d2e30d26 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:51.915410 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1093/2181] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:51.925445 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d5fc7-9f86-4a4d-af37-b888ae977cc6 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:51.966352 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d5fc7-9f86-4a4d-af37-b888ae977cc6 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:51.974755 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76917588-1fe7-4453-8ffa-c7e7dc715681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:51.975460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76917588-1fe7-4453-8ffa-c7e7dc715681 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:51.975724 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76917588-1fe7-4453-8ffa-c7e7dc715681 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:51.977688 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76917588-1fe7-4453-8ffa-c7e7dc715681 admin admin] PATH_INFO: `/v3/projects/7d1e175c8f2546ff8e0079909eda2878/users/c7b5c33439794dc3b5d7ad7ed261fd4c/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:51.997426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76917588-1fe7-4453-8ffa-c7e7dc715681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d1e175c8f2546ff8e0079909eda2878, user_id=c7b5c33439794dc3b5d7ad7ed261fd4c, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:52.001140 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76917588-1fe7-4453-8ffa-c7e7dc715681 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:52.081258 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1089/2182] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:51 2022] PUT /identity/v3/projects/7d1e175c8f2546ff8e0079909eda2878/users/c7b5c33439794dc3b5d7ad7ed261fd4c/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:52.091800 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ef986-5700-4cf6-b95e-4ca95557903a None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:52.092094 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ef986-5700-4cf6-b95e-4ca95557903a None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:52.092417 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ef986-5700-4cf6-b95e-4ca95557903a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:52.124906 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-234ef986-5700-4cf6-b95e-4ca95557903a None None] MFA Rules not processed for user `c7b5c33439794dc3b5d7ad7ed261fd4c`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:52.126109 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-234ef986-5700-4cf6-b95e-4ca95557903a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:52.207534 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1094/2183] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:52.219164 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76917588-1fe7-4453-8ffa-c7e7dc715681 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:52.221031 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-76917588-1fe7-4453-8ffa-c7e7dc715681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:52.281457 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76917588-1fe7-4453-8ffa-c7e7dc715681 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:52.285078 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1676a-7734-4274-acb0-4b8c35a64659 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:52.285714 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1676a-7734-4274-acb0-4b8c35a64659 service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:52.286106 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1676a-7734-4274-acb0-4b8c35a64659 service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:52.286554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1676a-7734-4274-acb0-4b8c35a64659 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:52.296036 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1676a-7734-4274-acb0-4b8c35a64659 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:52.297625 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1676a-7734-4274-acb0-4b8c35a64659 service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:52.306735 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1090/2184] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:25:52.622754 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:52.968870 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ef986-5700-4cf6-b95e-4ca95557903a None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:52.970568 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-234ef986-5700-4cf6-b95e-4ca95557903a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:52.985333 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ef986-5700-4cf6-b95e-4ca95557903a None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:53.003679 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfbc10-40a3-4a8d-8859-78e176da6f54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:53.004329 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfbc10-40a3-4a8d-8859-78e176da6f54 service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:53.004620 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfbc10-40a3-4a8d-8859-78e176da6f54 service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:53.004896 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfbc10-40a3-4a8d-8859-78e176da6f54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:53.010249 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-bdcfbc10-40a3-4a8d-8859-78e176da6f54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:53.079869 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfbc10-40a3-4a8d-8859-78e176da6f54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:53.081541 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfbc10-40a3-4a8d-8859-78e176da6f54 service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:53.090771 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1095/2185] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:25:53.611214 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:54.885313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:55.662478 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:56.817432 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:56.838718 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1676a-7734-4274-acb0-4b8c35a64659 service cinder] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:56.909185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1676a-7734-4274-acb0-4b8c35a64659 service cinder] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:56.920352 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d9ba9-908e-44f4-98b7-fc90f23535ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:56.921012 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d9ba9-908e-44f4-98b7-fc90f23535ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:56.921318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d9ba9-908e-44f4-98b7-fc90f23535ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:56.921594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d9ba9-908e-44f4-98b7-fc90f23535ee admin admin] PATH_INFO: `/v3/users/c7b5c33439794dc3b5d7ad7ed261fd4c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:56.922774 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d9ba9-908e-44f4-98b7-fc90f23535ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7b5c33439794dc3b5d7ad7ed261fd4c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:56.925134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d9ba9-908e-44f4-98b7-fc90f23535ee admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:57.024937 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b8083-e53d-4560-ba83-962079e38675 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:57.025455 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b8083-e53d-4560-ba83-962079e38675 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:57.025561 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b8083-e53d-4560-ba83-962079e38675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:57.045380 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-901b8083-e53d-4560-ba83-962079e38675 None None] MFA Rules not processed for user `c78d6f1e27a14dba8a9a4c81eb08b384`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:57.046575 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-901b8083-e53d-4560-ba83-962079e38675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:57.118975 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1096/2186] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:25:57.188797 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-381d9ba9-908e-44f4-98b7-fc90f23535ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7b5c33439794dc3b5d7ad7ed261fd4c'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:57.189566 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-381d9ba9-908e-44f4-98b7-fc90f23535ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7b5c33439794dc3b5d7ad7ed261fd4c'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:57.198856 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-381d9ba9-908e-44f4-98b7-fc90f23535ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7b5c33439794dc3b5d7ad7ed261fd4c'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:57.199604 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-381d9ba9-908e-44f4-98b7-fc90f23535ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7b5c33439794dc3b5d7ad7ed261fd4c'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:57.213967 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-381d9ba9-908e-44f4-98b7-fc90f23535ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7b5c33439794dc3b5d7ad7ed261fd4c'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:57.337142 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1091/2187] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:25:56 2022] DELETE /identity/v3/users/c7b5c33439794dc3b5d7ad7ed261fd4c => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:57.342042 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3e6bc-34c9-4add-828b-9eebb4b1b793 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:57.342751 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3e6bc-34c9-4add-828b-9eebb4b1b793 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:57.343186 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3e6bc-34c9-4add-828b-9eebb4b1b793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:57.364485 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-8ea3e6bc-34c9-4add-828b-9eebb4b1b793 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:57.365859 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-8ea3e6bc-34c9-4add-828b-9eebb4b1b793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:57.432827 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1097/2188] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:57.442689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d9ba9-908e-44f4-98b7-fc90f23535ee admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:57.444138 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-381d9ba9-908e-44f4-98b7-fc90f23535ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:57.508988 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d9ba9-908e-44f4-98b7-fc90f23535ee admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:57.514411 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f2460-e178-451d-9be0-c8fd51a86a0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:57.515064 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f2460-e178-451d-9be0-c8fd51a86a0f service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:57.515420 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f2460-e178-451d-9be0-c8fd51a86a0f service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:57.515680 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f2460-e178-451d-9be0-c8fd51a86a0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:57.526431 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f2460-e178-451d-9be0-c8fd51a86a0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:57.528306 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f2460-e178-451d-9be0-c8fd51a86a0f service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:57.538411 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1092/2189] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:25:57.707522 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:58.035383 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3e6bc-34c9-4add-828b-9eebb4b1b793 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:58.040623 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-8ea3e6bc-34c9-4add-828b-9eebb4b1b793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:58.073268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3e6bc-34c9-4add-828b-9eebb4b1b793 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:58.087802 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e2952-df70-4b59-9130-69da1f8763cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:58.088828 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e2952-df70-4b59-9130-69da1f8763cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:58.089330 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e2952-df70-4b59-9130-69da1f8763cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:58.089774 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e2952-df70-4b59-9130-69da1f8763cc admin admin] PATH_INFO: `/v3/projects/7d1e175c8f2546ff8e0079909eda2878` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:58.091110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e2952-df70-4b59-9130-69da1f8763cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d1e175c8f2546ff8e0079909eda2878)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:58.094111 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e2952-df70-4b59-9130-69da1f8763cc admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:58.250760 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-366e2952-df70-4b59-9130-69da1f8763cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d1e175c8f2546ff8e0079909eda2878', 'request_id': 'req-366e2952-df70-4b59-9130-69da1f8763cc'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:58.258372 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-366e2952-df70-4b59-9130-69da1f8763cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d1e175c8f2546ff8e0079909eda2878', 'request_id': 'req-366e2952-df70-4b59-9130-69da1f8763cc'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:58.267168 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-366e2952-df70-4b59-9130-69da1f8763cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d1e175c8f2546ff8e0079909eda2878', 'request_id': 'req-366e2952-df70-4b59-9130-69da1f8763cc'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:58.383677 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-366e2952-df70-4b59-9130-69da1f8763cc admin admin] The token cache is being invalidate because project 7d1e175c8f2546ff8e0079909eda2878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:25:58.383994 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-366e2952-df70-4b59-9130-69da1f8763cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:58.384658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-366e2952-df70-4b59-9130-69da1f8763cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:25:58.388744 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1098/2190] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:25:58 2022] DELETE /identity/v3/projects/7d1e175c8f2546ff8e0079909eda2878 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:58.393879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78de21-a578-40a7-af5b-2ebac76efc52 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:58.394336 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78de21-a578-40a7-af5b-2ebac76efc52 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:58.394590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78de21-a578-40a7-af5b-2ebac76efc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:58.437621 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-5c78de21-a578-40a7-af5b-2ebac76efc52 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:58.438837 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-5c78de21-a578-40a7-af5b-2ebac76efc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:58.544981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1093/2191] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:58.553669 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48dbca-1bdf-4385-8bd0-0ee14fbe7273 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:58.554183 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48dbca-1bdf-4385-8bd0-0ee14fbe7273 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:58.554531 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48dbca-1bdf-4385-8bd0-0ee14fbe7273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:58.576650 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-7d48dbca-1bdf-4385-8bd0-0ee14fbe7273 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:58.577906 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-7d48dbca-1bdf-4385-8bd0-0ee14fbe7273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:58.586419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1099/2192] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:58.591278 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78de21-a578-40a7-af5b-2ebac76efc52 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:58.604544 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78de21-a578-40a7-af5b-2ebac76efc52 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:58.612618 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847747b-209e-40c6-a35c-fa81371f52cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:58.613459 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847747b-209e-40c6-a35c-fa81371f52cc admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:58.613725 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847747b-209e-40c6-a35c-fa81371f52cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:58.614109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847747b-209e-40c6-a35c-fa81371f52cc admin admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:58.614839 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847747b-209e-40c6-a35c-fa81371f52cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:25:58.615197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847747b-209e-40c6-a35c-fa81371f52cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:58.617195 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847747b-209e-40c6-a35c-fa81371f52cc admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:58.636823 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1094/2193] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:25:58.642324 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48dbca-1bdf-4385-8bd0-0ee14fbe7273 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:58.656031 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48dbca-1bdf-4385-8bd0-0ee14fbe7273 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:58.661263 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1bd22-53e6-4187-bab7-36cb9c3f92c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:58.661964 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1bd22-53e6-4187-bab7-36cb9c3f92c1 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:58.663716 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1bd22-53e6-4187-bab7-36cb9c3f92c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:58.663716 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1bd22-53e6-4187-bab7-36cb9c3f92c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:58.663716 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1bd22-53e6-4187-bab7-36cb9c3f92c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:58.665181 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1bd22-53e6-4187-bab7-36cb9c3f92c1 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:58.717469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847747b-209e-40c6-a35c-fa81371f52cc admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:58.721316 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-e847747b-209e-40c6-a35c-fa81371f52cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:58.789854 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847747b-209e-40c6-a35c-fa81371f52cc admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:58.797136 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1100/2194] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:25:58 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:25:58.801054 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1bd22-53e6-4187-bab7-36cb9c3f92c1 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:58.803324 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e682f8-52f6-4c44-a1ca-3e23a738bfea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:58.803965 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e682f8-52f6-4c44-a1ca-3e23a738bfea service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:58.804495 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e682f8-52f6-4c44-a1ca-3e23a738bfea service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:58.804495 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e682f8-52f6-4c44-a1ca-3e23a738bfea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:58.806521 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-f3e682f8-52f6-4c44-a1ca-3e23a738bfea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:58.865783 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1bd22-53e6-4187-bab7-36cb9c3f92c1 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:58.866771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e682f8-52f6-4c44-a1ca-3e23a738bfea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:58.868219 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e682f8-52f6-4c44-a1ca-3e23a738bfea service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:58.870521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4688d-394c-44e9-b7cd-a62a54d68742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:58.871251 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4688d-394c-44e9-b7cd-a62a54d68742 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:58.871539 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4688d-394c-44e9-b7cd-a62a54d68742 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:58.871929 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4688d-394c-44e9-b7cd-a62a54d68742 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:58.872650 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4688d-394c-44e9-b7cd-a62a54d68742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:58.875295 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4688d-394c-44e9-b7cd-a62a54d68742 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:58.881076 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1095/2195] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:25:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:25:58.977130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1101/2196] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:25:58 2022] POST /identity/v3/users => generated 292 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:25:58.981002 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e682f8-52f6-4c44-a1ca-3e23a738bfea service cinder] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:58.993344 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e682f8-52f6-4c44-a1ca-3e23a738bfea service cinder] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:59.000663 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc08d43-dbec-415e-a8c2-f49dc8b7bec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:59.001397 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc08d43-dbec-415e-a8c2-f49dc8b7bec0 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:59.001681 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc08d43-dbec-415e-a8c2-f49dc8b7bec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:59.001956 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc08d43-dbec-415e-a8c2-f49dc8b7bec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:59.002610 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc08d43-dbec-415e-a8c2-f49dc8b7bec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:59.004286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc08d43-dbec-415e-a8c2-f49dc8b7bec0 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:59.015334 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1096/2197] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:25:59.019481 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4688d-394c-44e9-b7cd-a62a54d68742 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:59.037312 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4688d-394c-44e9-b7cd-a62a54d68742 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:59.043089 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85923654-ae3c-4ac7-a187-16d3b068b554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:59.043778 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85923654-ae3c-4ac7-a187-16d3b068b554 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:59.044043 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85923654-ae3c-4ac7-a187-16d3b068b554 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:59.044316 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85923654-ae3c-4ac7-a187-16d3b068b554 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:59.045029 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85923654-ae3c-4ac7-a187-16d3b068b554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:59.046732 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85923654-ae3c-4ac7-a187-16d3b068b554 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:59.057557 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1102/2198] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:25:59.062116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc08d43-dbec-415e-a8c2-f49dc8b7bec0 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:59.072382 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc08d43-dbec-415e-a8c2-f49dc8b7bec0 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:59.077548 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b16b3-81a8-422c-9563-7d060a2a6082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:59.078260 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b16b3-81a8-422c-9563-7d060a2a6082 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:59.078542 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b16b3-81a8-422c-9563-7d060a2a6082 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:59.078813 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b16b3-81a8-422c-9563-7d060a2a6082 admin admin] PATH_INFO: `/v3/projects/c6cd9f065e0d4be88e42fa2ec3bb6ff3/users/9f7369d5f8c947caa6d4f0ce4ef5cc65/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:59.105835 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b16b3-81a8-422c-9563-7d060a2a6082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6cd9f065e0d4be88e42fa2ec3bb6ff3, user_id=9f7369d5f8c947caa6d4f0ce4ef5cc65, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:59.108745 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b16b3-81a8-422c-9563-7d060a2a6082 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:59.183511 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1097/2199] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:59 2022] PUT /identity/v3/projects/c6cd9f065e0d4be88e42fa2ec3bb6ff3/users/9f7369d5f8c947caa6d4f0ce4ef5cc65/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:25:59.194866 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00484d1-5813-4e4d-af2c-e9bff1b02028 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:59.195162 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00484d1-5813-4e4d-af2c-e9bff1b02028 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:59.195447 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00484d1-5813-4e4d-af2c-e9bff1b02028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:59.227323 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-d00484d1-5813-4e4d-af2c-e9bff1b02028 None None] MFA Rules not processed for user `9f7369d5f8c947caa6d4f0ce4ef5cc65`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:59.228644 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-d00484d1-5813-4e4d-af2c-e9bff1b02028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:25:59.296647 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1103/2200] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:25:59.301171 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b16b3-81a8-422c-9563-7d060a2a6082 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:59.363661 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b16b3-81a8-422c-9563-7d060a2a6082 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:59.368251 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4e299-a510-4e89-b7f5-4a1b22e8084f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:59.368941 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4e299-a510-4e89-b7f5-4a1b22e8084f admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:59.369268 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4e299-a510-4e89-b7f5-4a1b22e8084f admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:59.369545 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4e299-a510-4e89-b7f5-4a1b22e8084f admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:59.370168 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4e299-a510-4e89-b7f5-4a1b22e8084f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:59.372710 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4e299-a510-4e89-b7f5-4a1b22e8084f admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:59.478562 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1098/2201] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:25:59 2022] POST /identity/v3/projects => generated 383 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:25:59.485394 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00484d1-5813-4e4d-af2c-e9bff1b02028 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:59.496526 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00484d1-5813-4e4d-af2c-e9bff1b02028 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:59.519278 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:25:59.565311 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2186b5-f81d-4f6b-b59f-bfa98e0a5b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:59.566310 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2186b5-f81d-4f6b-b59f-bfa98e0a5b58 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:59.566657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2186b5-f81d-4f6b-b59f-bfa98e0a5b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:59.566996 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2186b5-f81d-4f6b-b59f-bfa98e0a5b58 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:59.567696 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2186b5-f81d-4f6b-b59f-bfa98e0a5b58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:59.571516 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2186b5-f81d-4f6b-b59f-bfa98e0a5b58 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:59.651588 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1104/2202] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:25:59 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:25:59.660405 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4e299-a510-4e89-b7f5-4a1b22e8084f admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:59.673869 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4e299-a510-4e89-b7f5-4a1b22e8084f admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:59.681371 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22287826-3381-4bab-b7d8-c6a9820884df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:59.682451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22287826-3381-4bab-b7d8-c6a9820884df admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:59.682734 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22287826-3381-4bab-b7d8-c6a9820884df admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:59.683010 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22287826-3381-4bab-b7d8-c6a9820884df admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:59.683674 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22287826-3381-4bab-b7d8-c6a9820884df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:59.686259 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22287826-3381-4bab-b7d8-c6a9820884df admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:59.699060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1099/2203] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:59.706892 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2186b5-f81d-4f6b-b59f-bfa98e0a5b58 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:59.727614 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2186b5-f81d-4f6b-b59f-bfa98e0a5b58 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:59.733385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be3ce19-a725-41be-8ac8-8d625a46c742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:59.734102 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3ce19-a725-41be-8ac8-8d625a46c742 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:59.734386 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3ce19-a725-41be-8ac8-8d625a46c742 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:59.734666 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3ce19-a725-41be-8ac8-8d625a46c742 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:59.735599 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be3ce19-a725-41be-8ac8-8d625a46c742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:59.737234 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be3ce19-a725-41be-8ac8-8d625a46c742 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:59.748113 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1105/2204] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:25:59.752507 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22287826-3381-4bab-b7d8-c6a9820884df admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:25:59.762910 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22287826-3381-4bab-b7d8-c6a9820884df admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:25:59.767483 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f4f26-3614-4fd7-936b-2ebecfad7a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:25:59.768108 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f4f26-3614-4fd7-936b-2ebecfad7a2a admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:59.768502 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f4f26-3614-4fd7-936b-2ebecfad7a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:59.768778 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f4f26-3614-4fd7-936b-2ebecfad7a2a admin admin] PATH_INFO: `/v3/projects/c5a365a19a424355b642e3471c757321/users/46311983be5e473b85da3e0e37dbfb13/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:59.798013 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f4f26-3614-4fd7-936b-2ebecfad7a2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5a365a19a424355b642e3471c757321, user_id=46311983be5e473b85da3e0e37dbfb13, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:25:59.801154 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f4f26-3614-4fd7-936b-2ebecfad7a2a admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:25:59.901628 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1100/2205] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:25:59 2022] PUT /identity/v3/projects/c5a365a19a424355b642e3471c757321/users/46311983be5e473b85da3e0e37dbfb13/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:25:59.914041 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11aaff-a14d-4949-98f0-07f9b3da9409 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:25:59.914334 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11aaff-a14d-4949-98f0-07f9b3da9409 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:25:59.914612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11aaff-a14d-4949-98f0-07f9b3da9409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:25:59.966418 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-8f11aaff-a14d-4949-98f0-07f9b3da9409 None None] MFA Rules not processed for user `46311983be5e473b85da3e0e37dbfb13`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:25:59.971966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-8f11aaff-a14d-4949-98f0-07f9b3da9409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:00.042560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1106/2206] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:25:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:00.047742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f4f26-3614-4fd7-936b-2ebecfad7a2a admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:00.111015 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f4f26-3614-4fd7-936b-2ebecfad7a2a admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:00.115997 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce200470-b222-434a-aa72-9bd9a11840cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:00.116610 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce200470-b222-434a-aa72-9bd9a11840cf admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:00.116895 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce200470-b222-434a-aa72-9bd9a11840cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:00.117209 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce200470-b222-434a-aa72-9bd9a11840cf admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:00.117896 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce200470-b222-434a-aa72-9bd9a11840cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:00.119825 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce200470-b222-434a-aa72-9bd9a11840cf admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:00.225689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1101/2207] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:26:00 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:26:00.229895 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11aaff-a14d-4949-98f0-07f9b3da9409 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:00.240821 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11aaff-a14d-4949-98f0-07f9b3da9409 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:00.305444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca1ee9-61e2-4951-9bc0-e7a001109212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:00.327114 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca1ee9-61e2-4951-9bc0-e7a001109212 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:00.327592 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca1ee9-61e2-4951-9bc0-e7a001109212 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:00.330851 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca1ee9-61e2-4951-9bc0-e7a001109212 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:00.331863 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ca1ee9-61e2-4951-9bc0-e7a001109212 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:00.334138 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ca1ee9-61e2-4951-9bc0-e7a001109212 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:00.581043 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1107/2208] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:26:00 2022] POST /identity/v3/users => generated 299 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:26:00.582857 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce200470-b222-434a-aa72-9bd9a11840cf admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:00.610796 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce200470-b222-434a-aa72-9bd9a11840cf admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:00.617578 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82614a30-b0a7-46a2-86f9-f2e2ee4f42a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:00.618439 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82614a30-b0a7-46a2-86f9-f2e2ee4f42a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:00.618785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82614a30-b0a7-46a2-86f9-f2e2ee4f42a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:00.619158 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82614a30-b0a7-46a2-86f9-f2e2ee4f42a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:00.620071 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82614a30-b0a7-46a2-86f9-f2e2ee4f42a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:00.622495 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82614a30-b0a7-46a2-86f9-f2e2ee4f42a0 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:00.635065 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1102/2209] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:26:00.639734 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca1ee9-61e2-4951-9bc0-e7a001109212 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:00.649925 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca1ee9-61e2-4951-9bc0-e7a001109212 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:00.654638 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c0d3c-c240-4b3e-b770-f1eb99653b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:00.655293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c0d3c-c240-4b3e-b770-f1eb99653b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:00.655580 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c0d3c-c240-4b3e-b770-f1eb99653b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:00.655861 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c0d3c-c240-4b3e-b770-f1eb99653b5f admin admin] PATH_INFO: `/v3/projects/5d207b77b1a344af8e11a131805bbcac/users/0cb7b62d1cc84d89af0d66c4f52150a0/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:00.670811 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c0d3c-c240-4b3e-b770-f1eb99653b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d207b77b1a344af8e11a131805bbcac, user_id=0cb7b62d1cc84d89af0d66c4f52150a0, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:00.673563 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c0d3c-c240-4b3e-b770-f1eb99653b5f admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:00.796155 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1108/2210] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:26:00 2022] PUT /identity/v3/projects/5d207b77b1a344af8e11a131805bbcac/users/0cb7b62d1cc84d89af0d66c4f52150a0/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:00.801030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82614a30-b0a7-46a2-86f9-f2e2ee4f42a0 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:00.814745 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82614a30-b0a7-46a2-86f9-f2e2ee4f42a0 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:00.879674 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339980d7-f2bc-43f9-a762-29ced8b87fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:00.880297 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339980d7-f2bc-43f9-a762-29ced8b87fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:00.880586 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339980d7-f2bc-43f9-a762-29ced8b87fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:00.880890 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339980d7-f2bc-43f9-a762-29ced8b87fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:00.881577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339980d7-f2bc-43f9-a762-29ced8b87fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:00.883186 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339980d7-f2bc-43f9-a762-29ced8b87fc6 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:00.896004 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1103/2211] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:26:00.897314 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c0d3c-c240-4b3e-b770-f1eb99653b5f admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:00.907741 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c0d3c-c240-4b3e-b770-f1eb99653b5f admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:00.912922 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c8993-6bad-450d-8efe-451b84287b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:00.913619 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c8993-6bad-450d-8efe-451b84287b23 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:00.913907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c8993-6bad-450d-8efe-451b84287b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:00.914207 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c8993-6bad-450d-8efe-451b84287b23 admin admin] PATH_INFO: `/v3/projects/5d207b77b1a344af8e11a131805bbcac/users/0cb7b62d1cc84d89af0d66c4f52150a0/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:00.916172 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c8993-6bad-450d-8efe-451b84287b23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d207b77b1a344af8e11a131805bbcac, user_id=0cb7b62d1cc84d89af0d66c4f52150a0, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:00.919476 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c8993-6bad-450d-8efe-451b84287b23 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:00.930722 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1109/2212] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:26:00 2022] PUT /identity/v3/projects/5d207b77b1a344af8e11a131805bbcac/users/0cb7b62d1cc84d89af0d66c4f52150a0/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:00.941782 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde892c-cfc8-480f-9170-db408b9a8ecf None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:00.942076 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde892c-cfc8-480f-9170-db408b9a8ecf None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:00.942357 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde892c-cfc8-480f-9170-db408b9a8ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:00.995808 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-dcde892c-cfc8-480f-9170-db408b9a8ecf None None] MFA Rules not processed for user `0cb7b62d1cc84d89af0d66c4f52150a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:00.998035 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-dcde892c-cfc8-480f-9170-db408b9a8ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:01.173051 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1104/2213] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:01.228380 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c8993-6bad-450d-8efe-451b84287b23 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:01.289108 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c8993-6bad-450d-8efe-451b84287b23 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:01.292621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7c27d-e701-43e2-9cd9-d1d939015e27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:01.293277 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7c27d-e701-43e2-9cd9-d1d939015e27 service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:01.293559 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7c27d-e701-43e2-9cd9-d1d939015e27 service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:01.294520 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7c27d-e701-43e2-9cd9-d1d939015e27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:01.366686 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7c27d-e701-43e2-9cd9-d1d939015e27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:01.368849 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7c27d-e701-43e2-9cd9-d1d939015e27 service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:01.383041 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1110/2214] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:26:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:26:01.439867 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:02.840127 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:03.856407 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:04.046208 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde892c-cfc8-480f-9170-db408b9a8ecf None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:04.047692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-dcde892c-cfc8-480f-9170-db408b9a8ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:04.062578 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde892c-cfc8-480f-9170-db408b9a8ecf None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:04.066858 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0cdb0-8e81-4e72-a472-f9f9f66bc0f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:04.067575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0cdb0-8e81-4e72-a472-f9f9f66bc0f6 service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:04.067919 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0cdb0-8e81-4e72-a472-f9f9f66bc0f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:04.068255 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0cdb0-8e81-4e72-a472-f9f9f66bc0f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:04.125144 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0cdb0-8e81-4e72-a472-f9f9f66bc0f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:04.126526 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0cdb0-8e81-4e72-a472-f9f9f66bc0f6 service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:04.136951 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1105/2215] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:26:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:26:04.414021 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7c27d-e701-43e2-9cd9-d1d939015e27 service cinder] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:04.416396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-99e7c27d-e701-43e2-9cd9-d1d939015e27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:04.507707 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7c27d-e701-43e2-9cd9-d1d939015e27 service cinder] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:04.515273 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f002e-f718-41ff-998e-997be5178dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:04.515952 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f002e-f718-41ff-998e-997be5178dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:04.516401 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f002e-f718-41ff-998e-997be5178dee admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:04.516689 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f002e-f718-41ff-998e-997be5178dee admin admin] PATH_INFO: `/v3/users/9f81e49388b948e8bc95dbb32bfe9462` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:04.517975 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f002e-f718-41ff-998e-997be5178dee admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f81e49388b948e8bc95dbb32bfe9462)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:04.522346 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f002e-f718-41ff-998e-997be5178dee admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:04.708235 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:04.756575 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-545f002e-f718-41ff-998e-997be5178dee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f81e49388b948e8bc95dbb32bfe9462'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:04.862615 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-545f002e-f718-41ff-998e-997be5178dee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f81e49388b948e8bc95dbb32bfe9462'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:04.871147 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-545f002e-f718-41ff-998e-997be5178dee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f81e49388b948e8bc95dbb32bfe9462'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:04.884636 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-545f002e-f718-41ff-998e-997be5178dee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f81e49388b948e8bc95dbb32bfe9462'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:04.885517 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-545f002e-f718-41ff-998e-997be5178dee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f81e49388b948e8bc95dbb32bfe9462'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:04.892288 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1111/2216] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:26:04 2022] DELETE /identity/v3/users/9f81e49388b948e8bc95dbb32bfe9462 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:04.896740 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d8c92-0dc7-479a-a91a-da6da6b746e8 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:04.903857 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d8c92-0dc7-479a-a91a-da6da6b746e8 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:04.903857 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d8c92-0dc7-479a-a91a-da6da6b746e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:04.916567 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-b06d8c92-0dc7-479a-a91a-da6da6b746e8 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:04.917845 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-b06d8c92-0dc7-479a-a91a-da6da6b746e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:04.980026 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1106/2217] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:04.990830 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f002e-f718-41ff-998e-997be5178dee admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:04.992717 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-545f002e-f718-41ff-998e-997be5178dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:05.054637 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f002e-f718-41ff-998e-997be5178dee admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:05.058587 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d9aca-5d3c-4426-8b26-a2ebc7599106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:05.059215 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d9aca-5d3c-4426-8b26-a2ebc7599106 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:05.059494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d9aca-5d3c-4426-8b26-a2ebc7599106 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:05.059770 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d9aca-5d3c-4426-8b26-a2ebc7599106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:05.070628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d9aca-5d3c-4426-8b26-a2ebc7599106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:05.072193 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d9aca-5d3c-4426-8b26-a2ebc7599106 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:05.085176 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1112/2218] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:26:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:26:05.889994 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d8c92-0dc7-479a-a91a-da6da6b746e8 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:05.891594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-b06d8c92-0dc7-479a-a91a-da6da6b746e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:05.903597 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d8c92-0dc7-479a-a91a-da6da6b746e8 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:05.908228 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad79733-5046-4b3c-8c11-699bfa4d9e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:05.908944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad79733-5046-4b3c-8c11-699bfa4d9e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:05.909264 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad79733-5046-4b3c-8c11-699bfa4d9e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:05.909546 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad79733-5046-4b3c-8c11-699bfa4d9e36 admin admin] PATH_INFO: `/v3/projects/8cacef9c56054f81bd83a7377b987c02` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:05.910691 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad79733-5046-4b3c-8c11-699bfa4d9e36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cacef9c56054f81bd83a7377b987c02)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:05.912747 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad79733-5046-4b3c-8c11-699bfa4d9e36 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:06.014756 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-fad79733-5046-4b3c-8c11-699bfa4d9e36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cacef9c56054f81bd83a7377b987c02', 'request_id': 'req-fad79733-5046-4b3c-8c11-699bfa4d9e36'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:06.022326 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-fad79733-5046-4b3c-8c11-699bfa4d9e36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cacef9c56054f81bd83a7377b987c02', 'request_id': 'req-fad79733-5046-4b3c-8c11-699bfa4d9e36'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:06.028891 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-fad79733-5046-4b3c-8c11-699bfa4d9e36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cacef9c56054f81bd83a7377b987c02', 'request_id': 'req-fad79733-5046-4b3c-8c11-699bfa4d9e36'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:06.056515 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d9aca-5d3c-4426-8b26-a2ebc7599106 service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:06.058006 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-288d9aca-5d3c-4426-8b26-a2ebc7599106 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:06.096512 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-fad79733-5046-4b3c-8c11-699bfa4d9e36 admin admin] The token cache is being invalidate because project 8cacef9c56054f81bd83a7377b987c02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:26:06.097018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-fad79733-5046-4b3c-8c11-699bfa4d9e36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:06.098039 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-fad79733-5046-4b3c-8c11-699bfa4d9e36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:06.103302 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1107/2219] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:26:05 2022] DELETE /identity/v3/projects/8cacef9c56054f81bd83a7377b987c02 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:06.104532 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad79733-5046-4b3c-8c11-699bfa4d9e36 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:06.106584 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-fad79733-5046-4b3c-8c11-699bfa4d9e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:06.130508 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d9aca-5d3c-4426-8b26-a2ebc7599106 service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:06.181927 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad79733-5046-4b3c-8c11-699bfa4d9e36 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:06.187696 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5252737-9e26-4ad9-b990-2c81487f9c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:06.188446 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5252737-9e26-4ad9-b990-2c81487f9c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:06.188808 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5252737-9e26-4ad9-b990-2c81487f9c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:06.189316 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5252737-9e26-4ad9-b990-2c81487f9c63 admin admin] PATH_INFO: `/v3/users/1cedda7c857941098158eec1d1d140d0` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:06.190973 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5252737-9e26-4ad9-b990-2c81487f9c63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cedda7c857941098158eec1d1d140d0)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:06.193153 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5252737-9e26-4ad9-b990-2c81487f9c63 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:06.201975 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33694c-dca4-4d6d-a6cd-6881917fd13d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:06.202646 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33694c-dca4-4d6d-a6cd-6881917fd13d service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:06.202881 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33694c-dca4-4d6d-a6cd-6881917fd13d service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:06.203155 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33694c-dca4-4d6d-a6cd-6881917fd13d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:06.204945 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-cf33694c-dca4-4d6d-a6cd-6881917fd13d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:06.239981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:06.273374 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33694c-dca4-4d6d-a6cd-6881917fd13d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:06.273374 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33694c-dca4-4d6d-a6cd-6881917fd13d service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:06.282756 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1113/2220] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:26:06 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:26:06.403254 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c5252737-9e26-4ad9-b990-2c81487f9c63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cedda7c857941098158eec1d1d140d0'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:06.404089 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c5252737-9e26-4ad9-b990-2c81487f9c63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cedda7c857941098158eec1d1d140d0'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:06.412284 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c5252737-9e26-4ad9-b990-2c81487f9c63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cedda7c857941098158eec1d1d140d0'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:06.413072 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c5252737-9e26-4ad9-b990-2c81487f9c63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cedda7c857941098158eec1d1d140d0'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:06.435281 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c5252737-9e26-4ad9-b990-2c81487f9c63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cedda7c857941098158eec1d1d140d0'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:06.550073 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1108/2221] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:26:06 2022] DELETE /identity/v3/users/1cedda7c857941098158eec1d1d140d0 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:07.005232 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:07.131862 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33694c-dca4-4d6d-a6cd-6881917fd13d service cinder] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:07.151305 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33694c-dca4-4d6d-a6cd-6881917fd13d service cinder] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:07.210437 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237877f-f6dd-467d-ba7c-61e310ace9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:07.211268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237877f-f6dd-467d-ba7c-61e310ace9c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:07.211638 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237877f-f6dd-467d-ba7c-61e310ace9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:07.212182 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237877f-f6dd-467d-ba7c-61e310ace9c7 admin admin] PATH_INFO: `/v3/projects/11f4e8bfff75458e86bc351356ef8169` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:07.214417 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237877f-f6dd-467d-ba7c-61e310ace9c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11f4e8bfff75458e86bc351356ef8169)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:07.224469 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237877f-f6dd-467d-ba7c-61e310ace9c7 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:07.327657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-0237877f-f6dd-467d-ba7c-61e310ace9c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11f4e8bfff75458e86bc351356ef8169', 'request_id': 'req-0237877f-f6dd-467d-ba7c-61e310ace9c7'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:07.335385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-0237877f-f6dd-467d-ba7c-61e310ace9c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11f4e8bfff75458e86bc351356ef8169', 'request_id': 'req-0237877f-f6dd-467d-ba7c-61e310ace9c7'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:07.345202 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-0237877f-f6dd-467d-ba7c-61e310ace9c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11f4e8bfff75458e86bc351356ef8169', 'request_id': 'req-0237877f-f6dd-467d-ba7c-61e310ace9c7'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:07.441718 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-0237877f-f6dd-467d-ba7c-61e310ace9c7 admin admin] The token cache is being invalidate because project 11f4e8bfff75458e86bc351356ef8169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:26:07.443806 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-0237877f-f6dd-467d-ba7c-61e310ace9c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:07.444102 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-0237877f-f6dd-467d-ba7c-61e310ace9c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:07.446336 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1114/2222] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:26:07 2022] DELETE /identity/v3/projects/11f4e8bfff75458e86bc351356ef8169 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:07.451048 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5252737-9e26-4ad9-b990-2c81487f9c63 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:07.452752 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-c5252737-9e26-4ad9-b990-2c81487f9c63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:07.483559 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5252737-9e26-4ad9-b990-2c81487f9c63 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:07.559468 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b3416-3433-4d31-8e02-d37a468e3f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:07.560151 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b3416-3433-4d31-8e02-d37a468e3f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:07.560671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b3416-3433-4d31-8e02-d37a468e3f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:07.560947 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b3416-3433-4d31-8e02-d37a468e3f68 admin admin] PATH_INFO: `/v3/users/43b70c95aafe4151af6d0ade7ae8db23` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:07.562468 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b3416-3433-4d31-8e02-d37a468e3f68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43b70c95aafe4151af6d0ade7ae8db23)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:07.565734 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b3416-3433-4d31-8e02-d37a468e3f68 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:07.746157 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-d37b3416-3433-4d31-8e02-d37a468e3f68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43b70c95aafe4151af6d0ade7ae8db23'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:07.747620 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-d37b3416-3433-4d31-8e02-d37a468e3f68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43b70c95aafe4151af6d0ade7ae8db23'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:07.762107 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-d37b3416-3433-4d31-8e02-d37a468e3f68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43b70c95aafe4151af6d0ade7ae8db23'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:07.764139 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-d37b3416-3433-4d31-8e02-d37a468e3f68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43b70c95aafe4151af6d0ade7ae8db23'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:07.784222 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-d37b3416-3433-4d31-8e02-d37a468e3f68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43b70c95aafe4151af6d0ade7ae8db23'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:07.849580 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1109/2223] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:26:07 2022] DELETE /identity/v3/users/43b70c95aafe4151af6d0ade7ae8db23 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:07.869005 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454285e-e1e3-4a07-a6ae-9fe6862f1934 None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:07.869415 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454285e-e1e3-4a07-a6ae-9fe6862f1934 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:07.869829 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454285e-e1e3-4a07-a6ae-9fe6862f1934 None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:07.871643 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1115/2224] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 23 04:26:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:26:07.883970 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55d28d-1a86-4a92-99a9-b7e5a5a731dd None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:07.884468 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55d28d-1a86-4a92-99a9-b7e5a5a731dd None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:07.884847 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55d28d-1a86-4a92-99a9-b7e5a5a731dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:07.944573 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-9b55d28d-1a86-4a92-99a9-b7e5a5a731dd None None] MFA Rules not processed for user `34794124b7234aeb98a15f0c2ae06a0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:07.953340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-9b55d28d-1a86-4a92-99a9-b7e5a5a731dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:08.070548 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:08.079888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1110/2225] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 23 04:26:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:08.112459 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454285e-e1e3-4a07-a6ae-9fe6862f1934 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:08.114150 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-d454285e-e1e3-4a07-a6ae-9fe6862f1934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:08.164577 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454285e-e1e3-4a07-a6ae-9fe6862f1934 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:08.222266 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f6624-b41f-4cb1-a265-789feee77de2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34794124b7234aeb98a15f0c2ae06a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:08.222912 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f6624-b41f-4cb1-a265-789feee77de2 service placement] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:08.225405 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f6624-b41f-4cb1-a265-789feee77de2 service placement] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:08.225715 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f6624-b41f-4cb1-a265-789feee77de2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:08.244136 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f6624-b41f-4cb1-a265-789feee77de2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:08.246405 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f6624-b41f-4cb1-a265-789feee77de2 service placement] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:08.270020 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1116/2226] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:26:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:26:08.532236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55d28d-1a86-4a92-99a9-b7e5a5a731dd None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:08.534295 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-9b55d28d-1a86-4a92-99a9-b7e5a5a731dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:08.636453 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55d28d-1a86-4a92-99a9-b7e5a5a731dd None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:08.642911 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906923bd-bd4e-4384-bd8d-08145b4a7dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:08.643647 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906923bd-bd4e-4384-bd8d-08145b4a7dba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:08.643998 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906923bd-bd4e-4384-bd8d-08145b4a7dba admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:08.644339 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906923bd-bd4e-4384-bd8d-08145b4a7dba admin admin] PATH_INFO: `/v3/projects/56b7e7d5c56549d697269eb1772512ef` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:08.645695 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906923bd-bd4e-4384-bd8d-08145b4a7dba admin admin] RBAC: Authorizing `identity:delete_project(project_id=56b7e7d5c56549d697269eb1772512ef)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:08.651535 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906923bd-bd4e-4384-bd8d-08145b4a7dba admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:08.783656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-906923bd-bd4e-4384-bd8d-08145b4a7dba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56b7e7d5c56549d697269eb1772512ef', 'request_id': 'req-906923bd-bd4e-4384-bd8d-08145b4a7dba'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:08.789850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-906923bd-bd4e-4384-bd8d-08145b4a7dba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56b7e7d5c56549d697269eb1772512ef', 'request_id': 'req-906923bd-bd4e-4384-bd8d-08145b4a7dba'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:08.795322 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-906923bd-bd4e-4384-bd8d-08145b4a7dba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56b7e7d5c56549d697269eb1772512ef', 'request_id': 'req-906923bd-bd4e-4384-bd8d-08145b4a7dba'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:08.874155 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-906923bd-bd4e-4384-bd8d-08145b4a7dba admin admin] The token cache is being invalidate because project 56b7e7d5c56549d697269eb1772512ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:26:08.874526 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-906923bd-bd4e-4384-bd8d-08145b4a7dba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:08.875702 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-906923bd-bd4e-4384-bd8d-08145b4a7dba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:08.877445 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1111/2227] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:26:08 2022] DELETE /identity/v3/projects/56b7e7d5c56549d697269eb1772512ef => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:08.883796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c300e-d7ea-4d04-8d93-809a2c958a2f None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:08.884311 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c300e-d7ea-4d04-8d93-809a2c958a2f None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:08.884668 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c300e-d7ea-4d04-8d93-809a2c958a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:08.911023 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:08.911023 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-e36c300e-d7ea-4d04-8d93-809a2c958a2f None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:08.911023 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-e36c300e-d7ea-4d04-8d93-809a2c958a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:08.977227 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1117/2228] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:08.986173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b65c88-5829-41af-812f-bf77aae3f68e None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:08.986552 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b65c88-5829-41af-812f-bf77aae3f68e None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:08.986902 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b65c88-5829-41af-812f-bf77aae3f68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:09.007954 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-73b65c88-5829-41af-812f-bf77aae3f68e None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:09.009339 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-73b65c88-5829-41af-812f-bf77aae3f68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:09.018219 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1112/2229] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:09.022626 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c300e-d7ea-4d04-8d93-809a2c958a2f None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:09.032840 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c300e-d7ea-4d04-8d93-809a2c958a2f None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:09.037915 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d2618-cf94-42df-a878-ac4fe76d037e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:09.038546 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d2618-cf94-42df-a878-ac4fe76d037e admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:09.039234 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d2618-cf94-42df-a878-ac4fe76d037e admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:09.039234 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d2618-cf94-42df-a878-ac4fe76d037e admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:09.039905 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d2618-cf94-42df-a878-ac4fe76d037e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:26:09.040215 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d2618-cf94-42df-a878-ac4fe76d037e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:09.041907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d2618-cf94-42df-a878-ac4fe76d037e admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:09.057145 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1118/2230] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:26:09.061736 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b65c88-5829-41af-812f-bf77aae3f68e None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:09.073315 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b65c88-5829-41af-812f-bf77aae3f68e None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:09.079413 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4fa45-90bf-42f8-bff4-0d4c7d789aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:09.082907 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4fa45-90bf-42f8-bff4-0d4c7d789aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:09.082907 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4fa45-90bf-42f8-bff4-0d4c7d789aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:09.082907 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4fa45-90bf-42f8-bff4-0d4c7d789aa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:09.082907 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4fa45-90bf-42f8-bff4-0d4c7d789aa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:09.083884 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4fa45-90bf-42f8-bff4-0d4c7d789aa3 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:09.171254 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1113/2231] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:26:09 2022] POST /identity/v3/projects => generated 389 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:26:09.173346 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d2618-cf94-42df-a878-ac4fe76d037e admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:09.194946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d2618-cf94-42df-a878-ac4fe76d037e admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:09.274630 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4fa45-90bf-42f8-bff4-0d4c7d789aa3 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:09.276425 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-70d4fa45-90bf-42f8-bff4-0d4c7d789aa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:09.283014 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66deddcf-4fb1-4198-aa4e-cfd5b4bbe686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:09.284025 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66deddcf-4fb1-4198-aa4e-cfd5b4bbe686 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:09.284526 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66deddcf-4fb1-4198-aa4e-cfd5b4bbe686 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:09.285159 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66deddcf-4fb1-4198-aa4e-cfd5b4bbe686 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:09.286077 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66deddcf-4fb1-4198-aa4e-cfd5b4bbe686 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:09.289124 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66deddcf-4fb1-4198-aa4e-cfd5b4bbe686 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:09.378970 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1119/2232] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:26:09 2022] POST /identity/v3/users => generated 295 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:26:09.380372 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4fa45-90bf-42f8-bff4-0d4c7d789aa3 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:09.386042 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66deddcf-4fb1-4198-aa4e-cfd5b4bbe686 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:09.389274 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3448d-1806-4fa2-acdd-be4520640f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:09.389940 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3448d-1806-4fa2-acdd-be4520640f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:09.390218 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3448d-1806-4fa2-acdd-be4520640f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:09.390541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3448d-1806-4fa2-acdd-be4520640f9e admin admin] PATH_INFO: `/v3/users/dcd0b362e80e4d9ea0f9dd0169fdcc7b` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:09.391748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3448d-1806-4fa2-acdd-be4520640f9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd0b362e80e4d9ea0f9dd0169fdcc7b)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:09.394052 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3448d-1806-4fa2-acdd-be4520640f9e admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:09.412323 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66deddcf-4fb1-4198-aa4e-cfd5b4bbe686 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:09.420568 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86e176-50f1-4129-b6a6-048171b6f537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:09.421731 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86e176-50f1-4129-b6a6-048171b6f537 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:09.423189 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86e176-50f1-4129-b6a6-048171b6f537 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:09.423685 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86e176-50f1-4129-b6a6-048171b6f537 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:09.424959 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad86e176-50f1-4129-b6a6-048171b6f537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:09.427585 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad86e176-50f1-4129-b6a6-048171b6f537 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:09.445024 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1120/2233] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:26:09.448808 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86e176-50f1-4129-b6a6-048171b6f537 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:09.460880 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86e176-50f1-4129-b6a6-048171b6f537 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:09.465619 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54acf0-be04-4d64-a0eb-5b3f6a80cd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:09.470885 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54acf0-be04-4d64-a0eb-5b3f6a80cd52 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:09.470885 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54acf0-be04-4d64-a0eb-5b3f6a80cd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:09.470885 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54acf0-be04-4d64-a0eb-5b3f6a80cd52 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:09.470885 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54acf0-be04-4d64-a0eb-5b3f6a80cd52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:09.470885 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54acf0-be04-4d64-a0eb-5b3f6a80cd52 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:09.479758 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1121/2234] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:26:09.485459 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54acf0-be04-4d64-a0eb-5b3f6a80cd52 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:09.495344 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54acf0-be04-4d64-a0eb-5b3f6a80cd52 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:09.500008 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a424fc-8b3e-4f03-835b-d8e52ebadaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:09.500707 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a424fc-8b3e-4f03-835b-d8e52ebadaa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:09.500988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a424fc-8b3e-4f03-835b-d8e52ebadaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:09.501296 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a424fc-8b3e-4f03-835b-d8e52ebadaa1 admin admin] PATH_INFO: `/v3/projects/6f450cf598ae43ac9a2fdf7d364bb2b4/users/7918138a16774fe4bbef241e5e1e9be4/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:09.516101 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a424fc-8b3e-4f03-835b-d8e52ebadaa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f450cf598ae43ac9a2fdf7d364bb2b4, user_id=7918138a16774fe4bbef241e5e1e9be4, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:09.518880 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a424fc-8b3e-4f03-835b-d8e52ebadaa1 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:09.617197 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1122/2235] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:26:09 2022] PUT /identity/v3/projects/6f450cf598ae43ac9a2fdf7d364bb2b4/users/7918138a16774fe4bbef241e5e1e9be4/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:09.628416 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee9b9b-4419-480d-a6ef-c441a28c29eb None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:09.628705 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee9b9b-4419-480d-a6ef-c441a28c29eb None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:09.629230 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee9b9b-4419-480d-a6ef-c441a28c29eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:09.652852 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-26d3448d-1806-4fa2-acdd-be4520640f9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd0b362e80e4d9ea0f9dd0169fdcc7b'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:09.653811 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-26d3448d-1806-4fa2-acdd-be4520640f9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd0b362e80e4d9ea0f9dd0169fdcc7b'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:09.661870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-26d3448d-1806-4fa2-acdd-be4520640f9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd0b362e80e4d9ea0f9dd0169fdcc7b'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:09.662637 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-26d3448d-1806-4fa2-acdd-be4520640f9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd0b362e80e4d9ea0f9dd0169fdcc7b'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:09.663958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-0eee9b9b-4419-480d-a6ef-c441a28c29eb None None] MFA Rules not processed for user `7918138a16774fe4bbef241e5e1e9be4`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:09.665207 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-0eee9b9b-4419-480d-a6ef-c441a28c29eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:09.676930 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-26d3448d-1806-4fa2-acdd-be4520640f9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd0b362e80e4d9ea0f9dd0169fdcc7b'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:09.728944 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1123/2236] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:26:09.734180 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee9b9b-4419-480d-a6ef-c441a28c29eb None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:09.735483 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-0eee9b9b-4419-480d-a6ef-c441a28c29eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:09.751350 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1114/2237] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:26:09 2022] DELETE /identity/v3/users/dcd0b362e80e4d9ea0f9dd0169fdcc7b => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:26:09.803733 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee9b9b-4419-480d-a6ef-c441a28c29eb None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:09.866937 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b12388-ec8e-4b77-a7fc-d6f0d34ed672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:09.867561 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b12388-ec8e-4b77-a7fc-d6f0d34ed672 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:09.867842 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b12388-ec8e-4b77-a7fc-d6f0d34ed672 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:09.868142 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b12388-ec8e-4b77-a7fc-d6f0d34ed672 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:09.868776 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b12388-ec8e-4b77-a7fc-d6f0d34ed672 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:09.870752 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b12388-ec8e-4b77-a7fc-d6f0d34ed672 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:09.942827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:09.973106 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1124/2238] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:26:09 2022] POST /identity/v3/projects => generated 393 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:26:09.977349 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3448d-1806-4fa2-acdd-be4520640f9e admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:09.987276 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3448d-1806-4fa2-acdd-be4520640f9e admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:10.002481 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b12388-ec8e-4b77-a7fc-d6f0d34ed672 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:10.004753 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-38b12388-ec8e-4b77-a7fc-d6f0d34ed672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:10.063392 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c515840-bbaa-4546-8d89-77de86c5b8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:10.064066 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c515840-bbaa-4546-8d89-77de86c5b8ed admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:10.064305 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c515840-bbaa-4546-8d89-77de86c5b8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:10.064579 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c515840-bbaa-4546-8d89-77de86c5b8ed admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:10.065328 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c515840-bbaa-4546-8d89-77de86c5b8ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:10.067472 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c515840-bbaa-4546-8d89-77de86c5b8ed admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:10.093263 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b12388-ec8e-4b77-a7fc-d6f0d34ed672 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:10.093783 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea226d1-70b5-49f6-a9b9-c46ee751a70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:10.094428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea226d1-70b5-49f6-a9b9-c46ee751a70c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:10.094718 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea226d1-70b5-49f6-a9b9-c46ee751a70c admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:10.094995 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea226d1-70b5-49f6-a9b9-c46ee751a70c admin admin] PATH_INFO: `/v3/projects/8f0cf14066894b85995392016b540803` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:10.096139 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea226d1-70b5-49f6-a9b9-c46ee751a70c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f0cf14066894b85995392016b540803)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:10.098103 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea226d1-70b5-49f6-a9b9-c46ee751a70c admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:10.143047 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1115/2239] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:26:09 2022] POST /identity/v3/users => generated 303 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:26:10.147307 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c515840-bbaa-4546-8d89-77de86c5b8ed admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:10.157793 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c515840-bbaa-4546-8d89-77de86c5b8ed admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:10.162331 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca810c-c2d2-4ec6-99c0-4654889920ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:10.163041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca810c-c2d2-4ec6-99c0-4654889920ad admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:10.163194 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca810c-c2d2-4ec6-99c0-4654889920ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:10.163461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca810c-c2d2-4ec6-99c0-4654889920ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:10.164118 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca810c-c2d2-4ec6-99c0-4654889920ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:10.165751 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca810c-c2d2-4ec6-99c0-4654889920ad admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:10.176897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1116/2240] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:26:10.181024 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca810c-c2d2-4ec6-99c0-4654889920ad admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:10.187465 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-9ea226d1-70b5-49f6-a9b9-c46ee751a70c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f0cf14066894b85995392016b540803', 'request_id': 'req-9ea226d1-70b5-49f6-a9b9-c46ee751a70c'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:10.191574 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca810c-c2d2-4ec6-99c0-4654889920ad admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:10.194580 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-9ea226d1-70b5-49f6-a9b9-c46ee751a70c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f0cf14066894b85995392016b540803', 'request_id': 'req-9ea226d1-70b5-49f6-a9b9-c46ee751a70c'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:10.200282 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-9ea226d1-70b5-49f6-a9b9-c46ee751a70c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f0cf14066894b85995392016b540803', 'request_id': 'req-9ea226d1-70b5-49f6-a9b9-c46ee751a70c'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:10.253855 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107469d2-f639-4c1f-8379-3bdafe4a8391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:10.254527 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107469d2-f639-4c1f-8379-3bdafe4a8391 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:10.254881 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107469d2-f639-4c1f-8379-3bdafe4a8391 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:10.255119 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107469d2-f639-4c1f-8379-3bdafe4a8391 admin admin] PATH_INFO: `/v3/projects/944488a4d3404a0fab66272b9f79a167/users/d6b21e5e659444eaada02c3ef469641e/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:10.270636 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107469d2-f639-4c1f-8379-3bdafe4a8391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=944488a4d3404a0fab66272b9f79a167, user_id=d6b21e5e659444eaada02c3ef469641e, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:10.273432 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107469d2-f639-4c1f-8379-3bdafe4a8391 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:10.290155 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-9ea226d1-70b5-49f6-a9b9-c46ee751a70c admin admin] The token cache is being invalidate because project 8f0cf14066894b85995392016b540803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:26:10.295117 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-9ea226d1-70b5-49f6-a9b9-c46ee751a70c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:10.295117 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-9ea226d1-70b5-49f6-a9b9-c46ee751a70c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:10.295117 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1125/2241] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:26:10 2022] DELETE /identity/v3/projects/8f0cf14066894b85995392016b540803 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:26:10.300119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea226d1-70b5-49f6-a9b9-c46ee751a70c admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:10.302618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-9ea226d1-70b5-49f6-a9b9-c46ee751a70c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:10.317912 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea226d1-70b5-49f6-a9b9-c46ee751a70c admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:10.323453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539d7d5-fb0c-49d8-9d52-da1ed087b6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:10.324088 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539d7d5-fb0c-49d8-9d52-da1ed087b6c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:10.331177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539d7d5-fb0c-49d8-9d52-da1ed087b6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:10.331177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539d7d5-fb0c-49d8-9d52-da1ed087b6c4 admin admin] PATH_INFO: `/v3/users/5a27570c413943368f831f74badeb8b8` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:10.331177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539d7d5-fb0c-49d8-9d52-da1ed087b6c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a27570c413943368f831f74badeb8b8)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:10.331177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539d7d5-fb0c-49d8-9d52-da1ed087b6c4 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:10.354175 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1117/2242] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:26:10 2022] PUT /identity/v3/projects/944488a4d3404a0fab66272b9f79a167/users/d6b21e5e659444eaada02c3ef469641e/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:26:10.358167 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107469d2-f639-4c1f-8379-3bdafe4a8391 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:10.359864 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-107469d2-f639-4c1f-8379-3bdafe4a8391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:10.423397 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107469d2-f639-4c1f-8379-3bdafe4a8391 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:10.428388 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b1034-85e3-4209-b6f9-f0718d5ff22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:10.429017 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b1034-85e3-4209-b6f9-f0718d5ff22a admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:10.429326 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b1034-85e3-4209-b6f9-f0718d5ff22a admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:10.433644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b1034-85e3-4209-b6f9-f0718d5ff22a admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:10.433644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b1034-85e3-4209-b6f9-f0718d5ff22a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:10.433644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b1034-85e3-4209-b6f9-f0718d5ff22a admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:10.443557 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1118/2243] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:26:10.447132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b1034-85e3-4209-b6f9-f0718d5ff22a admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:10.458074 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b1034-85e3-4209-b6f9-f0718d5ff22a admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:10.462828 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08d51e-0308-4dc3-aa40-9e58b7d77ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:10.463531 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08d51e-0308-4dc3-aa40-9e58b7d77ee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:10.463827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08d51e-0308-4dc3-aa40-9e58b7d77ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:10.464102 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08d51e-0308-4dc3-aa40-9e58b7d77ee3 admin admin] PATH_INFO: `/v3/projects/944488a4d3404a0fab66272b9f79a167/users/d6b21e5e659444eaada02c3ef469641e/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:10.466099 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08d51e-0308-4dc3-aa40-9e58b7d77ee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=944488a4d3404a0fab66272b9f79a167, user_id=d6b21e5e659444eaada02c3ef469641e, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:10.468756 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08d51e-0308-4dc3-aa40-9e58b7d77ee3 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:10.479685 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1119/2244] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:26:10 2022] PUT /identity/v3/projects/944488a4d3404a0fab66272b9f79a167/users/d6b21e5e659444eaada02c3ef469641e/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:26:10.491346 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33ed03-2e04-4414-bde6-0a58c5af318d None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:10.492733 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:10.493257 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33ed03-2e04-4414-bde6-0a58c5af318d None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:10.493596 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33ed03-2e04-4414-bde6-0a58c5af318d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:10.525296 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-bd33ed03-2e04-4414-bde6-0a58c5af318d None None] MFA Rules not processed for user `d6b21e5e659444eaada02c3ef469641e`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:10.526533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-bd33ed03-2e04-4414-bde6-0a58c5af318d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:10.554267 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:10.555114 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6539d7d5-fb0c-49d8-9d52-da1ed087b6c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a27570c413943368f831f74badeb8b8'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:10.605035 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6539d7d5-fb0c-49d8-9d52-da1ed087b6c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a27570c413943368f831f74badeb8b8'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:10.609142 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1120/2245] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:10 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:26:10.618209 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33ed03-2e04-4414-bde6-0a58c5af318d None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:10.618371 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6539d7d5-fb0c-49d8-9d52-da1ed087b6c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a27570c413943368f831f74badeb8b8'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:10.619819 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-bd33ed03-2e04-4414-bde6-0a58c5af318d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:10.634221 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6539d7d5-fb0c-49d8-9d52-da1ed087b6c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a27570c413943368f831f74badeb8b8'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:10.634221 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6539d7d5-fb0c-49d8-9d52-da1ed087b6c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a27570c413943368f831f74badeb8b8'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:10.641918 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1126/2246] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:26:10 2022] DELETE /identity/v3/users/5a27570c413943368f831f74badeb8b8 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:10.695318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33ed03-2e04-4414-bde6-0a58c5af318d None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:10.754953 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcf02a-4a96-42b8-9ed3-38fac93b1b2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:10.755588 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcf02a-4a96-42b8-9ed3-38fac93b1b2c service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:10.764112 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcf02a-4a96-42b8-9ed3-38fac93b1b2c service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:10.764112 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcf02a-4a96-42b8-9ed3-38fac93b1b2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:10.764112 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-cfdcf02a-4a96-42b8-9ed3-38fac93b1b2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:10.825032 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcf02a-4a96-42b8-9ed3-38fac93b1b2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:10.827142 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcf02a-4a96-42b8-9ed3-38fac93b1b2c service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:10.837125 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1121/2247] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:26:10 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:26:10.885644 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539d7d5-fb0c-49d8-9d52-da1ed087b6c4 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:10.887095 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-6539d7d5-fb0c-49d8-9d52-da1ed087b6c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:10.901238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539d7d5-fb0c-49d8-9d52-da1ed087b6c4 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:10.913184 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e25e24-f6b3-43e7-9550-2d750810f34a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:10.913184 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e25e24-f6b3-43e7-9550-2d750810f34a service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:10.913184 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e25e24-f6b3-43e7-9550-2d750810f34a service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:10.913184 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e25e24-f6b3-43e7-9550-2d750810f34a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:10.914361 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c1e25e24-f6b3-43e7-9550-2d750810f34a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:10.916253 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcf02a-4a96-42b8-9ed3-38fac93b1b2c service cinder] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:10.918244 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-cfdcf02a-4a96-42b8-9ed3-38fac93b1b2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:10.991750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e25e24-f6b3-43e7-9550-2d750810f34a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:10.993314 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e25e24-f6b3-43e7-9550-2d750810f34a service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:10.996762 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcf02a-4a96-42b8-9ed3-38fac93b1b2c service cinder] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:11.003014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea249a4-2547-4c5a-bdcb-d00d61a595ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:11.003467 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1127/2248] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:26:10 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:26:11.003659 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea249a4-2547-4c5a-bdcb-d00d61a595ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:11.003971 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea249a4-2547-4c5a-bdcb-d00d61a595ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:11.004250 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea249a4-2547-4c5a-bdcb-d00d61a595ba admin admin] PATH_INFO: `/v3/projects/ffabc5b248d041a5a84cbf4d0b404ee0` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:11.005481 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea249a4-2547-4c5a-bdcb-d00d61a595ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffabc5b248d041a5a84cbf4d0b404ee0)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:11.007406 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea249a4-2547-4c5a-bdcb-d00d61a595ba admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:11.110200 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-aea249a4-2547-4c5a-bdcb-d00d61a595ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffabc5b248d041a5a84cbf4d0b404ee0', 'request_id': 'req-aea249a4-2547-4c5a-bdcb-d00d61a595ba'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:11.118695 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-aea249a4-2547-4c5a-bdcb-d00d61a595ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffabc5b248d041a5a84cbf4d0b404ee0', 'request_id': 'req-aea249a4-2547-4c5a-bdcb-d00d61a595ba'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:11.125803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-aea249a4-2547-4c5a-bdcb-d00d61a595ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffabc5b248d041a5a84cbf4d0b404ee0', 'request_id': 'req-aea249a4-2547-4c5a-bdcb-d00d61a595ba'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:11.164513 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:11.173765 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e25e24-f6b3-43e7-9550-2d750810f34a service cinder] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:11.175764 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c1e25e24-f6b3-43e7-9550-2d750810f34a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:11.189790 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e25e24-f6b3-43e7-9550-2d750810f34a service cinder] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:11.221589 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-aea249a4-2547-4c5a-bdcb-d00d61a595ba admin admin] The token cache is being invalidate because project ffabc5b248d041a5a84cbf4d0b404ee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:26:11.221805 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-aea249a4-2547-4c5a-bdcb-d00d61a595ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:11.222520 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-aea249a4-2547-4c5a-bdcb-d00d61a595ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:11.224104 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1122/2249] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:26:10 2022] DELETE /identity/v3/projects/ffabc5b248d041a5a84cbf4d0b404ee0 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:11.230315 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421aff2f-5741-4b61-8986-6b018265987e None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:11.230315 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421aff2f-5741-4b61-8986-6b018265987e None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:11.230534 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421aff2f-5741-4b61-8986-6b018265987e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:11.248520 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fd669-b1df-4e1e-859c-17fc228843c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:11.249191 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fd669-b1df-4e1e-859c-17fc228843c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:11.249480 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fd669-b1df-4e1e-859c-17fc228843c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:11.249759 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fd669-b1df-4e1e-859c-17fc228843c7 admin admin] PATH_INFO: `/v3/users/9f7369d5f8c947caa6d4f0ce4ef5cc65` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:11.250943 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fd669-b1df-4e1e-859c-17fc228843c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f7369d5f8c947caa6d4f0ce4ef5cc65)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:11.252888 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fd669-b1df-4e1e-859c-17fc228843c7 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:11.253412 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-421aff2f-5741-4b61-8986-6b018265987e None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:11.254654 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-421aff2f-5741-4b61-8986-6b018265987e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:11.262505 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1123/2250] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:11.270807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a305b-a820-414a-8d80-e7693ad97872 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:11.271092 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a305b-a820-414a-8d80-e7693ad97872 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:11.271537 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a305b-a820-414a-8d80-e7693ad97872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:11.290153 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-ce9a305b-a820-414a-8d80-e7693ad97872 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:11.291334 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-ce9a305b-a820-414a-8d80-e7693ad97872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:11.299931 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1124/2251] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:26:11.303984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a305b-a820-414a-8d80-e7693ad97872 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:11.313259 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a305b-a820-414a-8d80-e7693ad97872 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:11.317867 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b305e-40eb-43e0-93ff-f6d9b6469ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:11.318444 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b305e-40eb-43e0-93ff-f6d9b6469ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:11.322800 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b305e-40eb-43e0-93ff-f6d9b6469ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:11.322800 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b305e-40eb-43e0-93ff-f6d9b6469ca3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:11.322800 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b305e-40eb-43e0-93ff-f6d9b6469ca3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:26:11.322800 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b305e-40eb-43e0-93ff-f6d9b6469ca3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:11.322800 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b305e-40eb-43e0-93ff-f6d9b6469ca3 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:11.333471 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1125/2252] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:26:11.337524 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b305e-40eb-43e0-93ff-f6d9b6469ca3 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:11.346981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b305e-40eb-43e0-93ff-f6d9b6469ca3 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:11.351613 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fee501-7d74-492c-ab60-dc6df357f5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:11.352203 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fee501-7d74-492c-ab60-dc6df357f5b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:11.352490 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fee501-7d74-492c-ab60-dc6df357f5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:11.352771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fee501-7d74-492c-ab60-dc6df357f5b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:11.353434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fee501-7d74-492c-ab60-dc6df357f5b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:11.355457 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fee501-7d74-492c-ab60-dc6df357f5b8 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:11.477061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1126/2253] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:26:11 2022] POST /identity/v3/projects => generated 371 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:26:11.481218 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fee501-7d74-492c-ab60-dc6df357f5b8 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:11.485832 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-dc5fd669-b1df-4e1e-859c-17fc228843c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f7369d5f8c947caa6d4f0ce4ef5cc65'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:11.536569 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-dc5fd669-b1df-4e1e-859c-17fc228843c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f7369d5f8c947caa6d4f0ce4ef5cc65'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:11.547807 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-dc5fd669-b1df-4e1e-859c-17fc228843c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f7369d5f8c947caa6d4f0ce4ef5cc65'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:11.563256 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fee501-7d74-492c-ab60-dc6df357f5b8 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:11.563256 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57287479-edb1-4107-b737-afe53166620b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:11.563256 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57287479-edb1-4107-b737-afe53166620b admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:11.563256 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57287479-edb1-4107-b737-afe53166620b admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:11.563647 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57287479-edb1-4107-b737-afe53166620b admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:11.563743 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-dc5fd669-b1df-4e1e-859c-17fc228843c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f7369d5f8c947caa6d4f0ce4ef5cc65'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:11.563833 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57287479-edb1-4107-b737-afe53166620b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:11.564458 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-dc5fd669-b1df-4e1e-859c-17fc228843c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f7369d5f8c947caa6d4f0ce4ef5cc65'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:11.565561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57287479-edb1-4107-b737-afe53166620b admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:11.570443 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1128/2254] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:26:11 2022] DELETE /identity/v3/users/9f7369d5f8c947caa6d4f0ce4ef5cc65 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:26:11.574703 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cde94-cf19-4b49-9461-6fcf436773a2 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:11.575060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cde94-cf19-4b49-9461-6fcf436773a2 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:11.575402 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cde94-cf19-4b49-9461-6fcf436773a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:11.593664 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-029cde94-cf19-4b49-9461-6fcf436773a2 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:11.594829 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-029cde94-cf19-4b49-9461-6fcf436773a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:11.605500 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:11.639561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1127/2255] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:26:11 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:26:11.643630 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57287479-edb1-4107-b737-afe53166620b admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:11.649002 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-57287479-edb1-4107-b737-afe53166620b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:11.657625 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57287479-edb1-4107-b737-afe53166620b admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:11.663845 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a0180-3cb5-4e86-9d52-372a0206a2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:11.664451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a0180-3cb5-4e86-9d52-372a0206a2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:11.664802 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a0180-3cb5-4e86-9d52-372a0206a2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:11.665185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a0180-3cb5-4e86-9d52-372a0206a2d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:11.665889 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1129/2256] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:26:11.668952 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a0180-3cb5-4e86-9d52-372a0206a2d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:11.672326 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a0180-3cb5-4e86-9d52-372a0206a2d6 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:11.676719 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cde94-cf19-4b49-9461-6fcf436773a2 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:11.679023 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-029cde94-cf19-4b49-9461-6fcf436773a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:11.683702 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1128/2257] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:26:11.687797 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a0180-3cb5-4e86-9d52-372a0206a2d6 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:11.702773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a0180-3cb5-4e86-9d52-372a0206a2d6 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:11.707727 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22193bce-7a30-4790-9fe5-5776c101cfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:11.708447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22193bce-7a30-4790-9fe5-5776c101cfcf admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:11.708736 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22193bce-7a30-4790-9fe5-5776c101cfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:11.709014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22193bce-7a30-4790-9fe5-5776c101cfcf admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:11.709704 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22193bce-7a30-4790-9fe5-5776c101cfcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:11.711941 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22193bce-7a30-4790-9fe5-5776c101cfcf admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:11.730708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1129/2258] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:26:11.731966 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22193bce-7a30-4790-9fe5-5776c101cfcf admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:11.742619 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22193bce-7a30-4790-9fe5-5776c101cfcf admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:11.747487 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e369154-cd0f-488f-8e92-57d8352fbd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:11.748181 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e369154-cd0f-488f-8e92-57d8352fbd8a admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:11.748462 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e369154-cd0f-488f-8e92-57d8352fbd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:11.748740 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e369154-cd0f-488f-8e92-57d8352fbd8a admin admin] PATH_INFO: `/v3/projects/80f3b5142ebb4729aaf1b22b02e48d8b/users/2de0983f2f2b4b399fd23e2327868a12/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:11.759533 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cde94-cf19-4b49-9461-6fcf436773a2 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:11.764552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884429d7-b43a-4e17-9b75-049a77a5c870 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:11.765230 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884429d7-b43a-4e17-9b75-049a77a5c870 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:11.765519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884429d7-b43a-4e17-9b75-049a77a5c870 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:11.765801 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884429d7-b43a-4e17-9b75-049a77a5c870 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:11.778340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e369154-cd0f-488f-8e92-57d8352fbd8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=80f3b5142ebb4729aaf1b22b02e48d8b, user_id=2de0983f2f2b4b399fd23e2327868a12, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:11.780405 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884429d7-b43a-4e17-9b75-049a77a5c870 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:11.781746 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e369154-cd0f-488f-8e92-57d8352fbd8a admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:11.783165 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884429d7-b43a-4e17-9b75-049a77a5c870 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:11.799089 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1130/2259] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:26:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:26:11.847100 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1130/2260] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:26:11 2022] PUT /identity/v3/projects/80f3b5142ebb4729aaf1b22b02e48d8b/users/2de0983f2f2b4b399fd23e2327868a12/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:26:11.858086 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0da9a-8c27-40a0-87af-d12704640cdc None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:11.858376 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0da9a-8c27-40a0-87af-d12704640cdc None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:11.858649 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0da9a-8c27-40a0-87af-d12704640cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:11.886141 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-2da0da9a-8c27-40a0-87af-d12704640cdc None None] MFA Rules not processed for user `2de0983f2f2b4b399fd23e2327868a12`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:11.887381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-2da0da9a-8c27-40a0-87af-d12704640cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:11.974500 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1131/2261] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:11.988639 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e369154-cd0f-488f-8e92-57d8352fbd8a admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:11.991276 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-5e369154-cd0f-488f-8e92-57d8352fbd8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:12.055684 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e369154-cd0f-488f-8e92-57d8352fbd8a admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:12.059415 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963e7a1-0a3f-4eeb-8b0e-888cf7a2e895 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '020af86302e447a6b3973df4abbabafa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:12.060071 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963e7a1-0a3f-4eeb-8b0e-888cf7a2e895 service glance] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:12.060399 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963e7a1-0a3f-4eeb-8b0e-888cf7a2e895 service glance] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:12.060676 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963e7a1-0a3f-4eeb-8b0e-888cf7a2e895 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:12.069329 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4963e7a1-0a3f-4eeb-8b0e-888cf7a2e895 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:12.070772 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4963e7a1-0a3f-4eeb-8b0e-888cf7a2e895 service glance] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:12.073979 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:12.079779 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1131/2262] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:26:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:26:12.345605 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0da9a-8c27-40a0-87af-d12704640cdc None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:12.347196 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-2da0da9a-8c27-40a0-87af-d12704640cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:12.423527 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0da9a-8c27-40a0-87af-d12704640cdc None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:12.428454 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f43ec-9813-4f8b-b675-0fa825a630b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:12.429136 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f43ec-9813-4f8b-b675-0fa825a630b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:12.429426 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f43ec-9813-4f8b-b675-0fa825a630b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:12.429709 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f43ec-9813-4f8b-b675-0fa825a630b8 admin admin] PATH_INFO: `/v3/projects/c6cd9f065e0d4be88e42fa2ec3bb6ff3` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:12.430845 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f43ec-9813-4f8b-b675-0fa825a630b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6cd9f065e0d4be88e42fa2ec3bb6ff3)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:12.432806 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f43ec-9813-4f8b-b675-0fa825a630b8 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:12.548922 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-c83f43ec-9813-4f8b-b675-0fa825a630b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6cd9f065e0d4be88e42fa2ec3bb6ff3', 'request_id': 'req-c83f43ec-9813-4f8b-b675-0fa825a630b8'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:12.555640 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-c83f43ec-9813-4f8b-b675-0fa825a630b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6cd9f065e0d4be88e42fa2ec3bb6ff3', 'request_id': 'req-c83f43ec-9813-4f8b-b675-0fa825a630b8'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:12.562099 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-c83f43ec-9813-4f8b-b675-0fa825a630b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6cd9f065e0d4be88e42fa2ec3bb6ff3', 'request_id': 'req-c83f43ec-9813-4f8b-b675-0fa825a630b8'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:12.662704 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-c83f43ec-9813-4f8b-b675-0fa825a630b8 admin admin] The token cache is being invalidate because project c6cd9f065e0d4be88e42fa2ec3bb6ff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:26:12.663008 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-c83f43ec-9813-4f8b-b675-0fa825a630b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:12.663731 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-c83f43ec-9813-4f8b-b675-0fa825a630b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:12.665697 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1132/2263] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:26:12 2022] DELETE /identity/v3/projects/c6cd9f065e0d4be88e42fa2ec3bb6ff3 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:12.669809 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963e7a1-0a3f-4eeb-8b0e-888cf7a2e895 service glance] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:12.682984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963e7a1-0a3f-4eeb-8b0e-888cf7a2e895 service glance] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:12.745279 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301453e-22da-4c41-8a6d-f10866e87107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:12.745866 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301453e-22da-4c41-8a6d-f10866e87107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:12.745946 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301453e-22da-4c41-8a6d-f10866e87107 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:12.749690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301453e-22da-4c41-8a6d-f10866e87107 admin admin] PATH_INFO: `/v3/users/46311983be5e473b85da3e0e37dbfb13` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:12.749690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301453e-22da-4c41-8a6d-f10866e87107 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46311983be5e473b85da3e0e37dbfb13)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:12.749974 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301453e-22da-4c41-8a6d-f10866e87107 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:12.862631 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:12.921564 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:12.934771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-8301453e-22da-4c41-8a6d-f10866e87107 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46311983be5e473b85da3e0e37dbfb13'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:12.939958 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-8301453e-22da-4c41-8a6d-f10866e87107 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46311983be5e473b85da3e0e37dbfb13'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:12.947169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-8301453e-22da-4c41-8a6d-f10866e87107 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46311983be5e473b85da3e0e37dbfb13'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:12.948001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-8301453e-22da-4c41-8a6d-f10866e87107 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46311983be5e473b85da3e0e37dbfb13'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:12.971155 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-8301453e-22da-4c41-8a6d-f10866e87107 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46311983be5e473b85da3e0e37dbfb13'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:13.092408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1132/2264] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:26:12 2022] DELETE /identity/v3/users/46311983be5e473b85da3e0e37dbfb13 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:13.447221 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:13.713778 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:13.738465 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f43ec-9813-4f8b-b675-0fa825a630b8 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:13.741318 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c83f43ec-9813-4f8b-b675-0fa825a630b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:13.757622 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f43ec-9813-4f8b-b675-0fa825a630b8 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:13.822774 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a90f41-2388-42fb-95bc-d2b84f7bcb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:13.823336 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a90f41-2388-42fb-95bc-d2b84f7bcb4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:13.823616 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a90f41-2388-42fb-95bc-d2b84f7bcb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:13.823888 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a90f41-2388-42fb-95bc-d2b84f7bcb4a admin admin] PATH_INFO: `/v3/projects/c5a365a19a424355b642e3471c757321` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:13.825190 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a90f41-2388-42fb-95bc-d2b84f7bcb4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5a365a19a424355b642e3471c757321)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:13.827490 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a90f41-2388-42fb-95bc-d2b84f7bcb4a admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:13.862651 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:14.006212 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-43a90f41-2388-42fb-95bc-d2b84f7bcb4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5a365a19a424355b642e3471c757321', 'request_id': 'req-43a90f41-2388-42fb-95bc-d2b84f7bcb4a'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:14.012398 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-43a90f41-2388-42fb-95bc-d2b84f7bcb4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5a365a19a424355b642e3471c757321', 'request_id': 'req-43a90f41-2388-42fb-95bc-d2b84f7bcb4a'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:14.017899 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-43a90f41-2388-42fb-95bc-d2b84f7bcb4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5a365a19a424355b642e3471c757321', 'request_id': 'req-43a90f41-2388-42fb-95bc-d2b84f7bcb4a'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:14.084723 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-43a90f41-2388-42fb-95bc-d2b84f7bcb4a admin admin] The token cache is being invalidate because project c5a365a19a424355b642e3471c757321 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:26:14.084949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-43a90f41-2388-42fb-95bc-d2b84f7bcb4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:14.085646 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-43a90f41-2388-42fb-95bc-d2b84f7bcb4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:14.087255 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1133/2265] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:26:13 2022] DELETE /identity/v3/projects/c5a365a19a424355b642e3471c757321 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:14.091453 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301453e-22da-4c41-8a6d-f10866e87107 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:14.093387 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-8301453e-22da-4c41-8a6d-f10866e87107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:14.106795 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301453e-22da-4c41-8a6d-f10866e87107 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:14.165187 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11def65-be9e-44e3-92dc-8797b3d56c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:14.165865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11def65-be9e-44e3-92dc-8797b3d56c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:14.166165 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11def65-be9e-44e3-92dc-8797b3d56c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:14.166502 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11def65-be9e-44e3-92dc-8797b3d56c78 admin admin] PATH_INFO: `/v3/users/0cb7b62d1cc84d89af0d66c4f52150a0` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:14.167534 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11def65-be9e-44e3-92dc-8797b3d56c78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cb7b62d1cc84d89af0d66c4f52150a0)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:14.169584 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11def65-be9e-44e3-92dc-8797b3d56c78 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:14.360344 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:14.375308 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c11def65-be9e-44e3-92dc-8797b3d56c78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cb7b62d1cc84d89af0d66c4f52150a0'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:14.376785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c11def65-be9e-44e3-92dc-8797b3d56c78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cb7b62d1cc84d89af0d66c4f52150a0'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:14.386704 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c11def65-be9e-44e3-92dc-8797b3d56c78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cb7b62d1cc84d89af0d66c4f52150a0'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:14.386704 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c11def65-be9e-44e3-92dc-8797b3d56c78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cb7b62d1cc84d89af0d66c4f52150a0'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:14.397609 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c11def65-be9e-44e3-92dc-8797b3d56c78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cb7b62d1cc84d89af0d66c4f52150a0'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:14.479260 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1133/2266] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:26:14 2022] DELETE /identity/v3/users/0cb7b62d1cc84d89af0d66c4f52150a0 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:14.733865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:14.835453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a90f41-2388-42fb-95bc-d2b84f7bcb4a admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:14.836910 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-43a90f41-2388-42fb-95bc-d2b84f7bcb4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:14.849938 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a90f41-2388-42fb-95bc-d2b84f7bcb4a admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:14.908399 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ba867-27eb-4db3-9b7a-4515df1d6e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:14.909039 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ba867-27eb-4db3-9b7a-4515df1d6e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:14.909354 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ba867-27eb-4db3-9b7a-4515df1d6e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:14.909635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ba867-27eb-4db3-9b7a-4515df1d6e60 admin admin] PATH_INFO: `/v3/projects/5d207b77b1a344af8e11a131805bbcac` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:14.910762 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ba867-27eb-4db3-9b7a-4515df1d6e60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d207b77b1a344af8e11a131805bbcac)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:14.912745 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ba867-27eb-4db3-9b7a-4515df1d6e60 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:15.052527 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-435ba867-27eb-4db3-9b7a-4515df1d6e60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d207b77b1a344af8e11a131805bbcac', 'request_id': 'req-435ba867-27eb-4db3-9b7a-4515df1d6e60'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:15.058858 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-435ba867-27eb-4db3-9b7a-4515df1d6e60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d207b77b1a344af8e11a131805bbcac', 'request_id': 'req-435ba867-27eb-4db3-9b7a-4515df1d6e60'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:15.065023 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-435ba867-27eb-4db3-9b7a-4515df1d6e60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d207b77b1a344af8e11a131805bbcac', 'request_id': 'req-435ba867-27eb-4db3-9b7a-4515df1d6e60'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:15.074445 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:15.126680 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-435ba867-27eb-4db3-9b7a-4515df1d6e60 admin admin] The token cache is being invalidate because project 5d207b77b1a344af8e11a131805bbcac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:26:15.126986 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-435ba867-27eb-4db3-9b7a-4515df1d6e60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:15.127661 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-435ba867-27eb-4db3-9b7a-4515df1d6e60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:15.129377 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1134/2267] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:26:14 2022] DELETE /identity/v3/projects/5d207b77b1a344af8e11a131805bbcac => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:15.134639 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ced88-3146-40ca-be0a-c802eec3d927 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:15.137150 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ced88-3146-40ca-be0a-c802eec3d927 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:15.137150 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ced88-3146-40ca-be0a-c802eec3d927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:15.156270 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-0e1ced88-3146-40ca-be0a-c802eec3d927 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:15.157808 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-0e1ced88-3146-40ca-be0a-c802eec3d927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:15.225350 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1134/2268] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:15.233711 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3805dcb-5aa5-4308-a03d-321779f2e858 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:15.234002 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3805dcb-5aa5-4308-a03d-321779f2e858 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:15.234278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3805dcb-5aa5-4308-a03d-321779f2e858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:15.259393 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-a3805dcb-5aa5-4308-a03d-321779f2e858 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:15.260659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-a3805dcb-5aa5-4308-a03d-321779f2e858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:15.270528 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1135/2269] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:15.274906 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ced88-3146-40ca-be0a-c802eec3d927 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:15.285740 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ced88-3146-40ca-be0a-c802eec3d927 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:15.290467 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3eb6ca-4794-4026-9c72-84410c7230eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:15.291077 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3eb6ca-4794-4026-9c72-84410c7230eb admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:15.291355 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3eb6ca-4794-4026-9c72-84410c7230eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:15.291624 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3eb6ca-4794-4026-9c72-84410c7230eb admin admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:15.292272 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3eb6ca-4794-4026-9c72-84410c7230eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:26:15.292570 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3eb6ca-4794-4026-9c72-84410c7230eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:15.294196 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3eb6ca-4794-4026-9c72-84410c7230eb admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:15.307192 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1135/2270] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:26:15.311708 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3805dcb-5aa5-4308-a03d-321779f2e858 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:15.327403 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3805dcb-5aa5-4308-a03d-321779f2e858 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:15.331953 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c0e9d-f55c-42b3-8221-bd4ccc2e08f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:15.332563 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c0e9d-f55c-42b3-8221-bd4ccc2e08f4 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:15.332840 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c0e9d-f55c-42b3-8221-bd4ccc2e08f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:15.333135 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c0e9d-f55c-42b3-8221-bd4ccc2e08f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:15.333832 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c0e9d-f55c-42b3-8221-bd4ccc2e08f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:15.335691 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c0e9d-f55c-42b3-8221-bd4ccc2e08f4 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:15.424334 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1136/2271] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:26:15 2022] POST /identity/v3/projects => generated 389 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:26:15.424765 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3eb6ca-4794-4026-9c72-84410c7230eb admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:15.434907 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3eb6ca-4794-4026-9c72-84410c7230eb admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:15.445070 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:15.496699 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:15.529331 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913d257-98b6-45d8-910c-791b2715e1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:15.529964 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913d257-98b6-45d8-910c-791b2715e1c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:15.530244 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913d257-98b6-45d8-910c-791b2715e1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:15.530516 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913d257-98b6-45d8-910c-791b2715e1c2 admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:15.531154 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913d257-98b6-45d8-910c-791b2715e1c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:15.533187 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913d257-98b6-45d8-910c-791b2715e1c2 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:15.630656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1136/2272] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:26:15 2022] POST /identity/v3/users => generated 295 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:26:15.631649 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c0e9d-f55c-42b3-8221-bd4ccc2e08f4 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:15.646865 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c0e9d-f55c-42b3-8221-bd4ccc2e08f4 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:15.654687 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eec8e6-887c-4924-86a9-9401c1ab106d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:15.655491 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eec8e6-887c-4924-86a9-9401c1ab106d admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:15.655782 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eec8e6-887c-4924-86a9-9401c1ab106d admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:15.656061 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eec8e6-887c-4924-86a9-9401c1ab106d admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:15.656728 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eec8e6-887c-4924-86a9-9401c1ab106d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:15.658476 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eec8e6-887c-4924-86a9-9401c1ab106d admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:15.668948 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1137/2273] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:26:15.673270 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913d257-98b6-45d8-910c-791b2715e1c2 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:15.684902 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913d257-98b6-45d8-910c-791b2715e1c2 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:15.693770 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7fdc3-200c-4818-b4c6-d22881a0e4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:15.694534 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7fdc3-200c-4818-b4c6-d22881a0e4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:15.694923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7fdc3-200c-4818-b4c6-d22881a0e4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:15.695306 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7fdc3-200c-4818-b4c6-d22881a0e4b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:15.696415 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e7fdc3-200c-4818-b4c6-d22881a0e4b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:15.698229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e7fdc3-200c-4818-b4c6-d22881a0e4b0 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:15.711095 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1137/2274] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:26:15.715295 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eec8e6-887c-4924-86a9-9401c1ab106d admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:15.725911 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eec8e6-887c-4924-86a9-9401c1ab106d admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:15.730441 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcb9b3-020b-42d8-9950-d9e84c74cdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:15.731096 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcb9b3-020b-42d8-9950-d9e84c74cdf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:15.731376 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcb9b3-020b-42d8-9950-d9e84c74cdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:15.731648 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcb9b3-020b-42d8-9950-d9e84c74cdf9 admin admin] PATH_INFO: `/v3/projects/15777dd0c5844c5fb111ba9f9c0d88a7/users/7dc1e1858e204fbca0b5559a49f77e96/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:15.746069 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcb9b3-020b-42d8-9950-d9e84c74cdf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15777dd0c5844c5fb111ba9f9c0d88a7, user_id=7dc1e1858e204fbca0b5559a49f77e96, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:15.749469 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcb9b3-020b-42d8-9950-d9e84c74cdf9 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:15.851015 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1138/2275] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:26:15 2022] PUT /identity/v3/projects/15777dd0c5844c5fb111ba9f9c0d88a7/users/7dc1e1858e204fbca0b5559a49f77e96/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:26:15.863117 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6518e41-f295-431c-99fd-22ddc9281c58 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:15.863484 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6518e41-f295-431c-99fd-22ddc9281c58 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:15.863796 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6518e41-f295-431c-99fd-22ddc9281c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:15.899059 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-e6518e41-f295-431c-99fd-22ddc9281c58 None None] MFA Rules not processed for user `7dc1e1858e204fbca0b5559a49f77e96`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:15.900416 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-e6518e41-f295-431c-99fd-22ddc9281c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:15.968541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1138/2276] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:15 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:15.970096 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcb9b3-020b-42d8-9950-d9e84c74cdf9 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:15.972016 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-76dcb9b3-020b-42d8-9950-d9e84c74cdf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:15.979404 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6518e41-f295-431c-99fd-22ddc9281c58 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:15.980839 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-e6518e41-f295-431c-99fd-22ddc9281c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:16.043799 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcb9b3-020b-42d8-9950-d9e84c74cdf9 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:16.049622 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eccf59-e332-4487-b526-2284fd48ae63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:16.050398 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eccf59-e332-4487-b526-2284fd48ae63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:16.050751 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eccf59-e332-4487-b526-2284fd48ae63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:16.051090 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eccf59-e332-4487-b526-2284fd48ae63 admin admin] PATH_INFO: `/v3/users/7918138a16774fe4bbef241e5e1e9be4` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:16.055485 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eccf59-e332-4487-b526-2284fd48ae63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7918138a16774fe4bbef241e5e1e9be4)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:16.055599 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6518e41-f295-431c-99fd-22ddc9281c58 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:16.055694 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eccf59-e332-4487-b526-2284fd48ae63 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:16.056765 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1482ac9-6e7d-4d17-a14d-77e7a42d2b24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:16.057404 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1482ac9-6e7d-4d17-a14d-77e7a42d2b24 service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:16.057681 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1482ac9-6e7d-4d17-a14d-77e7a42d2b24 service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:16.057950 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1482ac9-6e7d-4d17-a14d-77e7a42d2b24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:16.067591 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1482ac9-6e7d-4d17-a14d-77e7a42d2b24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:16.069028 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1482ac9-6e7d-4d17-a14d-77e7a42d2b24 service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:16.078824 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1139/2277] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:26:15 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:26:16.081361 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:16.219336 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:16.224776 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b7eccf59-e332-4487-b526-2284fd48ae63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7918138a16774fe4bbef241e5e1e9be4'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:16.370609 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b7eccf59-e332-4487-b526-2284fd48ae63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7918138a16774fe4bbef241e5e1e9be4'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:16.378558 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b7eccf59-e332-4487-b526-2284fd48ae63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7918138a16774fe4bbef241e5e1e9be4'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:16.391947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b7eccf59-e332-4487-b526-2284fd48ae63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7918138a16774fe4bbef241e5e1e9be4'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:16.392785 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b7eccf59-e332-4487-b526-2284fd48ae63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7918138a16774fe4bbef241e5e1e9be4'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:16.399369 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1139/2278] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:26:15 2022] DELETE /identity/v3/users/7918138a16774fe4bbef241e5e1e9be4 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:16.405213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b9f7d-8448-4629-8cdc-9f6a8cf728b3 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:16.405213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b9f7d-8448-4629-8cdc-9f6a8cf728b3 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:16.405213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b9f7d-8448-4629-8cdc-9f6a8cf728b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:16.424056 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-fd2b9f7d-8448-4629-8cdc-9f6a8cf728b3 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:16.425514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-fd2b9f7d-8448-4629-8cdc-9f6a8cf728b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:16.486520 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1140/2279] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:16.496863 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eccf59-e332-4487-b526-2284fd48ae63 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:16.498489 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-b7eccf59-e332-4487-b526-2284fd48ae63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:16.557669 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eccf59-e332-4487-b526-2284fd48ae63 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:16.562701 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe55b02-c499-4ba7-a0ca-e3785c56108d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:16.563333 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe55b02-c499-4ba7-a0ca-e3785c56108d service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:16.563612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe55b02-c499-4ba7-a0ca-e3785c56108d service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:16.563885 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe55b02-c499-4ba7-a0ca-e3785c56108d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:16.574288 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe55b02-c499-4ba7-a0ca-e3785c56108d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:16.575890 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe55b02-c499-4ba7-a0ca-e3785c56108d service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:16.585683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1140/2280] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:26:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:26:16.992785 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:17.130919 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b9f7d-8448-4629-8cdc-9f6a8cf728b3 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:17.130919 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-fd2b9f7d-8448-4629-8cdc-9f6a8cf728b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:17.141773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b9f7d-8448-4629-8cdc-9f6a8cf728b3 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:17.146627 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1489d5-31ec-45b5-a559-cddee67ff4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:17.147626 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1489d5-31ec-45b5-a559-cddee67ff4ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:17.147626 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1489d5-31ec-45b5-a559-cddee67ff4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:17.147897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1489d5-31ec-45b5-a559-cddee67ff4ae admin admin] PATH_INFO: `/v3/projects/6f450cf598ae43ac9a2fdf7d364bb2b4` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:17.149499 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1489d5-31ec-45b5-a559-cddee67ff4ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f450cf598ae43ac9a2fdf7d364bb2b4)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:17.151666 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1489d5-31ec-45b5-a559-cddee67ff4ae admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:17.251731 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:17.269635 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-9b1489d5-31ec-45b5-a559-cddee67ff4ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f450cf598ae43ac9a2fdf7d364bb2b4', 'request_id': 'req-9b1489d5-31ec-45b5-a559-cddee67ff4ae'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:17.275855 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-9b1489d5-31ec-45b5-a559-cddee67ff4ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f450cf598ae43ac9a2fdf7d364bb2b4', 'request_id': 'req-9b1489d5-31ec-45b5-a559-cddee67ff4ae'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:17.281792 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-9b1489d5-31ec-45b5-a559-cddee67ff4ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f450cf598ae43ac9a2fdf7d364bb2b4', 'request_id': 'req-9b1489d5-31ec-45b5-a559-cddee67ff4ae'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:17.365332 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-9b1489d5-31ec-45b5-a559-cddee67ff4ae admin admin] The token cache is being invalidate because project 6f450cf598ae43ac9a2fdf7d364bb2b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:26:17.365490 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-9b1489d5-31ec-45b5-a559-cddee67ff4ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:17.366284 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-9b1489d5-31ec-45b5-a559-cddee67ff4ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:17.368087 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1141/2281] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:26:17 2022] DELETE /identity/v3/projects/6f450cf598ae43ac9a2fdf7d364bb2b4 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:17.371920 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe55b02-c499-4ba7-a0ca-e3785c56108d service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:17.382312 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe55b02-c499-4ba7-a0ca-e3785c56108d service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:17.446957 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bb0aa-45e9-463a-b48f-4fe4964d1741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:17.447605 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bb0aa-45e9-463a-b48f-4fe4964d1741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:17.450598 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bb0aa-45e9-463a-b48f-4fe4964d1741 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:17.450598 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bb0aa-45e9-463a-b48f-4fe4964d1741 admin admin] PATH_INFO: `/v3/users/d6b21e5e659444eaada02c3ef469641e` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:17.450598 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bb0aa-45e9-463a-b48f-4fe4964d1741 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6b21e5e659444eaada02c3ef469641e)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:17.451880 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bb0aa-45e9-463a-b48f-4fe4964d1741 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:17.475652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:17.671142 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b03bb0aa-45e9-463a-b48f-4fe4964d1741 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6b21e5e659444eaada02c3ef469641e'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:17.765493 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b03bb0aa-45e9-463a-b48f-4fe4964d1741 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6b21e5e659444eaada02c3ef469641e'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:17.773388 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b03bb0aa-45e9-463a-b48f-4fe4964d1741 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6b21e5e659444eaada02c3ef469641e'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:17.785350 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b03bb0aa-45e9-463a-b48f-4fe4964d1741 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6b21e5e659444eaada02c3ef469641e'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:17.785966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b03bb0aa-45e9-463a-b48f-4fe4964d1741 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6b21e5e659444eaada02c3ef469641e'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:17.791987 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1141/2282] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:26:17 2022] DELETE /identity/v3/users/d6b21e5e659444eaada02c3ef469641e => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:18.045683 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:18.275261 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1489d5-31ec-45b5-a559-cddee67ff4ae admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:18.276684 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-9b1489d5-31ec-45b5-a559-cddee67ff4ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:18.289735 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1489d5-31ec-45b5-a559-cddee67ff4ae admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:18.348735 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33a7e7-3d62-4b24-abc7-7808e8e8d869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:18.349414 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33a7e7-3d62-4b24-abc7-7808e8e8d869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:18.349695 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33a7e7-3d62-4b24-abc7-7808e8e8d869 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:18.349999 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33a7e7-3d62-4b24-abc7-7808e8e8d869 admin admin] PATH_INFO: `/v3/projects/944488a4d3404a0fab66272b9f79a167` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:18.351224 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33a7e7-3d62-4b24-abc7-7808e8e8d869 admin admin] RBAC: Authorizing `identity:delete_project(project_id=944488a4d3404a0fab66272b9f79a167)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:18.353259 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33a7e7-3d62-4b24-abc7-7808e8e8d869 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:18.362474 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:18.445665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:18.494092 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-1d33a7e7-3d62-4b24-abc7-7808e8e8d869 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '944488a4d3404a0fab66272b9f79a167', 'request_id': 'req-1d33a7e7-3d62-4b24-abc7-7808e8e8d869'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:18.500669 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-1d33a7e7-3d62-4b24-abc7-7808e8e8d869 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '944488a4d3404a0fab66272b9f79a167', 'request_id': 'req-1d33a7e7-3d62-4b24-abc7-7808e8e8d869'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:18.506657 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-1d33a7e7-3d62-4b24-abc7-7808e8e8d869 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '944488a4d3404a0fab66272b9f79a167', 'request_id': 'req-1d33a7e7-3d62-4b24-abc7-7808e8e8d869'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:18.583149 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-1d33a7e7-3d62-4b24-abc7-7808e8e8d869 admin admin] The token cache is being invalidate because project 944488a4d3404a0fab66272b9f79a167 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:26:18.583467 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-1d33a7e7-3d62-4b24-abc7-7808e8e8d869 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:18.584143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-1d33a7e7-3d62-4b24-abc7-7808e8e8d869 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:18.589174 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1142/2283] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:26:18 2022] DELETE /identity/v3/projects/944488a4d3404a0fab66272b9f79a167 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:18.590658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4867539-3cce-4a11-a06c-2e32062ed011 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:18.590941 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4867539-3cce-4a11-a06c-2e32062ed011 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:18.591290 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4867539-3cce-4a11-a06c-2e32062ed011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:18.612406 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-f4867539-3cce-4a11-a06c-2e32062ed011 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:18.613708 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-f4867539-3cce-4a11-a06c-2e32062ed011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:18.678749 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1142/2284] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:26:18.686818 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2c3b0-cb12-4bf5-979a-630dc5ee053b None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:18.687153 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2c3b0-cb12-4bf5-979a-630dc5ee053b None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:18.687439 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2c3b0-cb12-4bf5-979a-630dc5ee053b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:18.709197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-dfa2c3b0-cb12-4bf5-979a-630dc5ee053b None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:18.710447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-dfa2c3b0-cb12-4bf5-979a-630dc5ee053b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:18.720291 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1143/2285] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:18.724568 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4867539-3cce-4a11-a06c-2e32062ed011 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:18.734748 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4867539-3cce-4a11-a06c-2e32062ed011 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:18.742852 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c41020-ef8f-425c-8e1d-9dfa457a895c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:18.747591 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c41020-ef8f-425c-8e1d-9dfa457a895c admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:18.747591 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c41020-ef8f-425c-8e1d-9dfa457a895c admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:18.747591 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c41020-ef8f-425c-8e1d-9dfa457a895c admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:18.747591 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c41020-ef8f-425c-8e1d-9dfa457a895c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:26:18.747591 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c41020-ef8f-425c-8e1d-9dfa457a895c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:18.747591 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c41020-ef8f-425c-8e1d-9dfa457a895c admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:18.759710 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1143/2286] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:26:18.764151 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2c3b0-cb12-4bf5-979a-630dc5ee053b None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:18.773676 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2c3b0-cb12-4bf5-979a-630dc5ee053b None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:18.778435 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ab85b-560e-4f26-bbc7-4fbb239be2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:18.779050 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ab85b-560e-4f26-bbc7-4fbb239be2b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:18.779339 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ab85b-560e-4f26-bbc7-4fbb239be2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:18.779611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ab85b-560e-4f26-bbc7-4fbb239be2b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:18.780899 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ab85b-560e-4f26-bbc7-4fbb239be2b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:18.782807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ab85b-560e-4f26-bbc7-4fbb239be2b2 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:18.861156 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1144/2287] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:26:18 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:26:18.865500 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c41020-ef8f-425c-8e1d-9dfa457a895c admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:18.873122 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:18.876772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c41020-ef8f-425c-8e1d-9dfa457a895c admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:18.934408 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc11d4-caca-4e7a-b5f7-9cf103245e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:18.935023 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc11d4-caca-4e7a-b5f7-9cf103245e9c admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:18.935308 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc11d4-caca-4e7a-b5f7-9cf103245e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:18.935583 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc11d4-caca-4e7a-b5f7-9cf103245e9c admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:18.936240 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc11d4-caca-4e7a-b5f7-9cf103245e9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:18.938220 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc11d4-caca-4e7a-b5f7-9cf103245e9c admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:19.018913 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1144/2288] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:26:18 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:26:19.023068 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ab85b-560e-4f26-bbc7-4fbb239be2b2 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:19.034889 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ab85b-560e-4f26-bbc7-4fbb239be2b2 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:19.039719 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446f671-d5d5-42af-ba09-a09633f4f325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:19.040457 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446f671-d5d5-42af-ba09-a09633f4f325 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:19.040693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446f671-d5d5-42af-ba09-a09633f4f325 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:19.040880 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446f671-d5d5-42af-ba09-a09633f4f325 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:19.041714 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446f671-d5d5-42af-ba09-a09633f4f325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:19.043403 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446f671-d5d5-42af-ba09-a09633f4f325 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:19.054578 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1145/2289] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:26:19.058363 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc11d4-caca-4e7a-b5f7-9cf103245e9c admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:19.069131 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc11d4-caca-4e7a-b5f7-9cf103245e9c admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:19.082832 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c5639-f109-4f3b-a9be-ac1cd70985f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:19.083717 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c5639-f109-4f3b-a9be-ac1cd70985f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:19.084190 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c5639-f109-4f3b-a9be-ac1cd70985f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:19.084682 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c5639-f109-4f3b-a9be-ac1cd70985f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:19.085653 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c5639-f109-4f3b-a9be-ac1cd70985f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:19.087439 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c5639-f109-4f3b-a9be-ac1cd70985f8 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:19.104355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1145/2290] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:26:19.108389 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446f671-d5d5-42af-ba09-a09633f4f325 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:19.123323 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446f671-d5d5-42af-ba09-a09633f4f325 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:19.123323 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:19.127651 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057534f-96ba-440b-af68-ebdb2c907646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:19.128345 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057534f-96ba-440b-af68-ebdb2c907646 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:19.128665 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057534f-96ba-440b-af68-ebdb2c907646 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:19.128953 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057534f-96ba-440b-af68-ebdb2c907646 admin admin] PATH_INFO: `/v3/projects/464359d8eb8b413a8d4d6cf760b01b43/users/9d5cf6412dbe4c749287b5406fa412c0/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:19.159799 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057534f-96ba-440b-af68-ebdb2c907646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=464359d8eb8b413a8d4d6cf760b01b43, user_id=9d5cf6412dbe4c749287b5406fa412c0, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:19.162742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057534f-96ba-440b-af68-ebdb2c907646 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:19.259627 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1146/2291] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:26:19 2022] PUT /identity/v3/projects/464359d8eb8b413a8d4d6cf760b01b43/users/9d5cf6412dbe4c749287b5406fa412c0/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:26:19.272839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975cdcd-a455-4a21-8ac3-46d571c0183b None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:19.273462 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975cdcd-a455-4a21-8ac3-46d571c0183b None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:19.274184 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975cdcd-a455-4a21-8ac3-46d571c0183b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:19.315623 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-7975cdcd-a455-4a21-8ac3-46d571c0183b None None] MFA Rules not processed for user `9d5cf6412dbe4c749287b5406fa412c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:19.315623 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-7975cdcd-a455-4a21-8ac3-46d571c0183b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:19.388113 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1146/2292] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:19.392861 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057534f-96ba-440b-af68-ebdb2c907646 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:19.479960 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057534f-96ba-440b-af68-ebdb2c907646 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:19.485162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f944b74-bec9-427d-8ec9-2353662ff079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:19.486590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f944b74-bec9-427d-8ec9-2353662ff079 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:19.490207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f944b74-bec9-427d-8ec9-2353662ff079 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:19.490207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f944b74-bec9-427d-8ec9-2353662ff079 admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:19.490207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f944b74-bec9-427d-8ec9-2353662ff079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:19.490207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f944b74-bec9-427d-8ec9-2353662ff079 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:19.598442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1147/2293] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:26:19 2022] POST /identity/v3/projects => generated 385 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:26:19.603065 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975cdcd-a455-4a21-8ac3-46d571c0183b None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:19.616505 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975cdcd-a455-4a21-8ac3-46d571c0183b None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:19.694961 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2e0a1-43ba-4219-b1e5-6fe0fe6ab2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:19.695591 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2e0a1-43ba-4219-b1e5-6fe0fe6ab2a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:19.695866 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2e0a1-43ba-4219-b1e5-6fe0fe6ab2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:19.696143 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2e0a1-43ba-4219-b1e5-6fe0fe6ab2a3 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:19.696775 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2e0a1-43ba-4219-b1e5-6fe0fe6ab2a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:19.698911 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2e0a1-43ba-4219-b1e5-6fe0fe6ab2a3 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:19.777298 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1147/2294] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:26:19 2022] POST /identity/v3/users => generated 299 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:26:19.781551 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f944b74-bec9-427d-8ec9-2353662ff079 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:19.791834 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f944b74-bec9-427d-8ec9-2353662ff079 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:19.796957 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f64cc6-76d6-4ec9-8aeb-1ef8273f044a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:19.798832 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f64cc6-76d6-4ec9-8aeb-1ef8273f044a admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:19.798832 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f64cc6-76d6-4ec9-8aeb-1ef8273f044a admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:19.798832 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f64cc6-76d6-4ec9-8aeb-1ef8273f044a admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:19.799359 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f64cc6-76d6-4ec9-8aeb-1ef8273f044a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:19.800852 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f64cc6-76d6-4ec9-8aeb-1ef8273f044a admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:19.812054 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1148/2295] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:26:19.816422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2e0a1-43ba-4219-b1e5-6fe0fe6ab2a3 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:19.828728 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2e0a1-43ba-4219-b1e5-6fe0fe6ab2a3 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:19.835313 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:19.846595 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805983a-cca3-4680-9b3e-cab94a838ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:19.848087 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805983a-cca3-4680-9b3e-cab94a838ad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:19.848643 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805983a-cca3-4680-9b3e-cab94a838ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:19.849024 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805983a-cca3-4680-9b3e-cab94a838ad6 admin admin] PATH_INFO: `/v3/projects/d1ce075654b64b2bbfd44f8596d8585e/users/653c175069af4633a1675a2666fb8e2f/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:19.865606 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805983a-cca3-4680-9b3e-cab94a838ad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ce075654b64b2bbfd44f8596d8585e, user_id=653c175069af4633a1675a2666fb8e2f, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:19.868327 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805983a-cca3-4680-9b3e-cab94a838ad6 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:19.965812 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1148/2296] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:26:19 2022] PUT /identity/v3/projects/d1ce075654b64b2bbfd44f8596d8585e/users/653c175069af4633a1675a2666fb8e2f/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:19.966467 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f64cc6-76d6-4ec9-8aeb-1ef8273f044a admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:19.984110 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:19.989029 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f64cc6-76d6-4ec9-8aeb-1ef8273f044a admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:20.055815 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330d80c-a2de-4683-9832-7936042eebec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:20.056442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330d80c-a2de-4683-9832-7936042eebec admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:20.056724 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330d80c-a2de-4683-9832-7936042eebec admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:20.057007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330d80c-a2de-4683-9832-7936042eebec admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:20.057693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330d80c-a2de-4683-9832-7936042eebec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:20.059302 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330d80c-a2de-4683-9832-7936042eebec admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:20.069052 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1149/2297] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:26:20.073203 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805983a-cca3-4680-9b3e-cab94a838ad6 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:20.083298 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805983a-cca3-4680-9b3e-cab94a838ad6 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:20.087845 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5d502-017d-4f39-837a-ae9c32b27f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:20.088491 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5d502-017d-4f39-837a-ae9c32b27f04 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:20.088770 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5d502-017d-4f39-837a-ae9c32b27f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:20.089043 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5d502-017d-4f39-837a-ae9c32b27f04 admin admin] PATH_INFO: `/v3/projects/d1ce075654b64b2bbfd44f8596d8585e/users/653c175069af4633a1675a2666fb8e2f/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:20.091012 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb5d502-017d-4f39-837a-ae9c32b27f04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ce075654b64b2bbfd44f8596d8585e, user_id=653c175069af4633a1675a2666fb8e2f, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:20.094281 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb5d502-017d-4f39-837a-ae9c32b27f04 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:20.104342 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1149/2298] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:26:20 2022] PUT /identity/v3/projects/d1ce075654b64b2bbfd44f8596d8585e/users/653c175069af4633a1675a2666fb8e2f/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:20.118859 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8e08f-6dc5-4bcf-9859-9bfb22e6c8b0 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:20.118859 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8e08f-6dc5-4bcf-9859-9bfb22e6c8b0 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:20.118859 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8e08f-6dc5-4bcf-9859-9bfb22e6c8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:20.156498 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-3ff8e08f-6dc5-4bcf-9859-9bfb22e6c8b0 None None] MFA Rules not processed for user `653c175069af4633a1675a2666fb8e2f`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:20.157747 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-3ff8e08f-6dc5-4bcf-9859-9bfb22e6c8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:20.228213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1150/2299] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:26:20.239905 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5d502-017d-4f39-837a-ae9c32b27f04 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:20.243961 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-efb5d502-017d-4f39-837a-ae9c32b27f04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:20.326538 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5d502-017d-4f39-837a-ae9c32b27f04 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:20.331134 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9ba18-6667-4a68-8275-96fc0ef4e6e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:20.331813 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9ba18-6667-4a68-8275-96fc0ef4e6e4 service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:20.332934 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9ba18-6667-4a68-8275-96fc0ef4e6e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:20.333275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9ba18-6667-4a68-8275-96fc0ef4e6e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:20.345479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9ba18-6667-4a68-8275-96fc0ef4e6e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:20.347245 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9ba18-6667-4a68-8275-96fc0ef4e6e4 service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:20.363000 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1150/2300] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:26:20 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:26:20.850997 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:20.937278 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:21.125383 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:21.263225 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:21.566502 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8e08f-6dc5-4bcf-9859-9bfb22e6c8b0 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:21.656095 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8e08f-6dc5-4bcf-9859-9bfb22e6c8b0 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:21.661215 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfacfa2-df28-4356-aa0d-9d8a2a7771a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:21.661858 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfacfa2-df28-4356-aa0d-9d8a2a7771a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:21.662140 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfacfa2-df28-4356-aa0d-9d8a2a7771a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:21.662402 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfacfa2-df28-4356-aa0d-9d8a2a7771a0 admin admin] PATH_INFO: `/v3/users/9d5cf6412dbe4c749287b5406fa412c0` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:21.664771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfacfa2-df28-4356-aa0d-9d8a2a7771a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d5cf6412dbe4c749287b5406fa412c0)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:21.665783 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d900d4b-cd95-420b-b833-7583efe3e28c None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:21.666397 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d900d4b-cd95-420b-b833-7583efe3e28c None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:21.666754 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfacfa2-df28-4356-aa0d-9d8a2a7771a0 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:21.666975 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d900d4b-cd95-420b-b833-7583efe3e28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:21.692735 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-3d900d4b-cd95-420b-b833-7583efe3e28c None None] MFA Rules not processed for user `826b9a7c343b4dbc9aeb3dbc0b75fc92`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:21.694112 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-3d900d4b-cd95-420b-b833-7583efe3e28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:21.759470 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1151/2301] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 23 04:26:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:26:21.808857 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d900d4b-cd95-420b-b833-7583efe3e28c None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:21.810642 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-3d900d4b-cd95-420b-b833-7583efe3e28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:21.884182 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d900d4b-cd95-420b-b833-7583efe3e28c None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:21.889216 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0e7f1-b1a7-47be-bb08-37ce072e9818 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63190c62bc92403880ffaedc4737485a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:21.889986 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0e7f1-b1a7-47be-bb08-37ce072e9818 service swift] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:21.890265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0e7f1-b1a7-47be-bb08-37ce072e9818 service swift] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:21.890563 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0e7f1-b1a7-47be-bb08-37ce072e9818 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:21.898493 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0e7f1-b1a7-47be-bb08-37ce072e9818 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:21.900116 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0e7f1-b1a7-47be-bb08-37ce072e9818 service swift] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:21.908452 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1152/2302] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 23 04:26:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 04:26:21.947332 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:21.975838 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-cbfacfa2-df28-4356-aa0d-9d8a2a7771a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d5cf6412dbe4c749287b5406fa412c0'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:21.978516 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-cbfacfa2-df28-4356-aa0d-9d8a2a7771a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d5cf6412dbe4c749287b5406fa412c0'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:21.989951 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-cbfacfa2-df28-4356-aa0d-9d8a2a7771a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d5cf6412dbe4c749287b5406fa412c0'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:21.991182 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-cbfacfa2-df28-4356-aa0d-9d8a2a7771a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d5cf6412dbe4c749287b5406fa412c0'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:22.010063 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-cbfacfa2-df28-4356-aa0d-9d8a2a7771a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d5cf6412dbe4c749287b5406fa412c0'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:22.108663 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1151/2303] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:26:21 2022] DELETE /identity/v3/users/9d5cf6412dbe4c749287b5406fa412c0 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:22.113746 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d1a24-05c7-4359-8497-056e3a8d87ea None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:22.114332 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d1a24-05c7-4359-8497-056e3a8d87ea None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:22.114797 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d1a24-05c7-4359-8497-056e3a8d87ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:22.138297 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-3c7d1a24-05c7-4359-8497-056e3a8d87ea None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:22.142220 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-3c7d1a24-05c7-4359-8497-056e3a8d87ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:22.219137 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1153/2304] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:22.219642 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:22.226994 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfacfa2-df28-4356-aa0d-9d8a2a7771a0 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:22.229258 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-cbfacfa2-df28-4356-aa0d-9d8a2a7771a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:22.292360 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfacfa2-df28-4356-aa0d-9d8a2a7771a0 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:22.297381 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fdadd-82b6-4b69-8e66-a364eb51dedb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:22.298663 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fdadd-82b6-4b69-8e66-a364eb51dedb service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:22.299048 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fdadd-82b6-4b69-8e66-a364eb51dedb service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:22.299423 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fdadd-82b6-4b69-8e66-a364eb51dedb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:22.310411 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2fdadd-82b6-4b69-8e66-a364eb51dedb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:22.312561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2fdadd-82b6-4b69-8e66-a364eb51dedb service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:22.323299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1152/2305] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:26:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:26:22.652483 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:22.679750 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:22.994113 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:23.437116 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d1a24-05c7-4359-8497-056e3a8d87ea None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:23.439687 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-3c7d1a24-05c7-4359-8497-056e3a8d87ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:23.468839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d1a24-05c7-4359-8497-056e3a8d87ea None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:23.480011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:23.482616 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24c064-8c72-4a10-961c-cefa84d1f7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:23.483973 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24c064-8c72-4a10-961c-cefa84d1f7f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:23.486511 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24c064-8c72-4a10-961c-cefa84d1f7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:23.486964 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24c064-8c72-4a10-961c-cefa84d1f7f1 admin admin] PATH_INFO: `/v3/projects/464359d8eb8b413a8d4d6cf760b01b43` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:23.491395 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee24c064-8c72-4a10-961c-cefa84d1f7f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=464359d8eb8b413a8d4d6cf760b01b43)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:23.493779 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee24c064-8c72-4a10-961c-cefa84d1f7f1 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:23.668323 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-ee24c064-8c72-4a10-961c-cefa84d1f7f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '464359d8eb8b413a8d4d6cf760b01b43', 'request_id': 'req-ee24c064-8c72-4a10-961c-cefa84d1f7f1'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:23.675675 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-ee24c064-8c72-4a10-961c-cefa84d1f7f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '464359d8eb8b413a8d4d6cf760b01b43', 'request_id': 'req-ee24c064-8c72-4a10-961c-cefa84d1f7f1'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:23.682425 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-ee24c064-8c72-4a10-961c-cefa84d1f7f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '464359d8eb8b413a8d4d6cf760b01b43', 'request_id': 'req-ee24c064-8c72-4a10-961c-cefa84d1f7f1'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:23.782816 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-ee24c064-8c72-4a10-961c-cefa84d1f7f1 admin admin] The token cache is being invalidate because project 464359d8eb8b413a8d4d6cf760b01b43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:26:23.785799 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-ee24c064-8c72-4a10-961c-cefa84d1f7f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:23.785799 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-ee24c064-8c72-4a10-961c-cefa84d1f7f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:23.786315 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1154/2306] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:26:23 2022] DELETE /identity/v3/projects/464359d8eb8b413a8d4d6cf760b01b43 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:26:23.790353 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fdadd-82b6-4b69-8e66-a364eb51dedb service neutron] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:23.801287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fdadd-82b6-4b69-8e66-a364eb51dedb service neutron] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:23.805253 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:23.864024 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748a490-5087-4de9-b3cf-088b10d11175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:23.864683 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748a490-5087-4de9-b3cf-088b10d11175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:23.865033 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748a490-5087-4de9-b3cf-088b10d11175 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:23.865601 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748a490-5087-4de9-b3cf-088b10d11175 admin admin] PATH_INFO: `/v3/users/653c175069af4633a1675a2666fb8e2f` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:23.866746 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748a490-5087-4de9-b3cf-088b10d11175 admin admin] RBAC: Authorizing `identity:delete_user(user_id=653c175069af4633a1675a2666fb8e2f)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:23.868886 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748a490-5087-4de9-b3cf-088b10d11175 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:24.078983 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-1748a490-5087-4de9-b3cf-088b10d11175 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '653c175069af4633a1675a2666fb8e2f'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:24.082129 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-1748a490-5087-4de9-b3cf-088b10d11175 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '653c175069af4633a1675a2666fb8e2f'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:24.092755 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-1748a490-5087-4de9-b3cf-088b10d11175 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '653c175069af4633a1675a2666fb8e2f'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:24.095616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-1748a490-5087-4de9-b3cf-088b10d11175 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '653c175069af4633a1675a2666fb8e2f'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:24.107270 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:24.118832 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-1748a490-5087-4de9-b3cf-088b10d11175 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '653c175069af4633a1675a2666fb8e2f'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:24.258277 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1153/2307] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:26:23 2022] DELETE /identity/v3/users/653c175069af4633a1675a2666fb8e2f => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:26:24.773801 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24c064-8c72-4a10-961c-cefa84d1f7f1 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:24.776778 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-ee24c064-8c72-4a10-961c-cefa84d1f7f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:24.815351 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24c064-8c72-4a10-961c-cefa84d1f7f1 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:24.935913 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7472b13-3833-4d9a-8a7f-250a9f555d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:24.937235 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7472b13-3833-4d9a-8a7f-250a9f555d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:24.937714 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7472b13-3833-4d9a-8a7f-250a9f555d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:24.938170 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7472b13-3833-4d9a-8a7f-250a9f555d37 admin admin] PATH_INFO: `/v3/projects/d1ce075654b64b2bbfd44f8596d8585e` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:24.939336 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7472b13-3833-4d9a-8a7f-250a9f555d37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1ce075654b64b2bbfd44f8596d8585e)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:24.941636 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7472b13-3833-4d9a-8a7f-250a9f555d37 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:25.077495 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-d7472b13-3833-4d9a-8a7f-250a9f555d37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1ce075654b64b2bbfd44f8596d8585e', 'request_id': 'req-d7472b13-3833-4d9a-8a7f-250a9f555d37'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:25.084226 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-d7472b13-3833-4d9a-8a7f-250a9f555d37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1ce075654b64b2bbfd44f8596d8585e', 'request_id': 'req-d7472b13-3833-4d9a-8a7f-250a9f555d37'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:25.085482 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:25.091069 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-d7472b13-3833-4d9a-8a7f-250a9f555d37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1ce075654b64b2bbfd44f8596d8585e', 'request_id': 'req-d7472b13-3833-4d9a-8a7f-250a9f555d37'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:25.164874 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-d7472b13-3833-4d9a-8a7f-250a9f555d37 admin admin] The token cache is being invalidate because project d1ce075654b64b2bbfd44f8596d8585e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:26:25.165199 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-d7472b13-3833-4d9a-8a7f-250a9f555d37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:25.165970 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-d7472b13-3833-4d9a-8a7f-250a9f555d37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:25.171314 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1155/2308] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:26:24 2022] DELETE /identity/v3/projects/d1ce075654b64b2bbfd44f8596d8585e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:25.173624 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9052306-a1c1-4934-bd25-4d421e4c2414 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:25.174145 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9052306-a1c1-4934-bd25-4d421e4c2414 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:25.174245 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9052306-a1c1-4934-bd25-4d421e4c2414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:25.249444 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-f9052306-a1c1-4934-bd25-4d421e4c2414 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:25.251003 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-f9052306-a1c1-4934-bd25-4d421e4c2414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:25.333401 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1154/2309] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:25.335826 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b86b18-fcee-4735-a87b-c992138d3897 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:25.336182 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b86b18-fcee-4735-a87b-c992138d3897 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:25.336607 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b86b18-fcee-4735-a87b-c992138d3897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:25.364551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-b7b86b18-fcee-4735-a87b-c992138d3897 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:25.366025 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-b7b86b18-fcee-4735-a87b-c992138d3897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:25.375369 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1156/2310] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:25.379681 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9052306-a1c1-4934-bd25-4d421e4c2414 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:25.390814 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9052306-a1c1-4934-bd25-4d421e4c2414 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:25.397508 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e178b8-d8e0-4f31-bcb0-1edfbe06ecc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:25.398487 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e178b8-d8e0-4f31-bcb0-1edfbe06ecc5 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:25.398786 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e178b8-d8e0-4f31-bcb0-1edfbe06ecc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:25.399108 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e178b8-d8e0-4f31-bcb0-1edfbe06ecc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:25.399856 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e178b8-d8e0-4f31-bcb0-1edfbe06ecc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:26:25.400168 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e178b8-d8e0-4f31-bcb0-1edfbe06ecc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:25.401983 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e178b8-d8e0-4f31-bcb0-1edfbe06ecc5 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:25.417488 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1155/2311] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:26:25.421803 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b86b18-fcee-4735-a87b-c992138d3897 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:25.431615 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b86b18-fcee-4735-a87b-c992138d3897 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:25.436391 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54041d33-ca6f-408a-88c8-9d93f59565d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:25.436993 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54041d33-ca6f-408a-88c8-9d93f59565d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:25.437308 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54041d33-ca6f-408a-88c8-9d93f59565d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:25.437647 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54041d33-ca6f-408a-88c8-9d93f59565d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:25.438276 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54041d33-ca6f-408a-88c8-9d93f59565d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:25.440195 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54041d33-ca6f-408a-88c8-9d93f59565d2 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:25.602268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1157/2312] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:26:25 2022] POST /identity/v3/projects => generated 375 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:26:25.606475 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e178b8-d8e0-4f31-bcb0-1edfbe06ecc5 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:25.616731 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e178b8-d8e0-4f31-bcb0-1edfbe06ecc5 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:25.692285 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c76546-3403-4eb7-acec-28120baac6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:25.692820 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c76546-3403-4eb7-acec-28120baac6e5 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:25.697014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c76546-3403-4eb7-acec-28120baac6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:25.697545 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c76546-3403-4eb7-acec-28120baac6e5 admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:25.698305 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c76546-3403-4eb7-acec-28120baac6e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:25.703554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c76546-3403-4eb7-acec-28120baac6e5 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:25.788166 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1156/2313] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:26:25 2022] POST /identity/v3/users => generated 288 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:26:25.789335 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54041d33-ca6f-408a-88c8-9d93f59565d2 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:25.803658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54041d33-ca6f-408a-88c8-9d93f59565d2 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:25.810264 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424e335-6b77-40c9-b47e-24a556664553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:25.811358 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424e335-6b77-40c9-b47e-24a556664553 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:25.811655 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424e335-6b77-40c9-b47e-24a556664553 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:25.812488 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424e335-6b77-40c9-b47e-24a556664553 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:25.814659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424e335-6b77-40c9-b47e-24a556664553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:25.816396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424e335-6b77-40c9-b47e-24a556664553 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:25.841136 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1158/2314] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:26:25.847303 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c76546-3403-4eb7-acec-28120baac6e5 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:25.863408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c76546-3403-4eb7-acec-28120baac6e5 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:25.874959 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745047b-6b2d-4477-b20e-575751aa3745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:25.875582 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745047b-6b2d-4477-b20e-575751aa3745 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:25.876036 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745047b-6b2d-4477-b20e-575751aa3745 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:25.876160 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745047b-6b2d-4477-b20e-575751aa3745 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:25.877116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9745047b-6b2d-4477-b20e-575751aa3745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:25.879229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9745047b-6b2d-4477-b20e-575751aa3745 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:25.906949 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1157/2315] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:26:25.911237 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424e335-6b77-40c9-b47e-24a556664553 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:25.934025 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424e335-6b77-40c9-b47e-24a556664553 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:25.939725 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447ec2c-c962-423d-a184-d898ab2e8987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:25.940569 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447ec2c-c962-423d-a184-d898ab2e8987 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:25.941048 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447ec2c-c962-423d-a184-d898ab2e8987 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:25.941198 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447ec2c-c962-423d-a184-d898ab2e8987 admin admin] PATH_INFO: `/v3/projects/f1b3cd22a19143cd9d513de33c71b423/users/046c56fe6a614baabe8508d89c97de4e/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:25.979575 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447ec2c-c962-423d-a184-d898ab2e8987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1b3cd22a19143cd9d513de33c71b423, user_id=046c56fe6a614baabe8508d89c97de4e, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:25.986229 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447ec2c-c962-423d-a184-d898ab2e8987 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:26.096917 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1159/2316] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:26:25 2022] PUT /identity/v3/projects/f1b3cd22a19143cd9d513de33c71b423/users/046c56fe6a614baabe8508d89c97de4e/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:26.109286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd221d8-7301-4a35-b668-9d8a81025e6e None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:26.109600 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd221d8-7301-4a35-b668-9d8a81025e6e None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:26.109825 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd221d8-7301-4a35-b668-9d8a81025e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:26.156068 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-0fd221d8-7301-4a35-b668-9d8a81025e6e None None] MFA Rules not processed for user `046c56fe6a614baabe8508d89c97de4e`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:26.157963 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-0fd221d8-7301-4a35-b668-9d8a81025e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:26.223128 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:26.260791 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1158/2317] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:26.273772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447ec2c-c962-423d-a184-d898ab2e8987 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:26.275713 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-a447ec2c-c962-423d-a184-d898ab2e8987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:26.430632 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447ec2c-c962-423d-a184-d898ab2e8987 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:26.445522 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08cb0a-499f-4eb2-8958-fa6775070cc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:26.445522 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08cb0a-499f-4eb2-8958-fa6775070cc4 service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:26.445522 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08cb0a-499f-4eb2-8958-fa6775070cc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:26.445522 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08cb0a-499f-4eb2-8958-fa6775070cc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:26.463346 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08cb0a-499f-4eb2-8958-fa6775070cc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:26.465547 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08cb0a-499f-4eb2-8958-fa6775070cc4 service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:26.478102 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1160/2318] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:26:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:26:28.247718 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01568e-0ff8-4d6d-90a6-7cbb261378c2 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:28.248275 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01568e-0ff8-4d6d-90a6-7cbb261378c2 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:28.253336 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01568e-0ff8-4d6d-90a6-7cbb261378c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:28.268419 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-1f01568e-0ff8-4d6d-90a6-7cbb261378c2 None None] MFA Rules not processed for user `a42dcd2083e7477caeb79bedbcde3643`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:28.269659 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-1f01568e-0ff8-4d6d-90a6-7cbb261378c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:28.324135 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1159/2319] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:28 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:28.690248 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08cb0a-499f-4eb2-8958-fa6775070cc4 service cinder] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:28.691495 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-7f08cb0a-499f-4eb2-8958-fa6775070cc4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:28.802280 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08cb0a-499f-4eb2-8958-fa6775070cc4 service cinder] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:28.819575 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb31344-c6f6-4377-b529-d850cb771c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:28.819575 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb31344-c6f6-4377-b529-d850cb771c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:28.819575 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb31344-c6f6-4377-b529-d850cb771c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:28.819575 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb31344-c6f6-4377-b529-d850cb771c44 admin admin] PATH_INFO: `/v3/users/7dc1e1858e204fbca0b5559a49f77e96` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:28.822666 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb31344-c6f6-4377-b529-d850cb771c44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dc1e1858e204fbca0b5559a49f77e96)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:28.824600 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb31344-c6f6-4377-b529-d850cb771c44 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:28.886376 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:29.072123 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6eb31344-c6f6-4377-b529-d850cb771c44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dc1e1858e204fbca0b5559a49f77e96'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:29.147962 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6eb31344-c6f6-4377-b529-d850cb771c44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dc1e1858e204fbca0b5559a49f77e96'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:29.167232 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6eb31344-c6f6-4377-b529-d850cb771c44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dc1e1858e204fbca0b5559a49f77e96'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:29.199405 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6eb31344-c6f6-4377-b529-d850cb771c44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dc1e1858e204fbca0b5559a49f77e96'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:29.200792 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6eb31344-c6f6-4377-b529-d850cb771c44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dc1e1858e204fbca0b5559a49f77e96'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:29.215218 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1161/2320] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:26:28 2022] DELETE /identity/v3/users/7dc1e1858e204fbca0b5559a49f77e96 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:29.220117 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ced5f1-0ed7-46df-a28b-b3560c5a64bb None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:29.220655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ced5f1-0ed7-46df-a28b-b3560c5a64bb None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:29.221203 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ced5f1-0ed7-46df-a28b-b3560c5a64bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:29.247972 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-97ced5f1-0ed7-46df-a28b-b3560c5a64bb None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:29.250473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-97ced5f1-0ed7-46df-a28b-b3560c5a64bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:29.356839 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1160/2321] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:29.367494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb31344-c6f6-4377-b529-d850cb771c44 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:29.369839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-6eb31344-c6f6-4377-b529-d850cb771c44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:29.518318 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb31344-c6f6-4377-b529-d850cb771c44 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:29.525143 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f2c51-a0b6-4b35-9b4e-d32bcd1e1223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:29.525850 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f2c51-a0b6-4b35-9b4e-d32bcd1e1223 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:29.526137 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f2c51-a0b6-4b35-9b4e-d32bcd1e1223 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:29.526415 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f2c51-a0b6-4b35-9b4e-d32bcd1e1223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:29.544413 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f2c51-a0b6-4b35-9b4e-d32bcd1e1223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:29.546903 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f2c51-a0b6-4b35-9b4e-d32bcd1e1223 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:29.564196 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1162/2322] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:26:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:26:30.135204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ced5f1-0ed7-46df-a28b-b3560c5a64bb None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:30.136905 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-97ced5f1-0ed7-46df-a28b-b3560c5a64bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:30.183066 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ced5f1-0ed7-46df-a28b-b3560c5a64bb None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:30.190538 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba0df1-570f-4435-b402-dd146c1842be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:30.192317 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba0df1-570f-4435-b402-dd146c1842be admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:30.192618 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba0df1-570f-4435-b402-dd146c1842be admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:30.192955 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba0df1-570f-4435-b402-dd146c1842be admin admin] PATH_INFO: `/v3/projects/15777dd0c5844c5fb111ba9f9c0d88a7` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:30.194666 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba0df1-570f-4435-b402-dd146c1842be admin admin] RBAC: Authorizing `identity:delete_project(project_id=15777dd0c5844c5fb111ba9f9c0d88a7)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:30.196993 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba0df1-570f-4435-b402-dd146c1842be admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:30.371309 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-53ba0df1-570f-4435-b402-dd146c1842be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15777dd0c5844c5fb111ba9f9c0d88a7', 'request_id': 'req-53ba0df1-570f-4435-b402-dd146c1842be'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:30.383292 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-53ba0df1-570f-4435-b402-dd146c1842be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15777dd0c5844c5fb111ba9f9c0d88a7', 'request_id': 'req-53ba0df1-570f-4435-b402-dd146c1842be'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:30.387407 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-53ba0df1-570f-4435-b402-dd146c1842be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15777dd0c5844c5fb111ba9f9c0d88a7', 'request_id': 'req-53ba0df1-570f-4435-b402-dd146c1842be'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:30.463126 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-53ba0df1-570f-4435-b402-dd146c1842be admin admin] The token cache is being invalidate because project 15777dd0c5844c5fb111ba9f9c0d88a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:26:30.463320 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-53ba0df1-570f-4435-b402-dd146c1842be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:30.464051 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-53ba0df1-570f-4435-b402-dd146c1842be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:30.494707 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1161/2323] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:26:30 2022] DELETE /identity/v3/projects/15777dd0c5844c5fb111ba9f9c0d88a7 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:39.558743 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=46,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:40.460264 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:41.709817 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f2c51-a0b6-4b35-9b4e-d32bcd1e1223 service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:41.709817 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-bd0f2c51-a0b6-4b35-9b4e-d32bcd1e1223 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:41.721724 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f2c51-a0b6-4b35-9b4e-d32bcd1e1223 service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:41.791112 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0b048-5eaf-402e-946a-76e6c9e6a1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:41.791887 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0b048-5eaf-402e-946a-76e6c9e6a1f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:41.792267 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0b048-5eaf-402e-946a-76e6c9e6a1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:41.792645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0b048-5eaf-402e-946a-76e6c9e6a1f4 admin admin] PATH_INFO: `/v3/users/2de0983f2f2b4b399fd23e2327868a12` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:41.794087 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0b048-5eaf-402e-946a-76e6c9e6a1f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2de0983f2f2b4b399fd23e2327868a12)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:41.797374 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0b048-5eaf-402e-946a-76e6c9e6a1f4 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:42.020412 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-88e0b048-5eaf-402e-946a-76e6c9e6a1f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2de0983f2f2b4b399fd23e2327868a12'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:42.062825 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-88e0b048-5eaf-402e-946a-76e6c9e6a1f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2de0983f2f2b4b399fd23e2327868a12'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:42.074756 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-88e0b048-5eaf-402e-946a-76e6c9e6a1f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2de0983f2f2b4b399fd23e2327868a12'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:42.086381 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-88e0b048-5eaf-402e-946a-76e6c9e6a1f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2de0983f2f2b4b399fd23e2327868a12'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:42.087105 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-88e0b048-5eaf-402e-946a-76e6c9e6a1f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2de0983f2f2b4b399fd23e2327868a12'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:42.093958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1163/2324] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:26:41 2022] DELETE /identity/v3/users/2de0983f2f2b4b399fd23e2327868a12 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:42.098452 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b02e8-89a4-4cb7-858f-8e7d8ba8c08d None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:42.098969 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b02e8-89a4-4cb7-858f-8e7d8ba8c08d None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:42.099074 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b02e8-89a4-4cb7-858f-8e7d8ba8c08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:42.117824 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-062b02e8-89a4-4cb7-858f-8e7d8ba8c08d None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:42.119065 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-062b02e8-89a4-4cb7-858f-8e7d8ba8c08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:42.180588 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1162/2325] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:42.190271 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0b048-5eaf-402e-946a-76e6c9e6a1f4 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:42.192007 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-88e0b048-5eaf-402e-946a-76e6c9e6a1f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:42.265744 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0b048-5eaf-402e-946a-76e6c9e6a1f4 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:42.269415 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb888e-f857-4e77-ab3d-1d544b8719e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:42.270160 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb888e-f857-4e77-ab3d-1d544b8719e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:42.270452 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb888e-f857-4e77-ab3d-1d544b8719e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:42.270736 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb888e-f857-4e77-ab3d-1d544b8719e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:42.281485 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb888e-f857-4e77-ab3d-1d544b8719e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:42.282932 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb888e-f857-4e77-ab3d-1d544b8719e2 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:42.294029 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1164/2326] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:26:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:26:42.343733 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b02e8-89a4-4cb7-858f-8e7d8ba8c08d None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:42.345359 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-062b02e8-89a4-4cb7-858f-8e7d8ba8c08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:42.357484 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b02e8-89a4-4cb7-858f-8e7d8ba8c08d None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:42.362385 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e623df-98b9-48ad-8901-9589ed7bf7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:42.363143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e623df-98b9-48ad-8901-9589ed7bf7df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:42.368569 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e623df-98b9-48ad-8901-9589ed7bf7df admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:42.368569 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e623df-98b9-48ad-8901-9589ed7bf7df admin admin] PATH_INFO: `/v3/users/046c56fe6a614baabe8508d89c97de4e` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:42.368569 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e623df-98b9-48ad-8901-9589ed7bf7df admin admin] RBAC: Authorizing `identity:delete_user(user_id=046c56fe6a614baabe8508d89c97de4e)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:42.368569 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e623df-98b9-48ad-8901-9589ed7bf7df admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:42.545133 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-46e623df-98b9-48ad-8901-9589ed7bf7df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '046c56fe6a614baabe8508d89c97de4e'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:42.545943 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-46e623df-98b9-48ad-8901-9589ed7bf7df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '046c56fe6a614baabe8508d89c97de4e'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:42.553385 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-46e623df-98b9-48ad-8901-9589ed7bf7df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '046c56fe6a614baabe8508d89c97de4e'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:42.554063 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-46e623df-98b9-48ad-8901-9589ed7bf7df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '046c56fe6a614baabe8508d89c97de4e'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:42.567923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-46e623df-98b9-48ad-8901-9589ed7bf7df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '046c56fe6a614baabe8508d89c97de4e'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:42.622841 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1163/2327] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:26:42 2022] DELETE /identity/v3/users/046c56fe6a614baabe8508d89c97de4e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:42.627905 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bf432-eec5-420e-9de0-62bf03097dd3 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:42.628195 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bf432-eec5-420e-9de0-62bf03097dd3 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:42.628488 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bf432-eec5-420e-9de0-62bf03097dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:42.648280 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-551bf432-eec5-420e-9de0-62bf03097dd3 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:42.649529 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-551bf432-eec5-420e-9de0-62bf03097dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:42.666894 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:42.682883 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e623df-98b9-48ad-8901-9589ed7bf7df admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:42.684559 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-46e623df-98b9-48ad-8901-9589ed7bf7df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:42.728535 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1165/2328] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:42.740532 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551bf432-eec5-420e-9de0-62bf03097dd3 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:42.743017 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-551bf432-eec5-420e-9de0-62bf03097dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:42.783701 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e623df-98b9-48ad-8901-9589ed7bf7df admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:42.788722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485d229-355a-4b9b-b64c-42bd3fa5633d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:42.789522 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485d229-355a-4b9b-b64c-42bd3fa5633d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:42.789905 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485d229-355a-4b9b-b64c-42bd3fa5633d admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:42.790290 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485d229-355a-4b9b-b64c-42bd3fa5633d admin admin] PATH_INFO: `/v3/projects/80f3b5142ebb4729aaf1b22b02e48d8b` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:42.791738 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485d229-355a-4b9b-b64c-42bd3fa5633d admin admin] RBAC: Authorizing `identity:delete_project(project_id=80f3b5142ebb4729aaf1b22b02e48d8b)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:42.794444 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485d229-355a-4b9b-b64c-42bd3fa5633d admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:42.814096 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:42.817963 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551bf432-eec5-420e-9de0-62bf03097dd3 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:42.821598 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d8bc5-968d-444d-a5f8-c4fcd637eecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:42.822243 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d8bc5-968d-444d-a5f8-c4fcd637eecf service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:42.822529 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d8bc5-968d-444d-a5f8-c4fcd637eecf service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:42.822812 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d8bc5-968d-444d-a5f8-c4fcd637eecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:42.833358 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d8bc5-968d-444d-a5f8-c4fcd637eecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:42.834048 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d8bc5-968d-444d-a5f8-c4fcd637eecf service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:42.843615 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1166/2329] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:26:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:26:42.955325 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-5485d229-355a-4b9b-b64c-42bd3fa5633d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80f3b5142ebb4729aaf1b22b02e48d8b', 'request_id': 'req-5485d229-355a-4b9b-b64c-42bd3fa5633d'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:42.967966 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-5485d229-355a-4b9b-b64c-42bd3fa5633d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80f3b5142ebb4729aaf1b22b02e48d8b', 'request_id': 'req-5485d229-355a-4b9b-b64c-42bd3fa5633d'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:42.973706 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-5485d229-355a-4b9b-b64c-42bd3fa5633d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80f3b5142ebb4729aaf1b22b02e48d8b', 'request_id': 'req-5485d229-355a-4b9b-b64c-42bd3fa5633d'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:43.052927 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-5485d229-355a-4b9b-b64c-42bd3fa5633d admin admin] The token cache is being invalidate because project 80f3b5142ebb4729aaf1b22b02e48d8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:26:43.053519 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-5485d229-355a-4b9b-b64c-42bd3fa5633d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:43.054618 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-5485d229-355a-4b9b-b64c-42bd3fa5633d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:43.056668 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1164/2330] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:26:42 2022] DELETE /identity/v3/projects/80f3b5142ebb4729aaf1b22b02e48d8b => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:26:43.061746 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8be891-dd17-4d3f-aeed-13f36c12db19 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:43.062621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8be891-dd17-4d3f-aeed-13f36c12db19 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:43.062902 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8be891-dd17-4d3f-aeed-13f36c12db19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:43.085776 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-bc8be891-dd17-4d3f-aeed-13f36c12db19 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:43.087265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-bc8be891-dd17-4d3f-aeed-13f36c12db19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:43.135383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40510a39-0e0d-4c24-a2a6-a29dfcbd6354 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:43.135885 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40510a39-0e0d-4c24-a2a6-a29dfcbd6354 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:43.136120 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40510a39-0e0d-4c24-a2a6-a29dfcbd6354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:43.155588 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-40510a39-0e0d-4c24-a2a6-a29dfcbd6354 None None] MFA Rules not processed for user `826b9a7c343b4dbc9aeb3dbc0b75fc92`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:43.156803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-40510a39-0e0d-4c24-a2a6-a29dfcbd6354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:43.163161 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1167/2331] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:43.172739 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b3b65-9a9c-4090-b6a4-9c89131763c2 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:43.172739 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b3b65-9a9c-4090-b6a4-9c89131763c2 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:43.173050 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b3b65-9a9c-4090-b6a4-9c89131763c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:43.198248 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-577b3b65-9a9c-4090-b6a4-9c89131763c2 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:43.199463 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-577b3b65-9a9c-4090-b6a4-9c89131763c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:43.207396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1168/2332] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:43.211572 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b3b65-9a9c-4090-b6a4-9c89131763c2 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:43.216597 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1165/2333] 10.222.0.42 () {58 vars in 967 bytes} [Tue Aug 23 04:26:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:43.221548 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b3b65-9a9c-4090-b6a4-9c89131763c2 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:43.227780 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7cfaf-c02e-4f88-b0d7-5ff26a7ff0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:43.228285 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7cfaf-c02e-4f88-b0d7-5ff26a7ff0cb admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:43.228613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7cfaf-c02e-4f88-b0d7-5ff26a7ff0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:43.229029 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7cfaf-c02e-4f88-b0d7-5ff26a7ff0cb admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:43.229772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f7cfaf-c02e-4f88-b0d7-5ff26a7ff0cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:26:43.230396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f7cfaf-c02e-4f88-b0d7-5ff26a7ff0cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:43.231481 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40510a39-0e0d-4c24-a2a6-a29dfcbd6354 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:43.232142 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f7cfaf-c02e-4f88-b0d7-5ff26a7ff0cb admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:43.233577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-40510a39-0e0d-4c24-a2a6-a29dfcbd6354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:43.251670 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1169/2334] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:26:43.252673 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7cfaf-c02e-4f88-b0d7-5ff26a7ff0cb admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:43.266814 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7cfaf-c02e-4f88-b0d7-5ff26a7ff0cb admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:43.269383 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457521f-d9a4-4150-a06d-9b26450872b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:43.269993 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457521f-d9a4-4150-a06d-9b26450872b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:43.270280 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457521f-d9a4-4150-a06d-9b26450872b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:43.270559 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457521f-d9a4-4150-a06d-9b26450872b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:43.271195 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457521f-d9a4-4150-a06d-9b26450872b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:43.273315 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457521f-d9a4-4150-a06d-9b26450872b3 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:43.312343 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40510a39-0e0d-4c24-a2a6-a29dfcbd6354 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:43.317938 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9a476-9fb5-45dc-9354-bfbdb430eb32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63190c62bc92403880ffaedc4737485a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:43.318606 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9a476-9fb5-45dc-9354-bfbdb430eb32 service swift] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:43.318895 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9a476-9fb5-45dc-9354-bfbdb430eb32 service swift] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:43.319173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9a476-9fb5-45dc-9354-bfbdb430eb32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:43.328375 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9a476-9fb5-45dc-9354-bfbdb430eb32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:43.330037 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9a476-9fb5-45dc-9354-bfbdb430eb32 service swift] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:43.338555 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1166/2335] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 23 04:26:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 04:26:43.339455 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9a476-9fb5-45dc-9354-bfbdb430eb32 service swift] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:43.341598 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-dae9a476-9fb5-45dc-9354-bfbdb430eb32 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:43.355519 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9a476-9fb5-45dc-9354-bfbdb430eb32 service swift] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:43.360514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6cb403-232f-40fd-97df-a995ca06a398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:43.361282 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6cb403-232f-40fd-97df-a995ca06a398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:43.365151 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6cb403-232f-40fd-97df-a995ca06a398 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:43.365151 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6cb403-232f-40fd-97df-a995ca06a398 admin admin] PATH_INFO: `/v3/projects/f1b3cd22a19143cd9d513de33c71b423` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:43.365151 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6cb403-232f-40fd-97df-a995ca06a398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1b3cd22a19143cd9d513de33c71b423)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:43.365151 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6cb403-232f-40fd-97df-a995ca06a398 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:43.411642 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1170/2336] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:26:43 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:26:43.412883 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457521f-d9a4-4150-a06d-9b26450872b3 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:43.442693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:43.477645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457521f-d9a4-4150-a06d-9b26450872b3 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:43.482408 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5204d-0994-444b-8ea0-b8f44aee9349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:43.483031 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5204d-0994-444b-8ea0-b8f44aee9349 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:43.483310 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5204d-0994-444b-8ea0-b8f44aee9349 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:43.483611 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5204d-0994-444b-8ea0-b8f44aee9349 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:43.484242 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5204d-0994-444b-8ea0-b8f44aee9349 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:43.486214 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5204d-0994-444b-8ea0-b8f44aee9349 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:43.503575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:43.516433 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-0e6cb403-232f-40fd-97df-a995ca06a398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1b3cd22a19143cd9d513de33c71b423', 'request_id': 'req-0e6cb403-232f-40fd-97df-a995ca06a398'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:43.523141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-0e6cb403-232f-40fd-97df-a995ca06a398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1b3cd22a19143cd9d513de33c71b423', 'request_id': 'req-0e6cb403-232f-40fd-97df-a995ca06a398'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:43.529607 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-0e6cb403-232f-40fd-97df-a995ca06a398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1b3cd22a19143cd9d513de33c71b423', 'request_id': 'req-0e6cb403-232f-40fd-97df-a995ca06a398'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:43.605779 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1171/2337] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:26:43 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:26:43.610248 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5204d-0994-444b-8ea0-b8f44aee9349 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:43.619888 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5204d-0994-444b-8ea0-b8f44aee9349 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:43.629225 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-0e6cb403-232f-40fd-97df-a995ca06a398 admin admin] The token cache is being invalidate because project f1b3cd22a19143cd9d513de33c71b423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:26:43.629525 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-0e6cb403-232f-40fd-97df-a995ca06a398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:43.630200 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-0e6cb403-232f-40fd-97df-a995ca06a398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:43.631713 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1167/2338] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:26:43 2022] DELETE /identity/v3/projects/f1b3cd22a19143cd9d513de33c71b423 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:43.686214 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f77ecf-0324-46d1-8fea-220f1f642f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:43.687498 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f77ecf-0324-46d1-8fea-220f1f642f15 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:43.687711 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f77ecf-0324-46d1-8fea-220f1f642f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:43.687992 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f77ecf-0324-46d1-8fea-220f1f642f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:43.688658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f77ecf-0324-46d1-8fea-220f1f642f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:43.690410 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f77ecf-0324-46d1-8fea-220f1f642f15 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:43.701885 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1172/2339] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:26:43.706156 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6cb403-232f-40fd-97df-a995ca06a398 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:43.707630 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-0e6cb403-232f-40fd-97df-a995ca06a398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:43.721067 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6cb403-232f-40fd-97df-a995ca06a398 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:43.726563 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ecc8f-41e6-4e16-a35e-a907ed2c2eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:43.727210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ecc8f-41e6-4e16-a35e-a907ed2c2eef admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:43.727498 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ecc8f-41e6-4e16-a35e-a907ed2c2eef admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:43.727777 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ecc8f-41e6-4e16-a35e-a907ed2c2eef admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:43.728452 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ecc8f-41e6-4e16-a35e-a907ed2c2eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:43.730151 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ecc8f-41e6-4e16-a35e-a907ed2c2eef admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:43.741835 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1168/2340] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:26:43.746204 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f77ecf-0324-46d1-8fea-220f1f642f15 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:43.765761 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f77ecf-0324-46d1-8fea-220f1f642f15 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:43.770610 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac601f-7a0b-4bbc-8a82-87d8309de3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:43.771533 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac601f-7a0b-4bbc-8a82-87d8309de3d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:43.771912 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac601f-7a0b-4bbc-8a82-87d8309de3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:43.772285 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac601f-7a0b-4bbc-8a82-87d8309de3d8 admin admin] PATH_INFO: `/v3/projects/aa089d9855414d16a43a3d1c1e340d3e/users/95b2f363762b472e94ad4d65e2d15991/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:43.790558 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac601f-7a0b-4bbc-8a82-87d8309de3d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa089d9855414d16a43a3d1c1e340d3e, user_id=95b2f363762b472e94ad4d65e2d15991, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:43.793550 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac601f-7a0b-4bbc-8a82-87d8309de3d8 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:43.886197 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1173/2341] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:26:43 2022] PUT /identity/v3/projects/aa089d9855414d16a43a3d1c1e340d3e/users/95b2f363762b472e94ad4d65e2d15991/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:26:43.897002 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788ff18-5305-4c11-9519-a737855437b4 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:43.897328 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788ff18-5305-4c11-9519-a737855437b4 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:43.897611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788ff18-5305-4c11-9519-a737855437b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:43.928574 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-2788ff18-5305-4c11-9519-a737855437b4 None None] MFA Rules not processed for user `95b2f363762b472e94ad4d65e2d15991`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:43.929843 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-2788ff18-5305-4c11-9519-a737855437b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:43.999844 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1169/2342] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:44.011171 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac601f-7a0b-4bbc-8a82-87d8309de3d8 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:44.013214 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-ccac601f-7a0b-4bbc-8a82-87d8309de3d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:44.077321 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac601f-7a0b-4bbc-8a82-87d8309de3d8 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:44.081635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53c8f3-e8b7-404c-a1d1-d43a18d66dbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:44.082312 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53c8f3-e8b7-404c-a1d1-d43a18d66dbb service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:44.082597 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53c8f3-e8b7-404c-a1d1-d43a18d66dbb service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:44.082827 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53c8f3-e8b7-404c-a1d1-d43a18d66dbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:44.091574 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53c8f3-e8b7-404c-a1d1-d43a18d66dbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:44.093284 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53c8f3-e8b7-404c-a1d1-d43a18d66dbb service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:44.102266 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1174/2343] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:26:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:26:44.128438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788ff18-5305-4c11-9519-a737855437b4 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:44.196879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788ff18-5305-4c11-9519-a737855437b4 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:44.201485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015a916-ede4-488b-9d62-b8defba47c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:44.202129 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015a916-ede4-488b-9d62-b8defba47c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:44.202429 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015a916-ede4-488b-9d62-b8defba47c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:44.203227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015a916-ede4-488b-9d62-b8defba47c17 admin admin] PATH_INFO: `/v3/users/95b2f363762b472e94ad4d65e2d15991` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:44.204431 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3015a916-ede4-488b-9d62-b8defba47c17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95b2f363762b472e94ad4d65e2d15991)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:44.209273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3015a916-ede4-488b-9d62-b8defba47c17 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:44.397373 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:44.402609 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-3015a916-ede4-488b-9d62-b8defba47c17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95b2f363762b472e94ad4d65e2d15991'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:44.403268 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-3015a916-ede4-488b-9d62-b8defba47c17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95b2f363762b472e94ad4d65e2d15991'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:44.410388 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-3015a916-ede4-488b-9d62-b8defba47c17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95b2f363762b472e94ad4d65e2d15991'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:44.411024 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-3015a916-ede4-488b-9d62-b8defba47c17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95b2f363762b472e94ad4d65e2d15991'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:44.423676 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-3015a916-ede4-488b-9d62-b8defba47c17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95b2f363762b472e94ad4d65e2d15991'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:44.510519 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1170/2344] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:26:44 2022] DELETE /identity/v3/users/95b2f363762b472e94ad4d65e2d15991 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:44.516551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250ac85-2d49-4d61-a91c-e4e061b3467c None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:44.516957 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250ac85-2d49-4d61-a91c-e4e061b3467c None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:44.517349 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250ac85-2d49-4d61-a91c-e4e061b3467c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:44.538503 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-c250ac85-2d49-4d61-a91c-e4e061b3467c None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:44.539809 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c250ac85-2d49-4d61-a91c-e4e061b3467c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:44.566215 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:44.601986 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1175/2345] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:44.612340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015a916-ede4-488b-9d62-b8defba47c17 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:44.613773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-3015a916-ede4-488b-9d62-b8defba47c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:44.671738 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015a916-ede4-488b-9d62-b8defba47c17 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:44.676610 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7fbee-0cd2-4578-840d-9954bc2494b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:44.681162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7fbee-0cd2-4578-840d-9954bc2494b7 service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:44.681162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7fbee-0cd2-4578-840d-9954bc2494b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:44.681162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7fbee-0cd2-4578-840d-9954bc2494b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:44.691031 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de7fbee-0cd2-4578-840d-9954bc2494b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:44.692583 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de7fbee-0cd2-4578-840d-9954bc2494b7 service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:44.703302 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1171/2346] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:26:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:26:45.253418 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250ac85-2d49-4d61-a91c-e4e061b3467c None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:45.255413 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c250ac85-2d49-4d61-a91c-e4e061b3467c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:45.272058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250ac85-2d49-4d61-a91c-e4e061b3467c None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:45.276954 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb51c7d-2157-4efe-8d8c-bddf04c3e2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:45.277677 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb51c7d-2157-4efe-8d8c-bddf04c3e2d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:45.277964 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb51c7d-2157-4efe-8d8c-bddf04c3e2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:45.278244 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb51c7d-2157-4efe-8d8c-bddf04c3e2d4 admin admin] PATH_INFO: `/v3/projects/aa089d9855414d16a43a3d1c1e340d3e` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:45.287008 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb51c7d-2157-4efe-8d8c-bddf04c3e2d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa089d9855414d16a43a3d1c1e340d3e)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:45.288986 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb51c7d-2157-4efe-8d8c-bddf04c3e2d4 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:45.421211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-9fb51c7d-2157-4efe-8d8c-bddf04c3e2d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa089d9855414d16a43a3d1c1e340d3e', 'request_id': 'req-9fb51c7d-2157-4efe-8d8c-bddf04c3e2d4'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:45.429883 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-9fb51c7d-2157-4efe-8d8c-bddf04c3e2d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa089d9855414d16a43a3d1c1e340d3e', 'request_id': 'req-9fb51c7d-2157-4efe-8d8c-bddf04c3e2d4'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:45.436451 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-9fb51c7d-2157-4efe-8d8c-bddf04c3e2d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa089d9855414d16a43a3d1c1e340d3e', 'request_id': 'req-9fb51c7d-2157-4efe-8d8c-bddf04c3e2d4'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:45.491429 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-9fb51c7d-2157-4efe-8d8c-bddf04c3e2d4 admin admin] The token cache is being invalidate because project aa089d9855414d16a43a3d1c1e340d3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:26:45.491759 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-9fb51c7d-2157-4efe-8d8c-bddf04c3e2d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:45.492389 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-9fb51c7d-2157-4efe-8d8c-bddf04c3e2d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:45.497596 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1176/2347] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:26:45 2022] DELETE /identity/v3/projects/aa089d9855414d16a43a3d1c1e340d3e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:45.500221 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee31a2a-3702-43db-9bdb-153bf2dee660 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:45.500672 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee31a2a-3702-43db-9bdb-153bf2dee660 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:45.500786 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee31a2a-3702-43db-9bdb-153bf2dee660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:45.522896 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-2ee31a2a-3702-43db-9bdb-153bf2dee660 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:45.524169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-2ee31a2a-3702-43db-9bdb-153bf2dee660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:45.606557 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1172/2348] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:45.614746 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee2603-801a-4c51-9826-f0e5db4f54cf None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:45.615103 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee2603-801a-4c51-9826-f0e5db4f54cf None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:45.615462 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee2603-801a-4c51-9826-f0e5db4f54cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:45.637285 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-85ee2603-801a-4c51-9826-f0e5db4f54cf None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:45.638644 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-85ee2603-801a-4c51-9826-f0e5db4f54cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:45.647395 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1177/2349] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:26:45.651520 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee31a2a-3702-43db-9bdb-153bf2dee660 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:45.662810 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee31a2a-3702-43db-9bdb-153bf2dee660 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:45.667570 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527a8ae-f2e4-4aad-a581-d5988f0885f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:45.668216 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527a8ae-f2e4-4aad-a581-d5988f0885f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:45.668500 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527a8ae-f2e4-4aad-a581-d5988f0885f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:45.668775 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527a8ae-f2e4-4aad-a581-d5988f0885f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:45.669469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527a8ae-f2e4-4aad-a581-d5988f0885f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:26:45.669777 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527a8ae-f2e4-4aad-a581-d5988f0885f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:45.671441 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527a8ae-f2e4-4aad-a581-d5988f0885f1 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:45.684128 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1173/2350] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:26:45.688902 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee2603-801a-4c51-9826-f0e5db4f54cf None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:45.699181 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee2603-801a-4c51-9826-f0e5db4f54cf None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:45.704994 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7ec7d-59c0-43d0-9016-0af0032d63c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:45.705635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7ec7d-59c0-43d0-9016-0af0032d63c5 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:45.705915 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7ec7d-59c0-43d0-9016-0af0032d63c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:45.706186 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7ec7d-59c0-43d0-9016-0af0032d63c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:45.707134 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7ec7d-59c0-43d0-9016-0af0032d63c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:45.708712 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7ec7d-59c0-43d0-9016-0af0032d63c5 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:45.802758 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1178/2351] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:26:45 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:26:45.807406 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527a8ae-f2e4-4aad-a581-d5988f0885f1 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:45.822787 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527a8ae-f2e4-4aad-a581-d5988f0885f1 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:45.886183 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:45.902849 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870dcf88-8b50-40b2-9427-b444cd8c1e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:45.903581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dcf88-8b50-40b2-9427-b444cd8c1e4c admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:45.903931 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dcf88-8b50-40b2-9427-b444cd8c1e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:45.904304 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dcf88-8b50-40b2-9427-b444cd8c1e4c admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:45.905031 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870dcf88-8b50-40b2-9427-b444cd8c1e4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:45.907479 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870dcf88-8b50-40b2-9427-b444cd8c1e4c admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:46.032558 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1174/2352] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:26:45 2022] POST /identity/v3/users => generated 292 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:26:46.033798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7ec7d-59c0-43d0-9016-0af0032d63c5 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:46.044079 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7ec7d-59c0-43d0-9016-0af0032d63c5 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:46.049839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a03c85-2600-4cae-afe6-dc9f4135f092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:46.050448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a03c85-2600-4cae-afe6-dc9f4135f092 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:46.050995 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a03c85-2600-4cae-afe6-dc9f4135f092 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:46.051268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a03c85-2600-4cae-afe6-dc9f4135f092 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:46.051915 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a03c85-2600-4cae-afe6-dc9f4135f092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:46.053542 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a03c85-2600-4cae-afe6-dc9f4135f092 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:46.064375 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1179/2353] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:26:46.070105 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870dcf88-8b50-40b2-9427-b444cd8c1e4c admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:46.080304 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870dcf88-8b50-40b2-9427-b444cd8c1e4c admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:46.085312 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a95b5d-e555-4c26-b08e-0061521d3602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:46.085928 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a95b5d-e555-4c26-b08e-0061521d3602 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:46.086211 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a95b5d-e555-4c26-b08e-0061521d3602 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:46.086487 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a95b5d-e555-4c26-b08e-0061521d3602 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:46.087175 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a95b5d-e555-4c26-b08e-0061521d3602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:46.088925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a95b5d-e555-4c26-b08e-0061521d3602 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:46.100608 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1175/2354] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:26:46.104625 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a03c85-2600-4cae-afe6-dc9f4135f092 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:46.116923 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a03c85-2600-4cae-afe6-dc9f4135f092 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:46.122154 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f31851-0478-478f-a6d4-63500f98a571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:46.122772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f31851-0478-478f-a6d4-63500f98a571 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:46.123056 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f31851-0478-478f-a6d4-63500f98a571 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:46.123985 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f31851-0478-478f-a6d4-63500f98a571 admin admin] PATH_INFO: `/v3/projects/630658a2443f48f7b23630bd243ca41e/users/29155bd0c18e4744b27d9d06146ac54a/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:46.141644 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f31851-0478-478f-a6d4-63500f98a571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=630658a2443f48f7b23630bd243ca41e, user_id=29155bd0c18e4744b27d9d06146ac54a, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:46.144512 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f31851-0478-478f-a6d4-63500f98a571 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:46.246734 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1180/2355] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:26:46 2022] PUT /identity/v3/projects/630658a2443f48f7b23630bd243ca41e/users/29155bd0c18e4744b27d9d06146ac54a/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:46.251864 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a31d1-bc39-49c2-9993-74e60cdf988b None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:46.252153 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a31d1-bc39-49c2-9993-74e60cdf988b None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:46.252429 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a31d1-bc39-49c2-9993-74e60cdf988b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:46.278547 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-593a31d1-bc39-49c2-9993-74e60cdf988b None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:46.279793 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-593a31d1-bc39-49c2-9993-74e60cdf988b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:46.352928 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1176/2356] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:26:46.370153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f31851-0478-478f-a6d4-63500f98a571 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:46.370153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-59f31851-0478-478f-a6d4-63500f98a571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:46.452475 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:46.456808 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f31851-0478-478f-a6d4-63500f98a571 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:46.461770 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d2dc4-75bc-44a1-b341-95ea3faeb9d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:46.461770 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d2dc4-75bc-44a1-b341-95ea3faeb9d7 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:46.462091 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d2dc4-75bc-44a1-b341-95ea3faeb9d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:46.462306 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d2dc4-75bc-44a1-b341-95ea3faeb9d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:46.473996 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d2dc4-75bc-44a1-b341-95ea3faeb9d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:46.475389 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d2dc4-75bc-44a1-b341-95ea3faeb9d7 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:46.492517 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1181/2357] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:26:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:26:46.760829 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a31d1-bc39-49c2-9993-74e60cdf988b None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:46.762400 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-593a31d1-bc39-49c2-9993-74e60cdf988b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:46.775126 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a31d1-bc39-49c2-9993-74e60cdf988b None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:46.779792 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ca34d-e984-4d0d-9d62-9f06b15d03d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:46.780433 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ca34d-e984-4d0d-9d62-9f06b15d03d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:46.781470 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ca34d-e984-4d0d-9d62-9f06b15d03d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:46.781777 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ca34d-e984-4d0d-9d62-9f06b15d03d6 admin admin] PATH_INFO: `/v3/users/c78d6f1e27a14dba8a9a4c81eb08b384` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:46.782939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ca34d-e984-4d0d-9d62-9f06b15d03d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c78d6f1e27a14dba8a9a4c81eb08b384)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:46.784879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ca34d-e984-4d0d-9d62-9f06b15d03d6 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:46.965108 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-bc6ca34d-e984-4d0d-9d62-9f06b15d03d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c78d6f1e27a14dba8a9a4c81eb08b384'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:46.965801 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-bc6ca34d-e984-4d0d-9d62-9f06b15d03d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c78d6f1e27a14dba8a9a4c81eb08b384'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:46.973481 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-bc6ca34d-e984-4d0d-9d62-9f06b15d03d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c78d6f1e27a14dba8a9a4c81eb08b384'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:46.974125 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-bc6ca34d-e984-4d0d-9d62-9f06b15d03d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c78d6f1e27a14dba8a9a4c81eb08b384'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:46.986593 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-bc6ca34d-e984-4d0d-9d62-9f06b15d03d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c78d6f1e27a14dba8a9a4c81eb08b384'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:47.057704 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1177/2358] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:26:46 2022] DELETE /identity/v3/users/c78d6f1e27a14dba8a9a4c81eb08b384 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:47.298764 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d2dc4-75bc-44a1-b341-95ea3faeb9d7 service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:47.305926 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d2dc4-75bc-44a1-b341-95ea3faeb9d7 service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:47.363523 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215e54a-2c61-4fc0-a0f5-fabff7398c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:47.364250 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215e54a-2c61-4fc0-a0f5-fabff7398c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:47.366058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215e54a-2c61-4fc0-a0f5-fabff7398c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:47.366058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215e54a-2c61-4fc0-a0f5-fabff7398c21 admin admin] PATH_INFO: `/v3/projects/228a5833a3f04415bb01d5a50dfcef89` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:47.366058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215e54a-2c61-4fc0-a0f5-fabff7398c21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=228a5833a3f04415bb01d5a50dfcef89)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:47.368128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215e54a-2c61-4fc0-a0f5-fabff7398c21 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:47.462719 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6215e54a-2c61-4fc0-a0f5-fabff7398c21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '228a5833a3f04415bb01d5a50dfcef89', 'request_id': 'req-6215e54a-2c61-4fc0-a0f5-fabff7398c21'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:47.468929 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6215e54a-2c61-4fc0-a0f5-fabff7398c21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '228a5833a3f04415bb01d5a50dfcef89', 'request_id': 'req-6215e54a-2c61-4fc0-a0f5-fabff7398c21'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:47.474407 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6215e54a-2c61-4fc0-a0f5-fabff7398c21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '228a5833a3f04415bb01d5a50dfcef89', 'request_id': 'req-6215e54a-2c61-4fc0-a0f5-fabff7398c21'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:47.520015 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6215e54a-2c61-4fc0-a0f5-fabff7398c21 admin admin] The token cache is being invalidate because project 228a5833a3f04415bb01d5a50dfcef89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:26:47.520309 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6215e54a-2c61-4fc0-a0f5-fabff7398c21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:47.520934 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6215e54a-2c61-4fc0-a0f5-fabff7398c21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:26:47.522502 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1182/2359] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:26:47 2022] DELETE /identity/v3/projects/228a5833a3f04415bb01d5a50dfcef89 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:47.527575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d9ccf-017d-4bfb-af18-7cb7727581eb None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:47.527872 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d9ccf-017d-4bfb-af18-7cb7727581eb None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:47.528149 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d9ccf-017d-4bfb-af18-7cb7727581eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:47.548130 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-f42d9ccf-017d-4bfb-af18-7cb7727581eb None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:47.549284 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-f42d9ccf-017d-4bfb-af18-7cb7727581eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:47.587467 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:47.613202 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1178/2360] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:47.621124 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e5839-2d34-4761-adc7-26778c127c80 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:47.621579 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e5839-2d34-4761-adc7-26778c127c80 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:47.622077 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e5839-2d34-4761-adc7-26778c127c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:47.642874 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-f73e5839-2d34-4761-adc7-26778c127c80 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:47.644100 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-f73e5839-2d34-4761-adc7-26778c127c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:47.652060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1183/2361] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:47.657422 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d9ccf-017d-4bfb-af18-7cb7727581eb None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:47.667279 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d9ccf-017d-4bfb-af18-7cb7727581eb None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:47.672644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737466c-c9e1-4c30-baed-705fd032600c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:47.673287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737466c-c9e1-4c30-baed-705fd032600c admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:47.673573 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737466c-c9e1-4c30-baed-705fd032600c admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:47.673846 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737466c-c9e1-4c30-baed-705fd032600c admin admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:47.674509 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e737466c-c9e1-4c30-baed-705fd032600c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:26:47.674817 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e737466c-c9e1-4c30-baed-705fd032600c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:47.676691 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e737466c-c9e1-4c30-baed-705fd032600c admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:47.689489 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1179/2362] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:26:47.695797 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e5839-2d34-4761-adc7-26778c127c80 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:47.704261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e5839-2d34-4761-adc7-26778c127c80 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:47.709334 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4dc57-bbf2-4b55-92eb-1ea57a4ef746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:47.710039 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4dc57-bbf2-4b55-92eb-1ea57a4ef746 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:47.710385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4dc57-bbf2-4b55-92eb-1ea57a4ef746 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:47.710722 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4dc57-bbf2-4b55-92eb-1ea57a4ef746 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:47.711530 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf4dc57-bbf2-4b55-92eb-1ea57a4ef746 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:47.713682 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf4dc57-bbf2-4b55-92eb-1ea57a4ef746 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:47.807116 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1184/2363] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:26:47 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:26:47.808650 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737466c-c9e1-4c30-baed-705fd032600c admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:47.821055 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737466c-c9e1-4c30-baed-705fd032600c admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:47.880681 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cace633-d3f3-40f6-a41d-58c248bc54af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:47.881324 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cace633-d3f3-40f6-a41d-58c248bc54af admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:47.881605 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cace633-d3f3-40f6-a41d-58c248bc54af admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:47.881878 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cace633-d3f3-40f6-a41d-58c248bc54af admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:47.882508 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cace633-d3f3-40f6-a41d-58c248bc54af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:47.884507 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cace633-d3f3-40f6-a41d-58c248bc54af admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:48.003363 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1180/2364] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:26:47 2022] POST /identity/v3/users => generated 283 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:26:48.004628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4dc57-bbf2-4b55-92eb-1ea57a4ef746 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:48.015464 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4dc57-bbf2-4b55-92eb-1ea57a4ef746 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:48.020137 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc57d5d-70bd-4134-8387-f5e9fcb5ad20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:48.020812 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc57d5d-70bd-4134-8387-f5e9fcb5ad20 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:48.021328 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc57d5d-70bd-4134-8387-f5e9fcb5ad20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:48.021770 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc57d5d-70bd-4134-8387-f5e9fcb5ad20 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:48.022410 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc57d5d-70bd-4134-8387-f5e9fcb5ad20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:48.024100 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc57d5d-70bd-4134-8387-f5e9fcb5ad20 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:48.035219 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1185/2365] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:26:48.039344 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cace633-d3f3-40f6-a41d-58c248bc54af admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:48.050724 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cace633-d3f3-40f6-a41d-58c248bc54af admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:48.056022 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f157870-7543-431e-a65e-12deb6deef1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:48.056631 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f157870-7543-431e-a65e-12deb6deef1a admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:48.063374 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f157870-7543-431e-a65e-12deb6deef1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:48.063374 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f157870-7543-431e-a65e-12deb6deef1a admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:48.063374 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f157870-7543-431e-a65e-12deb6deef1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:48.063374 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f157870-7543-431e-a65e-12deb6deef1a admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:48.071448 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1181/2366] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:26:48.075954 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc57d5d-70bd-4134-8387-f5e9fcb5ad20 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:48.086851 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc57d5d-70bd-4134-8387-f5e9fcb5ad20 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:48.091440 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82b94d-f444-45ef-ba5f-d8ef3606d2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:48.092098 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82b94d-f444-45ef-ba5f-d8ef3606d2af admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:48.094920 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82b94d-f444-45ef-ba5f-d8ef3606d2af admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:48.094920 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82b94d-f444-45ef-ba5f-d8ef3606d2af admin admin] PATH_INFO: `/v3/projects/a045c9b6c54e4a4893cfde9f0e54f642/users/32ea839495bc462da390f8fe2871a016/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:48.108138 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82b94d-f444-45ef-ba5f-d8ef3606d2af admin admin] RBAC: Authorizing `identity:create_grant(project_id=a045c9b6c54e4a4893cfde9f0e54f642, user_id=32ea839495bc462da390f8fe2871a016, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:48.110916 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82b94d-f444-45ef-ba5f-d8ef3606d2af admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:48.221496 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1186/2367] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:26:48 2022] PUT /identity/v3/projects/a045c9b6c54e4a4893cfde9f0e54f642/users/32ea839495bc462da390f8fe2871a016/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:48.231504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abd1c3-515e-48a4-a6e8-8c51b5d37a9c None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:48.231874 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abd1c3-515e-48a4-a6e8-8c51b5d37a9c None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:48.232157 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abd1c3-515e-48a4-a6e8-8c51b5d37a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:48.261162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-62abd1c3-515e-48a4-a6e8-8c51b5d37a9c None None] MFA Rules not processed for user `32ea839495bc462da390f8fe2871a016`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:48.262442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-62abd1c3-515e-48a4-a6e8-8c51b5d37a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:48.332641 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1182/2368] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:48.344260 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82b94d-f444-45ef-ba5f-d8ef3606d2af admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:48.346125 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-8d82b94d-f444-45ef-ba5f-d8ef3606d2af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:48.367113 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:48.416280 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82b94d-f444-45ef-ba5f-d8ef3606d2af admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:48.420529 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee74ef-5ad6-4704-9e14-7a674b0627bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:48.421344 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee74ef-5ad6-4704-9e14-7a674b0627bd service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:48.421630 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee74ef-5ad6-4704-9e14-7a674b0627bd service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:48.421902 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee74ef-5ad6-4704-9e14-7a674b0627bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:48.431394 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee74ef-5ad6-4704-9e14-7a674b0627bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:48.433772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee74ef-5ad6-4704-9e14-7a674b0627bd service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:48.446373 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1187/2369] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:26:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:26:51.706230 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990f27a-6884-465f-a1db-c8dc66c5f0c8 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:51.707666 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990f27a-6884-465f-a1db-c8dc66c5f0c8 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:51.707976 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990f27a-6884-465f-a1db-c8dc66c5f0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:51.741802 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-f990f27a-6884-465f-a1db-c8dc66c5f0c8 None None] MFA Rules not processed for user `29155bd0c18e4744b27d9d06146ac54a`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:51.743082 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-f990f27a-6884-465f-a1db-c8dc66c5f0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:51.771492 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:51.815452 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1183/2370] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:51.820316 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee74ef-5ad6-4704-9e14-7a674b0627bd service cinder] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:51.822011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-9bee74ef-5ad6-4704-9e14-7a674b0627bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:51.895143 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee74ef-5ad6-4704-9e14-7a674b0627bd service cinder] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:51.900098 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4afcf-e781-4bae-9b8a-331a43865112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:51.900727 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4afcf-e781-4bae-9b8a-331a43865112 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:51.901025 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4afcf-e781-4bae-9b8a-331a43865112 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:51.901336 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4afcf-e781-4bae-9b8a-331a43865112 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:51.901982 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4afcf-e781-4bae-9b8a-331a43865112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:51.903974 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4afcf-e781-4bae-9b8a-331a43865112 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:52.035120 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1188/2371] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:26:51 2022] POST /identity/v3/projects => generated 385 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:26:52.036237 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990f27a-6884-465f-a1db-c8dc66c5f0c8 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:52.048084 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990f27a-6884-465f-a1db-c8dc66c5f0c8 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:52.105912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f539e4-b863-4d68-9e76-c3090b3bb745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:52.106585 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f539e4-b863-4d68-9e76-c3090b3bb745 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:52.106866 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f539e4-b863-4d68-9e76-c3090b3bb745 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:52.107138 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f539e4-b863-4d68-9e76-c3090b3bb745 admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:52.107827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f539e4-b863-4d68-9e76-c3090b3bb745 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:52.110373 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f539e4-b863-4d68-9e76-c3090b3bb745 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:52.225878 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1184/2372] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:26:52 2022] POST /identity/v3/users => generated 299 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:26:52.230129 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4afcf-e781-4bae-9b8a-331a43865112 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:52.243171 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4afcf-e781-4bae-9b8a-331a43865112 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:52.247764 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcbc30-dba4-4779-934b-ad0e8d662136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:52.248395 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcbc30-dba4-4779-934b-ad0e8d662136 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:52.248676 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcbc30-dba4-4779-934b-ad0e8d662136 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:52.248975 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcbc30-dba4-4779-934b-ad0e8d662136 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:52.249802 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcbc30-dba4-4779-934b-ad0e8d662136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:52.251501 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcbc30-dba4-4779-934b-ad0e8d662136 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:52.262339 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1189/2373] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:26:52.266912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f539e4-b863-4d68-9e76-c3090b3bb745 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:52.279679 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f539e4-b863-4d68-9e76-c3090b3bb745 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:52.285010 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5d383-5e1a-4b01-a611-0055b7239ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:52.285716 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5d383-5e1a-4b01-a611-0055b7239ab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:52.286024 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5d383-5e1a-4b01-a611-0055b7239ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:52.286322 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5d383-5e1a-4b01-a611-0055b7239ab9 admin admin] PATH_INFO: `/v3/projects/000a0a469cca49f293233db057fcb4a3/users/f9dcd095f5434d9198cee612b9d751f0/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:52.304614 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5d383-5e1a-4b01-a611-0055b7239ab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=000a0a469cca49f293233db057fcb4a3, user_id=f9dcd095f5434d9198cee612b9d751f0, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:52.307637 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5d383-5e1a-4b01-a611-0055b7239ab9 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:52.410765 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1185/2374] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:26:52 2022] PUT /identity/v3/projects/000a0a469cca49f293233db057fcb4a3/users/f9dcd095f5434d9198cee612b9d751f0/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:52.413694 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcbc30-dba4-4779-934b-ad0e8d662136 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:52.423677 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcbc30-dba4-4779-934b-ad0e8d662136 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:52.506564 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ad8d5-fa31-4719-bea6-536adc79afdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:52.507834 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ad8d5-fa31-4719-bea6-536adc79afdc admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:52.508282 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ad8d5-fa31-4719-bea6-536adc79afdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:52.508562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ad8d5-fa31-4719-bea6-536adc79afdc admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:52.509261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ad8d5-fa31-4719-bea6-536adc79afdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:52.510903 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ad8d5-fa31-4719-bea6-536adc79afdc admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:52.521629 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1190/2375] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:26:52.526112 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5d383-5e1a-4b01-a611-0055b7239ab9 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:52.538095 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5d383-5e1a-4b01-a611-0055b7239ab9 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:52.544312 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377560f-cc74-4c1d-9bdf-310e9a69d183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:52.544988 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377560f-cc74-4c1d-9bdf-310e9a69d183 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:52.545296 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377560f-cc74-4c1d-9bdf-310e9a69d183 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:52.545574 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377560f-cc74-4c1d-9bdf-310e9a69d183 admin admin] PATH_INFO: `/v3/projects/000a0a469cca49f293233db057fcb4a3/users/f9dcd095f5434d9198cee612b9d751f0/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:52.550102 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377560f-cc74-4c1d-9bdf-310e9a69d183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=000a0a469cca49f293233db057fcb4a3, user_id=f9dcd095f5434d9198cee612b9d751f0, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:52.553253 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377560f-cc74-4c1d-9bdf-310e9a69d183 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:52.569026 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1186/2376] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:26:52 2022] PUT /identity/v3/projects/000a0a469cca49f293233db057fcb4a3/users/f9dcd095f5434d9198cee612b9d751f0/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:26:58.214353 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf7e1c-7561-425e-a329-560cf5352ef2 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:58.214835 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf7e1c-7561-425e-a329-560cf5352ef2 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:58.215657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf7e1c-7561-425e-a329-560cf5352ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:58.240473 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-facf7e1c-7561-425e-a329-560cf5352ef2 None None] MFA Rules not processed for user `34e3236e7dfc447fb287403a386d33da`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:58.242362 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-facf7e1c-7561-425e-a329-560cf5352ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:58.278989 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:58.316771 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1191/2377] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:58.762944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6ff38-fb57-43dd-a662-a15beca10834 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:58.764332 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6ff38-fb57-43dd-a662-a15beca10834 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:58.765172 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6ff38-fb57-43dd-a662-a15beca10834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:58.828778 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-88d6ff38-fb57-43dd-a662-a15beca10834 None None] MFA Rules not processed for user `f9dcd095f5434d9198cee612b9d751f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:58.830403 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-88d6ff38-fb57-43dd-a662-a15beca10834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:58.966288 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1187/2378] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:26:58 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:58.987075 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf7e1c-7561-425e-a329-560cf5352ef2 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:58.989856 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-facf7e1c-7561-425e-a329-560cf5352ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:59.061008 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf7e1c-7561-425e-a329-560cf5352ef2 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:59.071926 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed7924-2c60-4173-8883-25513290251e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '020af86302e447a6b3973df4abbabafa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:59.074950 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed7924-2c60-4173-8883-25513290251e service glance] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:59.075417 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed7924-2c60-4173-8883-25513290251e service glance] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:59.075838 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed7924-2c60-4173-8883-25513290251e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:59.164405 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed7924-2c60-4173-8883-25513290251e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:59.166286 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed7924-2c60-4173-8883-25513290251e service glance] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:59.181464 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1192/2379] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:26:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:26:59.560356 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4697d4-2e0e-494b-ba96-970346954cc0 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:59.560650 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4697d4-2e0e-494b-ba96-970346954cc0 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:59.560934 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4697d4-2e0e-494b-ba96-970346954cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:59.575526 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:26:59.587514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-cb4697d4-2e0e-494b-ba96-970346954cc0 None None] MFA Rules not processed for user `826b9a7c343b4dbc9aeb3dbc0b75fc92`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:26:59.588756 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-cb4697d4-2e0e-494b-ba96-970346954cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:59.688296 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1188/2380] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 23 04:26:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:26:59.700996 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed7924-2c60-4173-8883-25513290251e service glance] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:26:59.702530 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-f8ed7924-2c60-4173-8883-25513290251e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:26:59.792172 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed7924-2c60-4173-8883-25513290251e service glance] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:26:59.797635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb36f31-7b12-4068-916a-cc72d40f3b32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63190c62bc92403880ffaedc4737485a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:26:59.798506 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb36f31-7b12-4068-916a-cc72d40f3b32 service swift] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:26:59.798786 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb36f31-7b12-4068-916a-cc72d40f3b32 service swift] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:26:59.799060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb36f31-7b12-4068-916a-cc72d40f3b32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:26:59.819693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb36f31-7b12-4068-916a-cc72d40f3b32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:26:59.821622 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb36f31-7b12-4068-916a-cc72d40f3b32 service swift] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:26:59.839779 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1193/2381] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 23 04:26:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 04:27:09.830502 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=91 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:27:10.920196 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=24 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:27:11.536661 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4d4d7-4c97-4b6c-8b43-e4ffabaa28d2 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:11.536948 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4d4d7-4c97-4b6c-8b43-e4ffabaa28d2 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:11.537253 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4d4d7-4c97-4b6c-8b43-e4ffabaa28d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:11.557434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-8af4d4d7-4c97-4b6c-8b43-e4ffabaa28d2 None None] MFA Rules not processed for user `29155bd0c18e4744b27d9d06146ac54a`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:27:11.559129 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-8af4d4d7-4c97-4b6c-8b43-e4ffabaa28d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:27:11.566313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1189/2382] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:27:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:27:15.125038 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b0cf2-aa77-4411-b2f9-6086ca576193 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:15.125898 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b0cf2-aa77-4411-b2f9-6086ca576193 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:15.126401 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b0cf2-aa77-4411-b2f9-6086ca576193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:15.147043 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-c73b0cf2-aa77-4411-b2f9-6086ca576193 None None] MFA Rules not processed for user `826b9a7c343b4dbc9aeb3dbc0b75fc92`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:27:15.148263 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c73b0cf2-aa77-4411-b2f9-6086ca576193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:27:15.156758 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1194/2383] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 23 04:27:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:27:15.170141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4d4d7-4c97-4b6c-8b43-e4ffabaa28d2 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:27:15.182727 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4d4d7-4c97-4b6c-8b43-e4ffabaa28d2 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:27:15.187839 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c286e-dafd-453a-a89c-74300ec38370 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63190c62bc92403880ffaedc4737485a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:27:15.188489 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c286e-dafd-453a-a89c-74300ec38370 service swift] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:15.188947 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c286e-dafd-453a-a89c-74300ec38370 service swift] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:15.189106 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c286e-dafd-453a-a89c-74300ec38370 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:15.198037 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c286e-dafd-453a-a89c-74300ec38370 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:27:15.199744 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c286e-dafd-453a-a89c-74300ec38370 service swift] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:27:15.216064 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1190/2384] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 23 04:27:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 04:27:25.140834 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:27:25.205493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=9 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:27:26.250306 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b0cf2-aa77-4411-b2f9-6086ca576193 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:27:26.325650 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b0cf2-aa77-4411-b2f9-6086ca576193 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:27:26.330199 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42ef41-9f53-498c-aa96-051c71a16768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:27:26.330879 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42ef41-9f53-498c-aa96-051c71a16768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:26.331166 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42ef41-9f53-498c-aa96-051c71a16768 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:26.331443 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42ef41-9f53-498c-aa96-051c71a16768 admin admin] PATH_INFO: `/v3/users/32ea839495bc462da390f8fe2871a016` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:26.332584 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42ef41-9f53-498c-aa96-051c71a16768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32ea839495bc462da390f8fe2871a016)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:27:26.334562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42ef41-9f53-498c-aa96-051c71a16768 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:27:26.488709 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-8a42ef41-9f53-498c-aa96-051c71a16768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32ea839495bc462da390f8fe2871a016'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:27:26.537475 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-8a42ef41-9f53-498c-aa96-051c71a16768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32ea839495bc462da390f8fe2871a016'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:27:26.547171 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-8a42ef41-9f53-498c-aa96-051c71a16768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32ea839495bc462da390f8fe2871a016'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:27:26.565147 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-8a42ef41-9f53-498c-aa96-051c71a16768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32ea839495bc462da390f8fe2871a016'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:27:26.566930 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-8a42ef41-9f53-498c-aa96-051c71a16768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32ea839495bc462da390f8fe2871a016'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:27:26.580359 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1195/2385] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:27:26 2022] DELETE /identity/v3/users/32ea839495bc462da390f8fe2871a016 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:27:26.582635 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d4e18-edbe-4c3b-9e41-88221ad1c096 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:26.583130 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d4e18-edbe-4c3b-9e41-88221ad1c096 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:26.583236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d4e18-edbe-4c3b-9e41-88221ad1c096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:26.604555 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-ce2d4e18-edbe-4c3b-9e41-88221ad1c096 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:27:26.605595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-ce2d4e18-edbe-4c3b-9e41-88221ad1c096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:27:26.672261 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1191/2386] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:27:26.683744 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42ef41-9f53-498c-aa96-051c71a16768 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:27:26.686068 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-8a42ef41-9f53-498c-aa96-051c71a16768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:27:26.753511 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42ef41-9f53-498c-aa96-051c71a16768 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:27:26.757205 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836fb1a0-9312-4ef5-9f8c-2a98782fb191 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:27:26.757825 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fb1a0-9312-4ef5-9f8c-2a98782fb191 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:26.758111 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fb1a0-9312-4ef5-9f8c-2a98782fb191 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:26.758391 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fb1a0-9312-4ef5-9f8c-2a98782fb191 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:26.769059 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836fb1a0-9312-4ef5-9f8c-2a98782fb191 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:27:26.771506 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836fb1a0-9312-4ef5-9f8c-2a98782fb191 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:27:26.783619 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1196/2387] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:27:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:27:27.205875 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d4e18-edbe-4c3b-9e41-88221ad1c096 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:27:27.207390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-ce2d4e18-edbe-4c3b-9e41-88221ad1c096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:27:27.221357 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d4e18-edbe-4c3b-9e41-88221ad1c096 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:27:27.226799 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771ab4d-bc78-4bca-8f7e-600de7e5545e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:27:27.227478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771ab4d-bc78-4bca-8f7e-600de7e5545e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:27.227735 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771ab4d-bc78-4bca-8f7e-600de7e5545e admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:27.228009 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771ab4d-bc78-4bca-8f7e-600de7e5545e admin admin] PATH_INFO: `/v3/projects/a045c9b6c54e4a4893cfde9f0e54f642` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:27.229182 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2771ab4d-bc78-4bca-8f7e-600de7e5545e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a045c9b6c54e4a4893cfde9f0e54f642)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:27:27.231120 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2771ab4d-bc78-4bca-8f7e-600de7e5545e admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:27:27.354967 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2771ab4d-bc78-4bca-8f7e-600de7e5545e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a045c9b6c54e4a4893cfde9f0e54f642', 'request_id': 'req-2771ab4d-bc78-4bca-8f7e-600de7e5545e'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:27:27.360978 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2771ab4d-bc78-4bca-8f7e-600de7e5545e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a045c9b6c54e4a4893cfde9f0e54f642', 'request_id': 'req-2771ab4d-bc78-4bca-8f7e-600de7e5545e'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:27:27.366619 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2771ab4d-bc78-4bca-8f7e-600de7e5545e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a045c9b6c54e4a4893cfde9f0e54f642', 'request_id': 'req-2771ab4d-bc78-4bca-8f7e-600de7e5545e'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:27:27.416139 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2771ab4d-bc78-4bca-8f7e-600de7e5545e admin admin] The token cache is being invalidate because project a045c9b6c54e4a4893cfde9f0e54f642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:27:27.416426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2771ab4d-bc78-4bca-8f7e-600de7e5545e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:27:27.417036 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2771ab4d-bc78-4bca-8f7e-600de7e5545e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:27:27.418554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1192/2388] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:27:27 2022] DELETE /identity/v3/projects/a045c9b6c54e4a4893cfde9f0e54f642 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:27:27.423594 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3a39b-c866-4079-adab-e66dab3efe16 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:27.424062 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3a39b-c866-4079-adab-e66dab3efe16 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:27.424172 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3a39b-c866-4079-adab-e66dab3efe16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:27.444098 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-5df3a39b-c866-4079-adab-e66dab3efe16 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:27:27.445331 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-5df3a39b-c866-4079-adab-e66dab3efe16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:27:27.462187 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:27:27.504321 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1197/2389] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:27:27.512126 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db9233-edf7-40f0-9845-c64ecee64ec7 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:27.512416 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db9233-edf7-40f0-9845-c64ecee64ec7 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:27.512698 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db9233-edf7-40f0-9845-c64ecee64ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:27.532833 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-28db9233-edf7-40f0-9845-c64ecee64ec7 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:27:27.534067 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-28db9233-edf7-40f0-9845-c64ecee64ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:27:27.542759 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1193/2390] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:27:27.546901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3a39b-c866-4079-adab-e66dab3efe16 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:27:27.557040 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3a39b-c866-4079-adab-e66dab3efe16 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:27:27.561689 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be8539-dd89-428d-863f-e73cf9773eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:27:27.562287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be8539-dd89-428d-863f-e73cf9773eab admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:27.562569 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be8539-dd89-428d-863f-e73cf9773eab admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:27.562845 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be8539-dd89-428d-863f-e73cf9773eab admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:27.563981 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be8539-dd89-428d-863f-e73cf9773eab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:27:27.564315 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be8539-dd89-428d-863f-e73cf9773eab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:27:27.565961 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be8539-dd89-428d-863f-e73cf9773eab admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:27:27.577424 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1198/2391] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:27:27.588987 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db9233-edf7-40f0-9845-c64ecee64ec7 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:27:27.598524 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db9233-edf7-40f0-9845-c64ecee64ec7 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:27:27.603329 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3148a2-4787-4832-b30b-03b3f5bab0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:27:27.603938 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3148a2-4787-4832-b30b-03b3f5bab0cb admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:27.604389 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3148a2-4787-4832-b30b-03b3f5bab0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:27.604683 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3148a2-4787-4832-b30b-03b3f5bab0cb admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:27.605595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3148a2-4787-4832-b30b-03b3f5bab0cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:27:27.607455 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3148a2-4787-4832-b30b-03b3f5bab0cb admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:27:27.702697 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1194/2392] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:27:27 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:27:27.703891 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be8539-dd89-428d-863f-e73cf9773eab admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:27:27.714365 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be8539-dd89-428d-863f-e73cf9773eab admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:27:27.774490 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4433a1-ac1e-4c25-afab-7d96b2d3e77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:27:27.775111 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4433a1-ac1e-4c25-afab-7d96b2d3e77f admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:27.775394 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4433a1-ac1e-4c25-afab-7d96b2d3e77f admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:27.775665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4433a1-ac1e-4c25-afab-7d96b2d3e77f admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:27.776344 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4433a1-ac1e-4c25-afab-7d96b2d3e77f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:27:27.778303 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4433a1-ac1e-4c25-afab-7d96b2d3e77f admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:27:27.868957 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1199/2393] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:27:27 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:27:27.883225 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3148a2-4787-4832-b30b-03b3f5bab0cb admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:27:27.885147 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3148a2-4787-4832-b30b-03b3f5bab0cb admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:27:27.892040 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff101240-610a-4705-9e59-e44ffdbc11ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:27:27.893074 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff101240-610a-4705-9e59-e44ffdbc11ec admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:27.893480 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff101240-610a-4705-9e59-e44ffdbc11ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:27.893856 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff101240-610a-4705-9e59-e44ffdbc11ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:27.894772 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff101240-610a-4705-9e59-e44ffdbc11ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:27:27.896731 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff101240-610a-4705-9e59-e44ffdbc11ec admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:27:27.908272 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1195/2394] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:27:27.912757 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4433a1-ac1e-4c25-afab-7d96b2d3e77f admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:27:27.927616 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4433a1-ac1e-4c25-afab-7d96b2d3e77f admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:27:27.933823 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584596f-666f-439b-ac73-b7f4320cd419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:27:27.934449 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584596f-666f-439b-ac73-b7f4320cd419 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:27.934809 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584596f-666f-439b-ac73-b7f4320cd419 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:27.935006 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584596f-666f-439b-ac73-b7f4320cd419 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:27.935667 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584596f-666f-439b-ac73-b7f4320cd419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:27:27.937398 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584596f-666f-439b-ac73-b7f4320cd419 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:27:27.953271 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1200/2395] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:27:27.954696 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff101240-610a-4705-9e59-e44ffdbc11ec admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:27:27.967231 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff101240-610a-4705-9e59-e44ffdbc11ec admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:27:27.974023 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b371a-b624-4482-8cce-0308c24be0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:27:27.975382 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b371a-b624-4482-8cce-0308c24be0b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:27.975382 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b371a-b624-4482-8cce-0308c24be0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:27.975591 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b371a-b624-4482-8cce-0308c24be0b8 admin admin] PATH_INFO: `/v3/projects/23149b1c330240ab81a1a38694dd8952/users/50c7934ecc604581a1e734173410058c/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:27.991301 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b371a-b624-4482-8cce-0308c24be0b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23149b1c330240ab81a1a38694dd8952, user_id=50c7934ecc604581a1e734173410058c, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:27:27.994119 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b371a-b624-4482-8cce-0308c24be0b8 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:27:28.058419 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1196/2396] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:27:27 2022] PUT /identity/v3/projects/23149b1c330240ab81a1a38694dd8952/users/50c7934ecc604581a1e734173410058c/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:27:28.069791 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a400d52-959f-4a68-b392-a1050b339353 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:28.070230 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a400d52-959f-4a68-b392-a1050b339353 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:28.070573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a400d52-959f-4a68-b392-a1050b339353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:28.101401 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-3a400d52-959f-4a68-b392-a1050b339353 None None] MFA Rules not processed for user `50c7934ecc604581a1e734173410058c`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:27:28.102617 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-3a400d52-959f-4a68-b392-a1050b339353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:27:28.182368 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1201/2397] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:27:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:27:28.193495 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b371a-b624-4482-8cce-0308c24be0b8 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:27:28.195185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-a10b371a-b624-4482-8cce-0308c24be0b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:27:28.217288 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:27:28.253585 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b371a-b624-4482-8cce-0308c24be0b8 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:27:28.257189 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49adb4-17c0-48f3-afa1-205be4502b6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:27:28.257796 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49adb4-17c0-48f3-afa1-205be4502b6d service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:28.258078 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49adb4-17c0-48f3-afa1-205be4502b6d service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:28.258352 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49adb4-17c0-48f3-afa1-205be4502b6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:28.267169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49adb4-17c0-48f3-afa1-205be4502b6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:27:28.268608 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49adb4-17c0-48f3-afa1-205be4502b6d service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:27:28.277404 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1197/2398] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:27:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:27:29.999559 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11efccd-4ebe-46ce-af47-f7bf31c4775d None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:30.000025 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11efccd-4ebe-46ce-af47-f7bf31c4775d None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:30.001464 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11efccd-4ebe-46ce-af47-f7bf31c4775d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:30.019687 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-e11efccd-4ebe-46ce-af47-f7bf31c4775d None None] MFA Rules not processed for user `50c7934ecc604581a1e734173410058c`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:27:30.020906 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-e11efccd-4ebe-46ce-af47-f7bf31c4775d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:27:30.027925 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1202/2399] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:27:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:27:31.856637 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49adb4-17c0-48f3-afa1-205be4502b6d service cinder] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:27:31.858062 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-be49adb4-17c0-48f3-afa1-205be4502b6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:27:31.932763 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49adb4-17c0-48f3-afa1-205be4502b6d service cinder] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:27:31.941808 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8319dde-f6f9-45b4-99ba-00d721273a8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34794124b7234aeb98a15f0c2ae06a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:27:31.942422 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8319dde-f6f9-45b4-99ba-00d721273a8f service placement] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:31.942698 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8319dde-f6f9-45b4-99ba-00d721273a8f service placement] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:31.942967 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8319dde-f6f9-45b4-99ba-00d721273a8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:31.946411 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-c8319dde-f6f9-45b4-99ba-00d721273a8f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:27:31.959317 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8319dde-f6f9-45b4-99ba-00d721273a8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:27:31.960931 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8319dde-f6f9-45b4-99ba-00d721273a8f service placement] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:27:31.970953 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1198/2400] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:27:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:27:40.013613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:27:41.966671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=49 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:27:43.564726 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11efccd-4ebe-46ce-af47-f7bf31c4775d None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:27:43.566276 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-e11efccd-4ebe-46ce-af47-f7bf31c4775d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:27:43.625301 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11efccd-4ebe-46ce-af47-f7bf31c4775d None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:27:43.629582 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35787341-7987-4d37-a21b-b7e40ea4ee3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:27:43.630195 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35787341-7987-4d37-a21b-b7e40ea4ee3f service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:43.630484 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35787341-7987-4d37-a21b-b7e40ea4ee3f service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:43.630760 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35787341-7987-4d37-a21b-b7e40ea4ee3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:43.632650 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-35787341-7987-4d37-a21b-b7e40ea4ee3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:27:43.694977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35787341-7987-4d37-a21b-b7e40ea4ee3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:27:43.696369 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35787341-7987-4d37-a21b-b7e40ea4ee3f service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:27:43.706026 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1203/2401] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:27:43 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:27:49.035277 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81356c2a-15c2-41c4-9d93-4110602fe6d3 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:49.036368 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81356c2a-15c2-41c4-9d93-4110602fe6d3 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:49.036984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81356c2a-15c2-41c4-9d93-4110602fe6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:49.062414 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-81356c2a-15c2-41c4-9d93-4110602fe6d3 None None] MFA Rules not processed for user `826b9a7c343b4dbc9aeb3dbc0b75fc92`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:27:49.063901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-81356c2a-15c2-41c4-9d93-4110602fe6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:27:49.124910 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1199/2402] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 23 04:27:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:27:49.149491 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35787341-7987-4d37-a21b-b7e40ea4ee3f service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:27:49.151124 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-35787341-7987-4d37-a21b-b7e40ea4ee3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:27:49.226210 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35787341-7987-4d37-a21b-b7e40ea4ee3f service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:27:49.231419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6841bd7-34e9-4703-8353-4699e9787511 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63190c62bc92403880ffaedc4737485a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:27:49.232057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6841bd7-34e9-4703-8353-4699e9787511 service swift] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:49.232340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6841bd7-34e9-4703-8353-4699e9787511 service swift] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:49.232613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6841bd7-34e9-4703-8353-4699e9787511 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:49.241653 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6841bd7-34e9-4703-8353-4699e9787511 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:27:49.243251 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6841bd7-34e9-4703-8353-4699e9787511 service swift] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:27:49.251425 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1204/2403] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 23 04:27:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 04:27:50.041546 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70c3cb-9f73-447e-9c0b-2966e9f5cbda None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:50.042007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70c3cb-9f73-447e-9c0b-2966e9f5cbda None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:50.042138 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70c3cb-9f73-447e-9c0b-2966e9f5cbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:50.061537 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-4c70c3cb-9f73-447e-9c0b-2966e9f5cbda None None] MFA Rules not processed for user `826b9a7c343b4dbc9aeb3dbc0b75fc92`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:27:50.062739 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-4c70c3cb-9f73-447e-9c0b-2966e9f5cbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:27:50.070325 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1200/2404] 10.222.0.42 () {58 vars in 967 bytes} [Tue Aug 23 04:27:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:27:50.083491 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6841bd7-34e9-4703-8353-4699e9787511 service swift] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:27:50.094084 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6841bd7-34e9-4703-8353-4699e9787511 service swift] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:27:50.099990 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf70ad3-3dfb-4f50-a5b1-4556e21a770b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63190c62bc92403880ffaedc4737485a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:27:50.100672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf70ad3-3dfb-4f50-a5b1-4556e21a770b service swift] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:50.101011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf70ad3-3dfb-4f50-a5b1-4556e21a770b service swift] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:50.101370 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf70ad3-3dfb-4f50-a5b1-4556e21a770b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:50.110016 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf70ad3-3dfb-4f50-a5b1-4556e21a770b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:27:50.111712 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf70ad3-3dfb-4f50-a5b1-4556e21a770b service swift] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:27:50.120093 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1205/2405] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 23 04:27:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 04:27:50.741011 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea3898-feaa-4ce5-a826-1a2113833720 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:50.741385 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea3898-feaa-4ce5-a826-1a2113833720 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:50.741661 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea3898-feaa-4ce5-a826-1a2113833720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:50.761077 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-22ea3898-feaa-4ce5-a826-1a2113833720 None None] MFA Rules not processed for user `826b9a7c343b4dbc9aeb3dbc0b75fc92`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:27:50.762436 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-22ea3898-feaa-4ce5-a826-1a2113833720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:27:50.770177 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1201/2406] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 23 04:27:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:27:50.782109 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf70ad3-3dfb-4f50-a5b1-4556e21a770b service swift] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:27:50.792606 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf70ad3-3dfb-4f50-a5b1-4556e21a770b service swift] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:27:50.797904 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cbcd8-ceaf-406d-b92d-95b6f8b74fa8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63190c62bc92403880ffaedc4737485a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:27:50.798503 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cbcd8-ceaf-406d-b92d-95b6f8b74fa8 service swift] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:50.798783 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cbcd8-ceaf-406d-b92d-95b6f8b74fa8 service swift] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:50.799057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cbcd8-ceaf-406d-b92d-95b6f8b74fa8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:50.808776 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cbcd8-ceaf-406d-b92d-95b6f8b74fa8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:27:50.810418 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cbcd8-ceaf-406d-b92d-95b6f8b74fa8 service swift] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:27:50.820153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1206/2407] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 23 04:27:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 04:27:51.519315 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de15332-a4f4-4af3-8803-c282ec8a8006 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:51.519794 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de15332-a4f4-4af3-8803-c282ec8a8006 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:51.519888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de15332-a4f4-4af3-8803-c282ec8a8006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:51.539098 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-2de15332-a4f4-4af3-8803-c282ec8a8006 None None] MFA Rules not processed for user `826b9a7c343b4dbc9aeb3dbc0b75fc92`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:27:51.540294 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-2de15332-a4f4-4af3-8803-c282ec8a8006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:27:51.547809 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1202/2408] 10.222.0.42 () {58 vars in 967 bytes} [Tue Aug 23 04:27:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:27:51.560877 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cbcd8-ceaf-406d-b92d-95b6f8b74fa8 service swift] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:27:51.571826 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cbcd8-ceaf-406d-b92d-95b6f8b74fa8 service swift] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:27:51.576831 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cab03-4dd9-4398-a1e5-3348e35e4a2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63190c62bc92403880ffaedc4737485a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:27:51.577472 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cab03-4dd9-4398-a1e5-3348e35e4a2e service swift] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:51.577767 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cab03-4dd9-4398-a1e5-3348e35e4a2e service swift] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:51.578045 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cab03-4dd9-4398-a1e5-3348e35e4a2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:51.587170 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0cab03-4dd9-4398-a1e5-3348e35e4a2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:27:51.588756 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0cab03-4dd9-4398-a1e5-3348e35e4a2e service swift] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:27:51.593585 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=100 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:27:51.597573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1207/2409] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 23 04:27:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 04:27:52.813494 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfd7f6-7276-4ca6-b9b0-f07efac1469a None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:52.814668 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfd7f6-7276-4ca6-b9b0-f07efac1469a None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:52.814967 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfd7f6-7276-4ca6-b9b0-f07efac1469a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:52.847033 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-c6dfd7f6-7276-4ca6-b9b0-f07efac1469a None None] MFA Rules not processed for user `a42dcd2083e7477caeb79bedbcde3643`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:27:52.849443 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-c6dfd7f6-7276-4ca6-b9b0-f07efac1469a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:27:52.921157 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1203/2410] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:27:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:27:54.432603 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cab03-4dd9-4398-a1e5-3348e35e4a2e service swift] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:27:54.495102 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cab03-4dd9-4398-a1e5-3348e35e4a2e service swift] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:27:54.499417 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754a268-5a3d-449e-95c9-645146beef2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:27:54.500040 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754a268-5a3d-449e-95c9-645146beef2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:54.500319 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754a268-5a3d-449e-95c9-645146beef2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:54.500595 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754a268-5a3d-449e-95c9-645146beef2c admin admin] PATH_INFO: `/v3/users/50c7934ecc604581a1e734173410058c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:54.501723 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754a268-5a3d-449e-95c9-645146beef2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=50c7934ecc604581a1e734173410058c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:27:54.503669 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754a268-5a3d-449e-95c9-645146beef2c admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:27:54.650848 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-f754a268-5a3d-449e-95c9-645146beef2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50c7934ecc604581a1e734173410058c'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:27:54.697919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-f754a268-5a3d-449e-95c9-645146beef2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50c7934ecc604581a1e734173410058c'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:27:54.706552 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-f754a268-5a3d-449e-95c9-645146beef2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50c7934ecc604581a1e734173410058c'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:27:54.719915 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-f754a268-5a3d-449e-95c9-645146beef2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50c7934ecc604581a1e734173410058c'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:27:54.720865 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-f754a268-5a3d-449e-95c9-645146beef2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50c7934ecc604581a1e734173410058c'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:27:54.728048 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1208/2411] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:27:54 2022] DELETE /identity/v3/users/50c7934ecc604581a1e734173410058c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:27:54.733035 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e49c9-7776-4b65-94aa-a9c6c7ca8656 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:54.733576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e49c9-7776-4b65-94aa-a9c6c7ca8656 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:54.733695 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e49c9-7776-4b65-94aa-a9c6c7ca8656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:54.753778 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-5c4e49c9-7776-4b65-94aa-a9c6c7ca8656 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:27:54.754919 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-5c4e49c9-7776-4b65-94aa-a9c6c7ca8656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:27:54.818091 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1204/2412] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:27:54.828110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754a268-5a3d-449e-95c9-645146beef2c admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:27:54.829644 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-f754a268-5a3d-449e-95c9-645146beef2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:27:54.890569 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754a268-5a3d-449e-95c9-645146beef2c admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:27:54.894948 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594006f-550e-4736-8e5e-7de59ddfcc20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:27:54.895567 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594006f-550e-4736-8e5e-7de59ddfcc20 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:54.895851 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594006f-550e-4736-8e5e-7de59ddfcc20 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:54.896127 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594006f-550e-4736-8e5e-7de59ddfcc20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:54.906293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594006f-550e-4736-8e5e-7de59ddfcc20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:27:54.907759 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594006f-550e-4736-8e5e-7de59ddfcc20 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:27:54.919001 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1209/2413] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:27:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:27:55.162072 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e49c9-7776-4b65-94aa-a9c6c7ca8656 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:27:55.165252 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-5c4e49c9-7776-4b65-94aa-a9c6c7ca8656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:27:55.179764 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e49c9-7776-4b65-94aa-a9c6c7ca8656 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:27:55.184424 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8a414-d8a2-4f43-b203-a1ebea471a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:27:55.185102 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8a414-d8a2-4f43-b203-a1ebea471a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:27:55.185393 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8a414-d8a2-4f43-b203-a1ebea471a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:27:55.185668 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8a414-d8a2-4f43-b203-a1ebea471a9c admin admin] PATH_INFO: `/v3/projects/23149b1c330240ab81a1a38694dd8952` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:27:55.186878 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8a414-d8a2-4f43-b203-a1ebea471a9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=23149b1c330240ab81a1a38694dd8952)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:27:55.188729 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8a414-d8a2-4f43-b203-a1ebea471a9c admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:27:55.265073 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:27:55.281451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-7ca8a414-d8a2-4f43-b203-a1ebea471a9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23149b1c330240ab81a1a38694dd8952', 'request_id': 'req-7ca8a414-d8a2-4f43-b203-a1ebea471a9c'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:27:55.287546 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-7ca8a414-d8a2-4f43-b203-a1ebea471a9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23149b1c330240ab81a1a38694dd8952', 'request_id': 'req-7ca8a414-d8a2-4f43-b203-a1ebea471a9c'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:27:55.293310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-7ca8a414-d8a2-4f43-b203-a1ebea471a9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23149b1c330240ab81a1a38694dd8952', 'request_id': 'req-7ca8a414-d8a2-4f43-b203-a1ebea471a9c'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:27:55.405872 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-7ca8a414-d8a2-4f43-b203-a1ebea471a9c admin admin] The token cache is being invalidate because project 23149b1c330240ab81a1a38694dd8952 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:27:55.406168 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-7ca8a414-d8a2-4f43-b203-a1ebea471a9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:27:55.406826 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-7ca8a414-d8a2-4f43-b203-a1ebea471a9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:27:55.408385 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1205/2414] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:27:55 2022] DELETE /identity/v3/projects/23149b1c330240ab81a1a38694dd8952 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:28:04.914857 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:28:05.429947 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:28:14.870637 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acd7ed-449c-4ebb-97f6-62412b646c74 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:28:14.871130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acd7ed-449c-4ebb-97f6-62412b646c74 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:28:14.871253 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acd7ed-449c-4ebb-97f6-62412b646c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:28:14.890420 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-70acd7ed-449c-4ebb-97f6-62412b646c74 None None] MFA Rules not processed for user `34e3236e7dfc447fb287403a386d33da`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:28:14.891526 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-70acd7ed-449c-4ebb-97f6-62412b646c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:28:14.946190 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1210/2415] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:28:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:28:24.939000 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=25 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:28:40.951389 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857da48-9f81-4f3a-b63e-9aa6d02aa84e None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:28:40.951914 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857da48-9f81-4f3a-b63e-9aa6d02aa84e None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:28:40.952020 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857da48-9f81-4f3a-b63e-9aa6d02aa84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:28:40.972383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-b857da48-9f81-4f3a-b63e-9aa6d02aa84e None None] MFA Rules not processed for user `0c2e8b2cb29542febfe09e6a33e094b6`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:28:40.974093 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-b857da48-9f81-4f3a-b63e-9aa6d02aa84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:28:41.027760 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1206/2416] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:28:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:28:51.021072 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=25 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:29:05.087458 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acd7ed-449c-4ebb-97f6-62412b646c74 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:05.090676 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-70acd7ed-449c-4ebb-97f6-62412b646c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:29:05.157976 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acd7ed-449c-4ebb-97f6-62412b646c74 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:05.162447 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2e1b3-1343-40b3-b25b-69ddfb3bf206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:05.163082 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2e1b3-1343-40b3-b25b-69ddfb3bf206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:05.163366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2e1b3-1343-40b3-b25b-69ddfb3bf206 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:05.163640 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2e1b3-1343-40b3-b25b-69ddfb3bf206 admin admin] PATH_INFO: `/v3/users/a42dcd2083e7477caeb79bedbcde3643` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:05.164766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2e1b3-1343-40b3-b25b-69ddfb3bf206 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a42dcd2083e7477caeb79bedbcde3643)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:05.167397 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2e1b3-1343-40b3-b25b-69ddfb3bf206 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:05.408494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-74b2e1b3-1343-40b3-b25b-69ddfb3bf206 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a42dcd2083e7477caeb79bedbcde3643'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:29:05.475409 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-74b2e1b3-1343-40b3-b25b-69ddfb3bf206 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a42dcd2083e7477caeb79bedbcde3643'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:29:05.483343 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-74b2e1b3-1343-40b3-b25b-69ddfb3bf206 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a42dcd2083e7477caeb79bedbcde3643'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:29:05.495899 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-74b2e1b3-1343-40b3-b25b-69ddfb3bf206 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a42dcd2083e7477caeb79bedbcde3643'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:29:05.496527 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-74b2e1b3-1343-40b3-b25b-69ddfb3bf206 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a42dcd2083e7477caeb79bedbcde3643'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:29:05.502434 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1211/2417] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:29:05 2022] DELETE /identity/v3/users/a42dcd2083e7477caeb79bedbcde3643 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:29:05.737639 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857da48-9f81-4f3a-b63e-9aa6d02aa84e None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:05.749620 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857da48-9f81-4f3a-b63e-9aa6d02aa84e None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:05.807441 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90bee7-e7f3-4eda-bd1f-51049c61c183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:05.808086 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90bee7-e7f3-4eda-bd1f-51049c61c183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:05.808370 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90bee7-e7f3-4eda-bd1f-51049c61c183 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:05.808646 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90bee7-e7f3-4eda-bd1f-51049c61c183 admin admin] PATH_INFO: `/v3/projects/35752811e3744b2e8ede5cd06648a9cb` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:05.809803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90bee7-e7f3-4eda-bd1f-51049c61c183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35752811e3744b2e8ede5cd06648a9cb)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:05.811747 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90bee7-e7f3-4eda-bd1f-51049c61c183 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:05.960563 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-3c90bee7-e7f3-4eda-bd1f-51049c61c183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35752811e3744b2e8ede5cd06648a9cb', 'request_id': 'req-3c90bee7-e7f3-4eda-bd1f-51049c61c183'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:29:05.967378 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-3c90bee7-e7f3-4eda-bd1f-51049c61c183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35752811e3744b2e8ede5cd06648a9cb', 'request_id': 'req-3c90bee7-e7f3-4eda-bd1f-51049c61c183'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:29:05.972936 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-3c90bee7-e7f3-4eda-bd1f-51049c61c183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35752811e3744b2e8ede5cd06648a9cb', 'request_id': 'req-3c90bee7-e7f3-4eda-bd1f-51049c61c183'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:29:06.058147 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-3c90bee7-e7f3-4eda-bd1f-51049c61c183 admin admin] The token cache is being invalidate because project 35752811e3744b2e8ede5cd06648a9cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:29:06.061554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-3c90bee7-e7f3-4eda-bd1f-51049c61c183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:29:06.061554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-3c90bee7-e7f3-4eda-bd1f-51049c61c183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:29:06.061554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1207/2418] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:29:05 2022] DELETE /identity/v3/projects/35752811e3744b2e8ede5cd06648a9cb => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:29:06.066261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793ed29-9030-4c3e-afb4-04b0d40638a0 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:06.066554 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793ed29-9030-4c3e-afb4-04b0d40638a0 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:06.066829 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793ed29-9030-4c3e-afb4-04b0d40638a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:06.088227 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-9793ed29-9030-4c3e-afb4-04b0d40638a0 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:29:06.090256 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-9793ed29-9030-4c3e-afb4-04b0d40638a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:29:06.148934 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1212/2419] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:29:06.157434 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a7268-d894-4c55-9925-98035cbfe480 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:06.157724 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a7268-d894-4c55-9925-98035cbfe480 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:06.158001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a7268-d894-4c55-9925-98035cbfe480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:06.177912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-0a5a7268-d894-4c55-9925-98035cbfe480 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:29:06.179121 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-0a5a7268-d894-4c55-9925-98035cbfe480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:29:06.187268 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1208/2420] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:29:06.191735 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793ed29-9030-4c3e-afb4-04b0d40638a0 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:06.204612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793ed29-9030-4c3e-afb4-04b0d40638a0 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:06.211618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebade5cf-3e6e-4e1a-9761-fc9cc993852d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:06.212220 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebade5cf-3e6e-4e1a-9761-fc9cc993852d admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:06.212500 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebade5cf-3e6e-4e1a-9761-fc9cc993852d admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:06.213437 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebade5cf-3e6e-4e1a-9761-fc9cc993852d admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:06.214084 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebade5cf-3e6e-4e1a-9761-fc9cc993852d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:29:06.214386 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebade5cf-3e6e-4e1a-9761-fc9cc993852d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:06.215980 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebade5cf-3e6e-4e1a-9761-fc9cc993852d admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:06.227859 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1213/2421] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:29:06.232620 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a7268-d894-4c55-9925-98035cbfe480 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:06.241520 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a7268-d894-4c55-9925-98035cbfe480 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:06.246330 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e51da-a9df-4180-aacd-44d8cda60a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:06.246931 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e51da-a9df-4180-aacd-44d8cda60a09 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:06.247207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e51da-a9df-4180-aacd-44d8cda60a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:06.247474 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e51da-a9df-4180-aacd-44d8cda60a09 admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:06.248114 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e51da-a9df-4180-aacd-44d8cda60a09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:06.250068 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e51da-a9df-4180-aacd-44d8cda60a09 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:06.342627 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1209/2422] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:29:06 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:29:06.346658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebade5cf-3e6e-4e1a-9761-fc9cc993852d admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:06.359084 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebade5cf-3e6e-4e1a-9761-fc9cc993852d admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:06.367930 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:29:06.429010 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9a00c-1f58-47bd-a7be-0d332baa8317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:06.429694 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9a00c-1f58-47bd-a7be-0d332baa8317 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:06.429996 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9a00c-1f58-47bd-a7be-0d332baa8317 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:06.430551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9a00c-1f58-47bd-a7be-0d332baa8317 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:06.431210 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9a00c-1f58-47bd-a7be-0d332baa8317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:06.433213 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9a00c-1f58-47bd-a7be-0d332baa8317 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:06.557292 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1214/2423] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:29:06 2022] POST /identity/v3/users => generated 294 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:29:06.561489 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e51da-a9df-4180-aacd-44d8cda60a09 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:06.572714 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e51da-a9df-4180-aacd-44d8cda60a09 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:06.577630 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e87020-85c3-413e-a1b9-1d9caed2589a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:06.581141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e87020-85c3-413e-a1b9-1d9caed2589a admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:06.581141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e87020-85c3-413e-a1b9-1d9caed2589a admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:06.581141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e87020-85c3-413e-a1b9-1d9caed2589a admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:06.581141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e87020-85c3-413e-a1b9-1d9caed2589a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:06.581141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e87020-85c3-413e-a1b9-1d9caed2589a admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:06.591376 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1210/2424] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:29:06.595564 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9a00c-1f58-47bd-a7be-0d332baa8317 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:06.605704 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9a00c-1f58-47bd-a7be-0d332baa8317 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:06.610500 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d74a5c-e4d4-4781-82e2-7eaa3406ad4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:06.611107 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d74a5c-e4d4-4781-82e2-7eaa3406ad4d admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:06.611393 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d74a5c-e4d4-4781-82e2-7eaa3406ad4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:06.611670 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d74a5c-e4d4-4781-82e2-7eaa3406ad4d admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:06.612321 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d74a5c-e4d4-4781-82e2-7eaa3406ad4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:06.613959 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d74a5c-e4d4-4781-82e2-7eaa3406ad4d admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:06.625290 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1215/2425] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:29:06.629307 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e87020-85c3-413e-a1b9-1d9caed2589a admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:06.640064 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e87020-85c3-413e-a1b9-1d9caed2589a admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:06.644658 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956e590-f8ba-4a49-87c8-f852e665d264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:06.645349 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956e590-f8ba-4a49-87c8-f852e665d264 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:06.645637 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956e590-f8ba-4a49-87c8-f852e665d264 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:06.645917 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956e590-f8ba-4a49-87c8-f852e665d264 admin admin] PATH_INFO: `/v3/projects/ddfc20681bf0452f99cd699c17c4c022/users/6a9a5ca141da4c26989d6a7c702c4acd/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:06.660655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956e590-f8ba-4a49-87c8-f852e665d264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddfc20681bf0452f99cd699c17c4c022, user_id=6a9a5ca141da4c26989d6a7c702c4acd, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:06.663579 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956e590-f8ba-4a49-87c8-f852e665d264 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:06.755679 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1211/2426] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:29:06 2022] PUT /identity/v3/projects/ddfc20681bf0452f99cd699c17c4c022/users/6a9a5ca141da4c26989d6a7c702c4acd/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:29:06.761758 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77ec56-e033-483a-817c-6699d7468384 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:06.762049 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77ec56-e033-483a-817c-6699d7468384 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:06.762323 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77ec56-e033-483a-817c-6699d7468384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:06.782124 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-3d77ec56-e033-483a-817c-6699d7468384 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:29:06.783327 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-3d77ec56-e033-483a-817c-6699d7468384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:29:06.842332 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1216/2427] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:29:06.852174 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956e590-f8ba-4a49-87c8-f852e665d264 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:06.853944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-5956e590-f8ba-4a49-87c8-f852e665d264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:29:06.887272 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:29:06.913065 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956e590-f8ba-4a49-87c8-f852e665d264 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:06.917352 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8c56c-a171-4b67-9126-e18caaa5211b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:06.917960 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8c56c-a171-4b67-9126-e18caaa5211b service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:06.918242 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8c56c-a171-4b67-9126-e18caaa5211b service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:06.918513 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8c56c-a171-4b67-9126-e18caaa5211b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:06.928023 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8c56c-a171-4b67-9126-e18caaa5211b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:06.929558 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8c56c-a171-4b67-9126-e18caaa5211b service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:06.940228 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1212/2428] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:29:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:29:12.426761 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b0662-35cf-4bad-8f2f-d2c408a51a7b None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:12.427619 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b0662-35cf-4bad-8f2f-d2c408a51a7b None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:12.428006 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b0662-35cf-4bad-8f2f-d2c408a51a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:12.469037 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-509b0662-35cf-4bad-8f2f-d2c408a51a7b None None] MFA Rules not processed for user `6a9a5ca141da4c26989d6a7c702c4acd`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:29:12.471312 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-509b0662-35cf-4bad-8f2f-d2c408a51a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:29:12.556787 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1217/2429] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:29:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:29:12.570801 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8c56c-a171-4b67-9126-e18caaa5211b service neutron] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:12.572909 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-47a8c56c-a171-4b67-9126-e18caaa5211b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:29:12.684944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8c56c-a171-4b67-9126-e18caaa5211b service neutron] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:12.692183 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d994ba4-d8c8-48fc-8138-446e5e62f0e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:12.692795 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d994ba4-d8c8-48fc-8138-446e5e62f0e2 service nova] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:12.693112 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d994ba4-d8c8-48fc-8138-446e5e62f0e2 service nova] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:12.693419 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d994ba4-d8c8-48fc-8138-446e5e62f0e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:12.705000 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d994ba4-d8c8-48fc-8138-446e5e62f0e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:12.706810 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d994ba4-d8c8-48fc-8138-446e5e62f0e2 service nova] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:12.717319 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1213/2430] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:29:12 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:29:15.886943 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf543c6-6b36-4596-ab3f-6716e3069fe8 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:15.886943 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf543c6-6b36-4596-ab3f-6716e3069fe8 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:15.886943 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf543c6-6b36-4596-ab3f-6716e3069fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:15.911192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-caf543c6-6b36-4596-ab3f-6716e3069fe8 None None] MFA Rules not processed for user `6a9a5ca141da4c26989d6a7c702c4acd`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:29:15.912422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-caf543c6-6b36-4596-ab3f-6716e3069fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:29:15.921669 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1218/2431] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:29:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:29:21.516078 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0b506-746b-497f-91ff-92a42988ee22 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:21.516716 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0b506-746b-497f-91ff-92a42988ee22 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:21.516831 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0b506-746b-497f-91ff-92a42988ee22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:21.535447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-80a0b506-746b-497f-91ff-92a42988ee22 None None] MFA Rules not processed for user `34e3236e7dfc447fb287403a386d33da`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:29:21.536640 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-80a0b506-746b-497f-91ff-92a42988ee22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:29:21.590626 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1214/2432] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:29:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:29:21.662934 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf543c6-6b36-4596-ab3f-6716e3069fe8 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:21.672615 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf543c6-6b36-4596-ab3f-6716e3069fe8 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:21.676195 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed43fd3-1498-4790-b753-a4ad8c577834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:21.676801 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed43fd3-1498-4790-b753-a4ad8c577834 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:21.677161 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed43fd3-1498-4790-b753-a4ad8c577834 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:21.677498 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed43fd3-1498-4790-b753-a4ad8c577834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:21.679259 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-2ed43fd3-1498-4790-b753-a4ad8c577834 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:29:21.691012 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:29:21.693286 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed43fd3-1498-4790-b753-a4ad8c577834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:21.694717 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed43fd3-1498-4790-b753-a4ad8c577834 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:21.706333 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1219/2433] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:29:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:29:23.066079 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0b506-746b-497f-91ff-92a42988ee22 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:23.078724 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0b506-746b-497f-91ff-92a42988ee22 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:23.083762 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0c866-b9f1-4c3f-975f-1b937739a7fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:23.084514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0c866-b9f1-4c3f-975f-1b937739a7fb service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:23.084801 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0c866-b9f1-4c3f-975f-1b937739a7fb service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:23.085182 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0c866-b9f1-4c3f-975f-1b937739a7fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:23.087162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-83c0c866-b9f1-4c3f-975f-1b937739a7fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:29:23.105482 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0c866-b9f1-4c3f-975f-1b937739a7fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:23.107041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0c866-b9f1-4c3f-975f-1b937739a7fb service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:23.120786 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1215/2434] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:29:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:29:24.325247 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461efd3b-e483-4762-861c-8524721c3296 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:24.325717 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461efd3b-e483-4762-861c-8524721c3296 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:24.325813 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461efd3b-e483-4762-861c-8524721c3296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:24.345454 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-461efd3b-e483-4762-861c-8524721c3296 None None] MFA Rules not processed for user `826b9a7c343b4dbc9aeb3dbc0b75fc92`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:29:24.346648 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-461efd3b-e483-4762-861c-8524721c3296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:29:24.400841 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1220/2435] 10.222.0.42 () {58 vars in 967 bytes} [Tue Aug 23 04:29:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:29:24.542452 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0c866-b9f1-4c3f-975f-1b937739a7fb service neutron] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:24.543891 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-83c0c866-b9f1-4c3f-975f-1b937739a7fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:29:24.598467 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:29:24.618854 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0c866-b9f1-4c3f-975f-1b937739a7fb service neutron] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:24.623923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212513e5-2e5e-4660-a898-2793b84d8470 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63190c62bc92403880ffaedc4737485a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:24.624528 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212513e5-2e5e-4660-a898-2793b84d8470 service swift] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:24.624811 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212513e5-2e5e-4660-a898-2793b84d8470 service swift] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:24.625105 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212513e5-2e5e-4660-a898-2793b84d8470 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:24.632972 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212513e5-2e5e-4660-a898-2793b84d8470 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:24.634642 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212513e5-2e5e-4660-a898-2793b84d8470 service swift] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:24.643109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1216/2436] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 23 04:29:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 04:29:34.393627 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=27 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:29:34.642770 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=11 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:29:34.910722 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461efd3b-e483-4762-861c-8524721c3296 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:34.912604 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-461efd3b-e483-4762-861c-8524721c3296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:29:34.929264 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461efd3b-e483-4762-861c-8524721c3296 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:34.935583 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa7e27-0693-43ad-b4a8-4b66910902e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:34.941020 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa7e27-0693-43ad-b4a8-4b66910902e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:34.941555 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa7e27-0693-43ad-b4a8-4b66910902e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:34.942022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa7e27-0693-43ad-b4a8-4b66910902e2 admin admin] PATH_INFO: `/v3/users/29155bd0c18e4744b27d9d06146ac54a` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:34.944533 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa7e27-0693-43ad-b4a8-4b66910902e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29155bd0c18e4744b27d9d06146ac54a)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:34.947469 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa7e27-0693-43ad-b4a8-4b66910902e2 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:35.146777 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b9fa7e27-0693-43ad-b4a8-4b66910902e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29155bd0c18e4744b27d9d06146ac54a'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:29:35.222791 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b9fa7e27-0693-43ad-b4a8-4b66910902e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29155bd0c18e4744b27d9d06146ac54a'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:29:35.231148 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b9fa7e27-0693-43ad-b4a8-4b66910902e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29155bd0c18e4744b27d9d06146ac54a'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:29:35.247208 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b9fa7e27-0693-43ad-b4a8-4b66910902e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29155bd0c18e4744b27d9d06146ac54a'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:29:35.247878 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b9fa7e27-0693-43ad-b4a8-4b66910902e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29155bd0c18e4744b27d9d06146ac54a'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:29:35.254678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1221/2437] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:29:34 2022] DELETE /identity/v3/users/29155bd0c18e4744b27d9d06146ac54a => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:29:35.523931 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212513e5-2e5e-4660-a898-2793b84d8470 service swift] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:35.543473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212513e5-2e5e-4660-a898-2793b84d8470 service swift] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:35.619179 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb076888-3e1a-4a2c-a992-db5e3a160eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:35.620530 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb076888-3e1a-4a2c-a992-db5e3a160eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:35.620920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb076888-3e1a-4a2c-a992-db5e3a160eee admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:35.621451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb076888-3e1a-4a2c-a992-db5e3a160eee admin admin] PATH_INFO: `/v3/projects/630658a2443f48f7b23630bd243ca41e` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:35.623184 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb076888-3e1a-4a2c-a992-db5e3a160eee admin admin] RBAC: Authorizing `identity:delete_project(project_id=630658a2443f48f7b23630bd243ca41e)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:35.623565 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa7e27-0693-43ad-b4a8-4b66910902e2 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:35.625196 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-b9fa7e27-0693-43ad-b4a8-4b66910902e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:29:35.626337 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb076888-3e1a-4a2c-a992-db5e3a160eee admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:35.688572 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa7e27-0693-43ad-b4a8-4b66910902e2 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:35.693210 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c874ab-9f1e-41b2-ac51-1c47104e1265 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:35.693831 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c874ab-9f1e-41b2-ac51-1c47104e1265 service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:35.694700 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c874ab-9f1e-41b2-ac51-1c47104e1265 service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:35.694700 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c874ab-9f1e-41b2-ac51-1c47104e1265 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:35.696415 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-40c874ab-9f1e-41b2-ac51-1c47104e1265 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:29:35.756304 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-cb076888-3e1a-4a2c-a992-db5e3a160eee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '630658a2443f48f7b23630bd243ca41e', 'request_id': 'req-cb076888-3e1a-4a2c-a992-db5e3a160eee'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:29:35.763037 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-cb076888-3e1a-4a2c-a992-db5e3a160eee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '630658a2443f48f7b23630bd243ca41e', 'request_id': 'req-cb076888-3e1a-4a2c-a992-db5e3a160eee'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:29:35.769963 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-cb076888-3e1a-4a2c-a992-db5e3a160eee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '630658a2443f48f7b23630bd243ca41e', 'request_id': 'req-cb076888-3e1a-4a2c-a992-db5e3a160eee'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:29:35.777928 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c874ab-9f1e-41b2-ac51-1c47104e1265 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:35.779545 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c874ab-9f1e-41b2-ac51-1c47104e1265 service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:35.791154 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1222/2438] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:29:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:29:35.834627 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-cb076888-3e1a-4a2c-a992-db5e3a160eee admin admin] The token cache is being invalidate because project 630658a2443f48f7b23630bd243ca41e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:29:35.834922 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-cb076888-3e1a-4a2c-a992-db5e3a160eee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:29:35.835874 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-cb076888-3e1a-4a2c-a992-db5e3a160eee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:29:35.837431 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1217/2439] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:29:35 2022] DELETE /identity/v3/projects/630658a2443f48f7b23630bd243ca41e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:29:35.841921 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c874ab-9f1e-41b2-ac51-1c47104e1265 service cinder] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:35.843315 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-40c874ab-9f1e-41b2-ac51-1c47104e1265 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:29:35.857926 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c874ab-9f1e-41b2-ac51-1c47104e1265 service cinder] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:35.888725 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:29:35.929967 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79835a-5828-4adf-8db4-6433f9c14546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:35.930815 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79835a-5828-4adf-8db4-6433f9c14546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:35.931399 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79835a-5828-4adf-8db4-6433f9c14546 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:35.931736 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79835a-5828-4adf-8db4-6433f9c14546 admin admin] PATH_INFO: `/v3/users/f9dcd095f5434d9198cee612b9d751f0` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:35.933067 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79835a-5828-4adf-8db4-6433f9c14546 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9dcd095f5434d9198cee612b9d751f0)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:35.935181 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79835a-5828-4adf-8db4-6433f9c14546 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:36.229239 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-1c79835a-5828-4adf-8db4-6433f9c14546 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9dcd095f5434d9198cee612b9d751f0'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:29:36.321371 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-1c79835a-5828-4adf-8db4-6433f9c14546 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9dcd095f5434d9198cee612b9d751f0'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:29:36.329071 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-1c79835a-5828-4adf-8db4-6433f9c14546 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9dcd095f5434d9198cee612b9d751f0'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:29:36.342168 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-1c79835a-5828-4adf-8db4-6433f9c14546 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9dcd095f5434d9198cee612b9d751f0'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:29:36.342846 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-1c79835a-5828-4adf-8db4-6433f9c14546 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9dcd095f5434d9198cee612b9d751f0'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:29:36.348647 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1223/2440] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:29:35 2022] DELETE /identity/v3/users/f9dcd095f5434d9198cee612b9d751f0 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:29:36.591244 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb076888-3e1a-4a2c-a992-db5e3a160eee admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:36.592608 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-cb076888-3e1a-4a2c-a992-db5e3a160eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:29:36.607582 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb076888-3e1a-4a2c-a992-db5e3a160eee admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:36.672753 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6383cbb-8dce-4845-b222-c74cac108212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:36.673450 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6383cbb-8dce-4845-b222-c74cac108212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:36.673737 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6383cbb-8dce-4845-b222-c74cac108212 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:36.674003 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6383cbb-8dce-4845-b222-c74cac108212 admin admin] PATH_INFO: `/v3/projects/000a0a469cca49f293233db057fcb4a3` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:36.675156 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6383cbb-8dce-4845-b222-c74cac108212 admin admin] RBAC: Authorizing `identity:delete_project(project_id=000a0a469cca49f293233db057fcb4a3)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:36.677082 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6383cbb-8dce-4845-b222-c74cac108212 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:36.771175 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:29:36.783318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-f6383cbb-8dce-4845-b222-c74cac108212 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '000a0a469cca49f293233db057fcb4a3', 'request_id': 'req-f6383cbb-8dce-4845-b222-c74cac108212'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:29:36.789516 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-f6383cbb-8dce-4845-b222-c74cac108212 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '000a0a469cca49f293233db057fcb4a3', 'request_id': 'req-f6383cbb-8dce-4845-b222-c74cac108212'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:29:36.795685 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-f6383cbb-8dce-4845-b222-c74cac108212 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '000a0a469cca49f293233db057fcb4a3', 'request_id': 'req-f6383cbb-8dce-4845-b222-c74cac108212'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:29:36.875415 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-f6383cbb-8dce-4845-b222-c74cac108212 admin admin] The token cache is being invalidate because project 000a0a469cca49f293233db057fcb4a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:29:36.875756 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-f6383cbb-8dce-4845-b222-c74cac108212 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:29:36.876332 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-f6383cbb-8dce-4845-b222-c74cac108212 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:29:36.878047 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1218/2441] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:29:36 2022] DELETE /identity/v3/projects/000a0a469cca49f293233db057fcb4a3 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:29:36.884425 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c365d1-d28f-44c0-9921-0046a33dd9c9 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:36.884425 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c365d1-d28f-44c0-9921-0046a33dd9c9 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:36.884425 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c365d1-d28f-44c0-9921-0046a33dd9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:36.904760 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-01c365d1-d28f-44c0-9921-0046a33dd9c9 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:29:36.906055 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-01c365d1-d28f-44c0-9921-0046a33dd9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:29:36.966767 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1224/2442] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:29:36.974627 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761949e-8607-4ab8-8487-fb718af3c231 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:36.974914 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761949e-8607-4ab8-8487-fb718af3c231 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:36.975241 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761949e-8607-4ab8-8487-fb718af3c231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:36.995568 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-f761949e-8607-4ab8-8487-fb718af3c231 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:29:36.996768 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-f761949e-8607-4ab8-8487-fb718af3c231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:29:37.005196 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1219/2443] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:29:37.009697 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c365d1-d28f-44c0-9921-0046a33dd9c9 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:37.020880 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c365d1-d28f-44c0-9921-0046a33dd9c9 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:37.026450 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14c588-948b-4b47-8d29-390b4daae44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:37.027063 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14c588-948b-4b47-8d29-390b4daae44c admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:37.027420 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14c588-948b-4b47-8d29-390b4daae44c admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:37.027740 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14c588-948b-4b47-8d29-390b4daae44c admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:37.028395 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14c588-948b-4b47-8d29-390b4daae44c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:29:37.028701 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14c588-948b-4b47-8d29-390b4daae44c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:37.030414 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14c588-948b-4b47-8d29-390b4daae44c admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:37.045145 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1225/2444] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:29:37.048051 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761949e-8607-4ab8-8487-fb718af3c231 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:37.058169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761949e-8607-4ab8-8487-fb718af3c231 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:37.062920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79fbf1-e204-4a5d-b399-006713f15a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:37.063530 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79fbf1-e204-4a5d-b399-006713f15a70 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:37.063818 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79fbf1-e204-4a5d-b399-006713f15a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:37.064097 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79fbf1-e204-4a5d-b399-006713f15a70 admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:37.064730 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79fbf1-e204-4a5d-b399-006713f15a70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:37.066786 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79fbf1-e204-4a5d-b399-006713f15a70 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:37.180378 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1220/2445] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:29:37 2022] POST /identity/v3/projects => generated 369 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:29:37.184934 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14c588-948b-4b47-8d29-390b4daae44c admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:37.195530 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14c588-948b-4b47-8d29-390b4daae44c admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:37.227098 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:29:37.254415 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e6701-e647-4328-b528-9d86bdd5b08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:37.255028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e6701-e647-4328-b528-9d86bdd5b08c admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:37.255316 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e6701-e647-4328-b528-9d86bdd5b08c admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:37.255633 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e6701-e647-4328-b528-9d86bdd5b08c admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:37.256274 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e6701-e647-4328-b528-9d86bdd5b08c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:37.258402 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e6701-e647-4328-b528-9d86bdd5b08c admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:37.407031 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1226/2446] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:29:37 2022] POST /identity/v3/users => generated 285 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:29:37.411391 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79fbf1-e204-4a5d-b399-006713f15a70 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:37.421944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79fbf1-e204-4a5d-b399-006713f15a70 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:37.426630 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca538ec-f021-4d1c-8824-39d3b29a5d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:37.427243 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca538ec-f021-4d1c-8824-39d3b29a5d76 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:37.427526 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca538ec-f021-4d1c-8824-39d3b29a5d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:37.427797 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca538ec-f021-4d1c-8824-39d3b29a5d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:37.428572 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca538ec-f021-4d1c-8824-39d3b29a5d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:37.430191 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca538ec-f021-4d1c-8824-39d3b29a5d76 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:37.441633 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1221/2447] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:29:37.445850 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e6701-e647-4328-b528-9d86bdd5b08c admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:37.456594 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e6701-e647-4328-b528-9d86bdd5b08c admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:37.461312 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87f733-9778-462b-907b-792d06cf808c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:37.461916 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87f733-9778-462b-907b-792d06cf808c admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:37.462227 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87f733-9778-462b-907b-792d06cf808c admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:37.462506 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87f733-9778-462b-907b-792d06cf808c admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:37.463158 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b87f733-9778-462b-907b-792d06cf808c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:37.464748 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b87f733-9778-462b-907b-792d06cf808c admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:37.474663 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1227/2448] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:29:37.479017 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca538ec-f021-4d1c-8824-39d3b29a5d76 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:37.489200 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca538ec-f021-4d1c-8824-39d3b29a5d76 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:37.493827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef1e05-eb25-4d24-91f8-412a667ed631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:37.495077 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef1e05-eb25-4d24-91f8-412a667ed631 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:37.495356 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef1e05-eb25-4d24-91f8-412a667ed631 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:37.495625 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef1e05-eb25-4d24-91f8-412a667ed631 admin admin] PATH_INFO: `/v3/projects/1980305368b84a3cbde0123e955e826c/users/811fd2d4db864678825214eef1ed467f/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:37.510748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef1e05-eb25-4d24-91f8-412a667ed631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1980305368b84a3cbde0123e955e826c, user_id=811fd2d4db864678825214eef1ed467f, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:37.513590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef1e05-eb25-4d24-91f8-412a667ed631 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:37.584181 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1222/2449] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:29:37 2022] PUT /identity/v3/projects/1980305368b84a3cbde0123e955e826c/users/811fd2d4db864678825214eef1ed467f/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:29:37.589242 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977dc0e4-b42a-419e-b524-d4c2dcbef96f None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:37.589554 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977dc0e4-b42a-419e-b524-d4c2dcbef96f None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:37.589835 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977dc0e4-b42a-419e-b524-d4c2dcbef96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:37.609194 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-977dc0e4-b42a-419e-b524-d4c2dcbef96f None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:29:37.610396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-977dc0e4-b42a-419e-b524-d4c2dcbef96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:29:37.674225 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1228/2450] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:29:37.686298 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef1e05-eb25-4d24-91f8-412a667ed631 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:37.688118 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-78ef1e05-eb25-4d24-91f8-412a667ed631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:29:37.759396 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef1e05-eb25-4d24-91f8-412a667ed631 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:37.763185 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31505f-fd31-48b3-8cc1-f424df3daf03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:37.763808 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31505f-fd31-48b3-8cc1-f424df3daf03 service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:37.764160 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31505f-fd31-48b3-8cc1-f424df3daf03 service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:37.764410 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31505f-fd31-48b3-8cc1-f424df3daf03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:37.773781 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc31505f-fd31-48b3-8cc1-f424df3daf03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:37.777675 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc31505f-fd31-48b3-8cc1-f424df3daf03 service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:37.785275 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1223/2451] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:29:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:29:43.544415 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d113fd-eac8-4f32-8a41-377bac561b94 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:43.544970 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d113fd-eac8-4f32-8a41-377bac561b94 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:43.544970 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d113fd-eac8-4f32-8a41-377bac561b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:43.579109 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-30d113fd-eac8-4f32-8a41-377bac561b94 None None] MFA Rules not processed for user `811fd2d4db864678825214eef1ed467f`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:29:43.580602 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-30d113fd-eac8-4f32-8a41-377bac561b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:29:43.672039 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1229/2452] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:29:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:29:43.675857 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31505f-fd31-48b3-8cc1-f424df3daf03 service neutron] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:43.688320 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31505f-fd31-48b3-8cc1-f424df3daf03 service neutron] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:43.693247 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e450529-0761-4056-94d8-e1eb92cd4ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:43.693861 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e450529-0761-4056-94d8-e1eb92cd4ff2 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:43.694209 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e450529-0761-4056-94d8-e1eb92cd4ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:43.694488 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e450529-0761-4056-94d8-e1eb92cd4ff2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:43.695122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e450529-0761-4056-94d8-e1eb92cd4ff2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:43.697066 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e450529-0761-4056-94d8-e1eb92cd4ff2 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:43.801167 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1224/2453] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:29:43 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:29:43.804753 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d113fd-eac8-4f32-8a41-377bac561b94 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:43.816823 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d113fd-eac8-4f32-8a41-377bac561b94 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:43.873642 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:29:43.894331 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a12e8-3214-432b-a6e6-abe60cfed8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:43.894970 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a12e8-3214-432b-a6e6-abe60cfed8f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:43.895254 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a12e8-3214-432b-a6e6-abe60cfed8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:43.895530 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a12e8-3214-432b-a6e6-abe60cfed8f3 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:43.896194 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a12e8-3214-432b-a6e6-abe60cfed8f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:43.898479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a12e8-3214-432b-a6e6-abe60cfed8f3 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:43.996687 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1230/2454] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:29:43 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:29:44.000760 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e450529-0761-4056-94d8-e1eb92cd4ff2 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:44.019578 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e450529-0761-4056-94d8-e1eb92cd4ff2 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:44.026453 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a39a41-044b-4f9e-b9d7-1cd3cce0fb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:44.027301 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a39a41-044b-4f9e-b9d7-1cd3cce0fb4f admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:44.027805 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a39a41-044b-4f9e-b9d7-1cd3cce0fb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:44.028236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a39a41-044b-4f9e-b9d7-1cd3cce0fb4f admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:44.029054 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a39a41-044b-4f9e-b9d7-1cd3cce0fb4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:44.031092 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a39a41-044b-4f9e-b9d7-1cd3cce0fb4f admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:44.044122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1225/2455] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:29:44.049079 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a12e8-3214-432b-a6e6-abe60cfed8f3 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:44.059987 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a12e8-3214-432b-a6e6-abe60cfed8f3 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:44.065253 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd993c2-712c-474a-98d5-930ba37617fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:44.065931 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd993c2-712c-474a-98d5-930ba37617fb admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:44.066377 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd993c2-712c-474a-98d5-930ba37617fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:44.066869 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd993c2-712c-474a-98d5-930ba37617fb admin admin] PATH_INFO: `/v3/projects/959f33d82f564ad2941181915184bda0/users/a4486054a8ac4aca8430cebcb15d29dd/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:44.082772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd993c2-712c-474a-98d5-930ba37617fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=959f33d82f564ad2941181915184bda0, user_id=a4486054a8ac4aca8430cebcb15d29dd, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:44.085605 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd993c2-712c-474a-98d5-930ba37617fb admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:44.211726 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1231/2456] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:29:44 2022] PUT /identity/v3/projects/959f33d82f564ad2941181915184bda0/users/a4486054a8ac4aca8430cebcb15d29dd/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:29:44.216276 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a39a41-044b-4f9e-b9d7-1cd3cce0fb4f admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:44.226928 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a39a41-044b-4f9e-b9d7-1cd3cce0fb4f admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:44.251791 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:29:44.287139 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5637520-6216-47b8-90e5-ed7415ae2b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:44.287845 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5637520-6216-47b8-90e5-ed7415ae2b4f admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:44.288198 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5637520-6216-47b8-90e5-ed7415ae2b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:44.288577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5637520-6216-47b8-90e5-ed7415ae2b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:44.289351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5637520-6216-47b8-90e5-ed7415ae2b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:44.300886 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5637520-6216-47b8-90e5-ed7415ae2b4f admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:44.307909 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1226/2457] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:29:44.309373 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd993c2-712c-474a-98d5-930ba37617fb admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:44.321945 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd993c2-712c-474a-98d5-930ba37617fb admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:44.337563 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ffb0f-8013-4cba-8e8f-904ae2c420de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:44.338743 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ffb0f-8013-4cba-8e8f-904ae2c420de admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:44.339026 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ffb0f-8013-4cba-8e8f-904ae2c420de admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:44.339304 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ffb0f-8013-4cba-8e8f-904ae2c420de admin admin] PATH_INFO: `/v3/projects/959f33d82f564ad2941181915184bda0/users/a4486054a8ac4aca8430cebcb15d29dd/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:44.341468 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ffb0f-8013-4cba-8e8f-904ae2c420de admin admin] RBAC: Authorizing `identity:create_grant(project_id=959f33d82f564ad2941181915184bda0, user_id=a4486054a8ac4aca8430cebcb15d29dd, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:44.344153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ffb0f-8013-4cba-8e8f-904ae2c420de admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:44.355851 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1232/2458] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:29:44 2022] PUT /identity/v3/projects/959f33d82f564ad2941181915184bda0/users/a4486054a8ac4aca8430cebcb15d29dd/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:29:50.145833 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cac266-1960-4201-bf4d-6f03ba1675da None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:50.146358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cac266-1960-4201-bf4d-6f03ba1675da None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:50.146358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cac266-1960-4201-bf4d-6f03ba1675da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:50.224698 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-d4cac266-1960-4201-bf4d-6f03ba1675da None None] MFA Rules not processed for user `a4486054a8ac4aca8430cebcb15d29dd`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:29:50.225914 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-d4cac266-1960-4201-bf4d-6f03ba1675da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:29:50.316539 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1227/2459] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:29:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:29:50.335920 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ffb0f-8013-4cba-8e8f-904ae2c420de admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:50.337844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-b68ffb0f-8013-4cba-8e8f-904ae2c420de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:29:50.445805 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ffb0f-8013-4cba-8e8f-904ae2c420de admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:50.452943 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589c16e-57ce-4ffb-a679-f5eea37ef7f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:50.453835 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589c16e-57ce-4ffb-a679-f5eea37ef7f0 service nova] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:50.454277 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589c16e-57ce-4ffb-a679-f5eea37ef7f0 service nova] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:50.454734 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589c16e-57ce-4ffb-a679-f5eea37ef7f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:50.520797 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b589c16e-57ce-4ffb-a679-f5eea37ef7f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:50.522619 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b589c16e-57ce-4ffb-a679-f5eea37ef7f0 service nova] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:50.533153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1233/2460] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:29:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:29:53.026634 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152efa98-89a1-4887-a0f1-5eb936111fd3 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:53.027131 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152efa98-89a1-4887-a0f1-5eb936111fd3 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:53.027244 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152efa98-89a1-4887-a0f1-5eb936111fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:53.047783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-152efa98-89a1-4887-a0f1-5eb936111fd3 None None] MFA Rules not processed for user `811fd2d4db864678825214eef1ed467f`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:29:53.048985 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-152efa98-89a1-4887-a0f1-5eb936111fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:29:53.055797 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1228/2461] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:29:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:29:56.158348 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589c16e-57ce-4ffb-a679-f5eea37ef7f0 service nova] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:29:56.159798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-b589c16e-57ce-4ffb-a679-f5eea37ef7f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:29:56.196525 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:29:56.220404 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589c16e-57ce-4ffb-a679-f5eea37ef7f0 service nova] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:29:56.230057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706cba5-ddc5-4ce7-8fe6-f7a1eaa1f7cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:29:56.230981 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706cba5-ddc5-4ce7-8fe6-f7a1eaa1f7cd service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:29:56.231280 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706cba5-ddc5-4ce7-8fe6-f7a1eaa1f7cd service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:29:56.231956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706cba5-ddc5-4ce7-8fe6-f7a1eaa1f7cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:29:56.234361 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-3706cba5-ddc5-4ce7-8fe6-f7a1eaa1f7cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:29:56.299482 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706cba5-ddc5-4ce7-8fe6-f7a1eaa1f7cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:29:56.300959 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706cba5-ddc5-4ce7-8fe6-f7a1eaa1f7cd service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:29:56.312201 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1234/2462] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:29:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:30:00.036183 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152efa98-89a1-4887-a0f1-5eb936111fd3 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:00.038257 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-152efa98-89a1-4887-a0f1-5eb936111fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:00.053367 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152efa98-89a1-4887-a0f1-5eb936111fd3 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:00.058164 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2bfbc-9843-4c00-a56c-9148a40dcfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:00.058794 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2bfbc-9843-4c00-a56c-9148a40dcfb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:00.059071 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2bfbc-9843-4c00-a56c-9148a40dcfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:00.059341 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2bfbc-9843-4c00-a56c-9148a40dcfb9 admin admin] PATH_INFO: `/v3/users/0c2e8b2cb29542febfe09e6a33e094b6` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:00.060452 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2bfbc-9843-4c00-a56c-9148a40dcfb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c2e8b2cb29542febfe09e6a33e094b6)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:00.063080 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2bfbc-9843-4c00-a56c-9148a40dcfb9 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:00.242943 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-79a2bfbc-9843-4c00-a56c-9148a40dcfb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c2e8b2cb29542febfe09e6a33e094b6'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:00.243623 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-79a2bfbc-9843-4c00-a56c-9148a40dcfb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c2e8b2cb29542febfe09e6a33e094b6'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:00.251160 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-79a2bfbc-9843-4c00-a56c-9148a40dcfb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c2e8b2cb29542febfe09e6a33e094b6'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:00.251789 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-79a2bfbc-9843-4c00-a56c-9148a40dcfb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c2e8b2cb29542febfe09e6a33e094b6'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:00.264568 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-79a2bfbc-9843-4c00-a56c-9148a40dcfb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c2e8b2cb29542febfe09e6a33e094b6'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:00.325509 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1229/2463] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:30:00 2022] DELETE /identity/v3/users/0c2e8b2cb29542febfe09e6a33e094b6 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:00.609562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706cba5-ddc5-4ce7-8fe6-f7a1eaa1f7cd service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:00.625772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706cba5-ddc5-4ce7-8fe6-f7a1eaa1f7cd service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:00.687822 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98c9b5-4dcf-4cda-a208-94f8676ad465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:00.688468 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98c9b5-4dcf-4cda-a208-94f8676ad465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:00.688748 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98c9b5-4dcf-4cda-a208-94f8676ad465 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:00.689020 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98c9b5-4dcf-4cda-a208-94f8676ad465 admin admin] PATH_INFO: `/v3/projects/8f8d93bde8ca491994ecae7eb1506ff1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:00.690183 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98c9b5-4dcf-4cda-a208-94f8676ad465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f8d93bde8ca491994ecae7eb1506ff1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:00.692123 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98c9b5-4dcf-4cda-a208-94f8676ad465 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:00.790556 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-9b98c9b5-4dcf-4cda-a208-94f8676ad465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f8d93bde8ca491994ecae7eb1506ff1', 'request_id': 'req-9b98c9b5-4dcf-4cda-a208-94f8676ad465'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:00.796755 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-9b98c9b5-4dcf-4cda-a208-94f8676ad465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f8d93bde8ca491994ecae7eb1506ff1', 'request_id': 'req-9b98c9b5-4dcf-4cda-a208-94f8676ad465'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:00.802785 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-9b98c9b5-4dcf-4cda-a208-94f8676ad465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f8d93bde8ca491994ecae7eb1506ff1', 'request_id': 'req-9b98c9b5-4dcf-4cda-a208-94f8676ad465'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:00.879302 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-9b98c9b5-4dcf-4cda-a208-94f8676ad465 admin admin] The token cache is being invalidate because project 8f8d93bde8ca491994ecae7eb1506ff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:30:00.879518 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-9b98c9b5-4dcf-4cda-a208-94f8676ad465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:00.880111 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-9b98c9b5-4dcf-4cda-a208-94f8676ad465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:00.881633 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1235/2464] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:30:00 2022] DELETE /identity/v3/projects/8f8d93bde8ca491994ecae7eb1506ff1 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:00.886582 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5d6e8-05af-4b4b-9146-de9195f1306f None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:00.886876 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5d6e8-05af-4b4b-9146-de9195f1306f None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:00.887155 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5d6e8-05af-4b4b-9146-de9195f1306f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:00.908264 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-6de5d6e8-05af-4b4b-9146-de9195f1306f None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:00.909530 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-6de5d6e8-05af-4b4b-9146-de9195f1306f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:00.918326 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:00.975613 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1230/2465] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:00.983483 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08772c0a-b304-474d-b340-3ce3a64c3bce None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:00.983764 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08772c0a-b304-474d-b340-3ce3a64c3bce None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:00.984039 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08772c0a-b304-474d-b340-3ce3a64c3bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:01.003522 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-08772c0a-b304-474d-b340-3ce3a64c3bce None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:01.004763 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-08772c0a-b304-474d-b340-3ce3a64c3bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:01.013125 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1236/2466] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:01.018090 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5d6e8-05af-4b4b-9146-de9195f1306f None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:01.027885 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5d6e8-05af-4b4b-9146-de9195f1306f None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:01.033523 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca7a39-02d9-4214-8e35-4636c60e1f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:01.034138 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca7a39-02d9-4214-8e35-4636c60e1f46 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:01.034518 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca7a39-02d9-4214-8e35-4636c60e1f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:01.034702 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca7a39-02d9-4214-8e35-4636c60e1f46 admin admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:01.035358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca7a39-02d9-4214-8e35-4636c60e1f46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:30:01.035665 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca7a39-02d9-4214-8e35-4636c60e1f46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:01.037347 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca7a39-02d9-4214-8e35-4636c60e1f46 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:01.048749 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1231/2467] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:30:01.053102 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08772c0a-b304-474d-b340-3ce3a64c3bce None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:01.059095 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:01.062991 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08772c0a-b304-474d-b340-3ce3a64c3bce None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:01.069139 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaaf711-5ef4-4d4e-a5ff-6d87d33e9ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:01.069502 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaf711-5ef4-4d4e-a5ff-6d87d33e9ecd admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:01.069869 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaf711-5ef4-4d4e-a5ff-6d87d33e9ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:01.071798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaf711-5ef4-4d4e-a5ff-6d87d33e9ecd admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:01.071798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaaf711-5ef4-4d4e-a5ff-6d87d33e9ecd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:01.073180 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaaf711-5ef4-4d4e-a5ff-6d87d33e9ecd admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:01.164537 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1237/2468] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:30:01 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:30:01.165905 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca7a39-02d9-4214-8e35-4636c60e1f46 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:01.175981 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca7a39-02d9-4214-8e35-4636c60e1f46 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:01.237667 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd6bcb-f953-4789-b512-550e05eef427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:01.238340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd6bcb-f953-4789-b512-550e05eef427 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:01.238620 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd6bcb-f953-4789-b512-550e05eef427 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:01.238903 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd6bcb-f953-4789-b512-550e05eef427 admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:01.239533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd6bcb-f953-4789-b512-550e05eef427 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:01.241507 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd6bcb-f953-4789-b512-550e05eef427 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:01.344742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1232/2469] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:30:01 2022] POST /identity/v3/users => generated 283 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:30:01.348862 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaaf711-5ef4-4d4e-a5ff-6d87d33e9ecd admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:01.359110 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaaf711-5ef4-4d4e-a5ff-6d87d33e9ecd admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:01.363739 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c15c1e-ceb1-4a4a-9d56-5995e36d32cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:01.364359 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c15c1e-ceb1-4a4a-9d56-5995e36d32cd admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:01.364673 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c15c1e-ceb1-4a4a-9d56-5995e36d32cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:01.364949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c15c1e-ceb1-4a4a-9d56-5995e36d32cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:01.365635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c15c1e-ceb1-4a4a-9d56-5995e36d32cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:01.367287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c15c1e-ceb1-4a4a-9d56-5995e36d32cd admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:01.378555 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1238/2470] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:30:01.382642 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd6bcb-f953-4789-b512-550e05eef427 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:01.393397 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd6bcb-f953-4789-b512-550e05eef427 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:01.398040 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f124a08-a182-456d-a2d7-d5b896868adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:01.398694 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f124a08-a182-456d-a2d7-d5b896868adf admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:01.398922 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f124a08-a182-456d-a2d7-d5b896868adf admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:01.399197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f124a08-a182-456d-a2d7-d5b896868adf admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:01.399898 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f124a08-a182-456d-a2d7-d5b896868adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:01.401520 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f124a08-a182-456d-a2d7-d5b896868adf admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:01.414722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1233/2471] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:30:01.417834 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c15c1e-ceb1-4a4a-9d56-5995e36d32cd admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:01.427769 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c15c1e-ceb1-4a4a-9d56-5995e36d32cd admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:01.432579 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f7cc1b-c64b-4338-8fbf-3a55b299ee43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:01.433257 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f7cc1b-c64b-4338-8fbf-3a55b299ee43 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:01.433542 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f7cc1b-c64b-4338-8fbf-3a55b299ee43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:01.433820 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f7cc1b-c64b-4338-8fbf-3a55b299ee43 admin admin] PATH_INFO: `/v3/projects/3c1aa7a58b714d569ee874df82d513be/users/349a7d3419e148e8bacac0db001cc148/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:01.448548 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f7cc1b-c64b-4338-8fbf-3a55b299ee43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c1aa7a58b714d569ee874df82d513be, user_id=349a7d3419e148e8bacac0db001cc148, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:01.451235 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f7cc1b-c64b-4338-8fbf-3a55b299ee43 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:01.516461 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1239/2472] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:30:01 2022] PUT /identity/v3/projects/3c1aa7a58b714d569ee874df82d513be/users/349a7d3419e148e8bacac0db001cc148/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:30:01.527033 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08065463-8f2e-4f00-b00f-e5f76887e83e None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:01.527325 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08065463-8f2e-4f00-b00f-e5f76887e83e None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:01.527603 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08065463-8f2e-4f00-b00f-e5f76887e83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:01.555763 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-08065463-8f2e-4f00-b00f-e5f76887e83e None None] MFA Rules not processed for user `349a7d3419e148e8bacac0db001cc148`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:01.557299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-08065463-8f2e-4f00-b00f-e5f76887e83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:01.621603 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1234/2473] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:01.633028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f7cc1b-c64b-4338-8fbf-3a55b299ee43 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:01.634778 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c1f7cc1b-c64b-4338-8fbf-3a55b299ee43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:01.694949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f7cc1b-c64b-4338-8fbf-3a55b299ee43 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:01.698506 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971364fb-a443-432f-810f-a640087b8544 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:01.699116 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971364fb-a443-432f-810f-a640087b8544 service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:01.699399 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971364fb-a443-432f-810f-a640087b8544 service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:01.699673 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971364fb-a443-432f-810f-a640087b8544 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:01.707749 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971364fb-a443-432f-810f-a640087b8544 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:01.709206 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971364fb-a443-432f-810f-a640087b8544 service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:01.718132 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1240/2474] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:30:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:30:08.881444 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08065463-8f2e-4f00-b00f-e5f76887e83e None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:08.886453 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-08065463-8f2e-4f00-b00f-e5f76887e83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:08.893271 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:08.946793 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08065463-8f2e-4f00-b00f-e5f76887e83e None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:08.950439 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2ecd3-447e-4ccc-82a2-eb7ca3818e45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:08.951058 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2ecd3-447e-4ccc-82a2-eb7ca3818e45 service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:08.951347 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2ecd3-447e-4ccc-82a2-eb7ca3818e45 service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:08.951625 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2ecd3-447e-4ccc-82a2-eb7ca3818e45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:08.953391 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-50d2ecd3-447e-4ccc-82a2-eb7ca3818e45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:08.963754 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2ecd3-447e-4ccc-82a2-eb7ca3818e45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:08.965221 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2ecd3-447e-4ccc-82a2-eb7ca3818e45 service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:08.973729 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1235/2475] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:30:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:30:09.707445 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971364fb-a443-432f-810f-a640087b8544 service cinder] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:09.712570 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-971364fb-a443-432f-810f-a640087b8544 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:09.779701 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971364fb-a443-432f-810f-a640087b8544 service cinder] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:09.785413 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c718d5d-c1f6-4312-bfd6-4aed3b1845ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34794124b7234aeb98a15f0c2ae06a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:09.786021 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c718d5d-c1f6-4312-bfd6-4aed3b1845ce service placement] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:09.786306 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c718d5d-c1f6-4312-bfd6-4aed3b1845ce service placement] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:09.786586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c718d5d-c1f6-4312-bfd6-4aed3b1845ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:09.788324 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-3c718d5d-c1f6-4312-bfd6-4aed3b1845ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:09.799571 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c718d5d-c1f6-4312-bfd6-4aed3b1845ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:09.801685 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c718d5d-c1f6-4312-bfd6-4aed3b1845ce service placement] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:09.812837 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1241/2476] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:30:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:30:11.522695 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2ecd3-447e-4ccc-82a2-eb7ca3818e45 service neutron] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:11.586217 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2ecd3-447e-4ccc-82a2-eb7ca3818e45 service neutron] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:11.590732 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033793f9-56a9-4351-a043-ce0535e413c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:11.591363 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033793f9-56a9-4351-a043-ce0535e413c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:11.591641 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033793f9-56a9-4351-a043-ce0535e413c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:11.591912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033793f9-56a9-4351-a043-ce0535e413c6 admin admin] PATH_INFO: `/v3/users/349a7d3419e148e8bacac0db001cc148` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:11.593037 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033793f9-56a9-4351-a043-ce0535e413c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=349a7d3419e148e8bacac0db001cc148)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:11.595032 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033793f9-56a9-4351-a043-ce0535e413c6 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:11.816408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-033793f9-56a9-4351-a043-ce0535e413c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '349a7d3419e148e8bacac0db001cc148'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:11.817003 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-033793f9-56a9-4351-a043-ce0535e413c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '349a7d3419e148e8bacac0db001cc148'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:11.824120 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-033793f9-56a9-4351-a043-ce0535e413c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '349a7d3419e148e8bacac0db001cc148'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:11.824748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-033793f9-56a9-4351-a043-ce0535e413c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '349a7d3419e148e8bacac0db001cc148'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:11.838766 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-033793f9-56a9-4351-a043-ce0535e413c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '349a7d3419e148e8bacac0db001cc148'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:11.950266 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1236/2477] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:30:11 2022] DELETE /identity/v3/users/349a7d3419e148e8bacac0db001cc148 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:11.954541 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdaae3-d0a9-411e-bcd2-d0d29e0ae31b None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:11.955015 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdaae3-d0a9-411e-bcd2-d0d29e0ae31b None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:11.959101 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdaae3-d0a9-411e-bcd2-d0d29e0ae31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:11.974060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-f4bdaae3-d0a9-411e-bcd2-d0d29e0ae31b None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:11.975306 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-f4bdaae3-d0a9-411e-bcd2-d0d29e0ae31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:12.015808 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:12.044580 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1242/2478] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:12.055339 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033793f9-56a9-4351-a043-ce0535e413c6 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:12.056999 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-033793f9-56a9-4351-a043-ce0535e413c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:12.096116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:12.120128 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033793f9-56a9-4351-a043-ce0535e413c6 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:12.124449 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ce143-9d9c-493d-9ae1-9c975cf099b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:12.125251 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ce143-9d9c-493d-9ae1-9c975cf099b8 service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:12.125647 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ce143-9d9c-493d-9ae1-9c975cf099b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:12.126023 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ce143-9d9c-493d-9ae1-9c975cf099b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:12.136522 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ce143-9d9c-493d-9ae1-9c975cf099b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:12.137995 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ce143-9d9c-493d-9ae1-9c975cf099b8 service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:12.148379 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1237/2479] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:30:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:30:12.618908 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bdaae3-d0a9-411e-bcd2-d0d29e0ae31b None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:12.620488 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-f4bdaae3-d0a9-411e-bcd2-d0d29e0ae31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:12.633774 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bdaae3-d0a9-411e-bcd2-d0d29e0ae31b None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:12.639704 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20293c72-08ba-4096-9e88-da4c9cd6a50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:12.640617 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20293c72-08ba-4096-9e88-da4c9cd6a50d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:12.644139 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20293c72-08ba-4096-9e88-da4c9cd6a50d admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:12.644139 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20293c72-08ba-4096-9e88-da4c9cd6a50d admin admin] PATH_INFO: `/v3/projects/3c1aa7a58b714d569ee874df82d513be` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:12.644139 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20293c72-08ba-4096-9e88-da4c9cd6a50d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c1aa7a58b714d569ee874df82d513be)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:12.645695 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20293c72-08ba-4096-9e88-da4c9cd6a50d admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:12.777902 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-20293c72-08ba-4096-9e88-da4c9cd6a50d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c1aa7a58b714d569ee874df82d513be', 'request_id': 'req-20293c72-08ba-4096-9e88-da4c9cd6a50d'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:12.784991 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-20293c72-08ba-4096-9e88-da4c9cd6a50d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c1aa7a58b714d569ee874df82d513be', 'request_id': 'req-20293c72-08ba-4096-9e88-da4c9cd6a50d'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:12.790479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-20293c72-08ba-4096-9e88-da4c9cd6a50d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c1aa7a58b714d569ee874df82d513be', 'request_id': 'req-20293c72-08ba-4096-9e88-da4c9cd6a50d'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:12.885740 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-20293c72-08ba-4096-9e88-da4c9cd6a50d admin admin] The token cache is being invalidate because project 3c1aa7a58b714d569ee874df82d513be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:30:12.886411 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-20293c72-08ba-4096-9e88-da4c9cd6a50d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:12.887050 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-20293c72-08ba-4096-9e88-da4c9cd6a50d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:12.892031 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1243/2480] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:30:12 2022] DELETE /identity/v3/projects/3c1aa7a58b714d569ee874df82d513be => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:30:12.894501 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae821817-7e7c-4be8-bda9-16e1bf4f8352 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:12.894934 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae821817-7e7c-4be8-bda9-16e1bf4f8352 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:12.895229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae821817-7e7c-4be8-bda9-16e1bf4f8352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:12.923253 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-ae821817-7e7c-4be8-bda9-16e1bf4f8352 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:12.929274 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-ae821817-7e7c-4be8-bda9-16e1bf4f8352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:13.019267 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1238/2481] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:13.028316 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b23024-6283-4a77-9779-280296825c30 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:13.028848 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b23024-6283-4a77-9779-280296825c30 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:13.029006 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b23024-6283-4a77-9779-280296825c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:13.051519 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae821817-7e7c-4be8-bda9-16e1bf4f8352 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:13.052946 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-ae821817-7e7c-4be8-bda9-16e1bf4f8352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:13.059179 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-f8b23024-6283-4a77-9779-280296825c30 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:13.060698 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-f8b23024-6283-4a77-9779-280296825c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:13.080050 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1244/2482] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:30:13.082426 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b23024-6283-4a77-9779-280296825c30 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:13.093948 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b23024-6283-4a77-9779-280296825c30 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:13.100926 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b78ba7-f96d-4130-9610-04feefc45517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:13.102349 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b78ba7-f96d-4130-9610-04feefc45517 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:13.102799 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b78ba7-f96d-4130-9610-04feefc45517 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:13.103266 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b78ba7-f96d-4130-9610-04feefc45517 admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:13.104111 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b78ba7-f96d-4130-9610-04feefc45517 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:30:13.104422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b78ba7-f96d-4130-9610-04feefc45517 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:13.106084 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b78ba7-f96d-4130-9610-04feefc45517 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:13.125396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1245/2483] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:30:13.143311 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b78ba7-f96d-4130-9610-04feefc45517 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:13.154442 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b78ba7-f96d-4130-9610-04feefc45517 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:13.158564 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae821817-7e7c-4be8-bda9-16e1bf4f8352 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:13.162684 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976512a-85cb-4d44-a001-d5bba1686ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:13.163572 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbc146-40ea-4208-9548-00aeb9caf318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:13.163949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbc146-40ea-4208-9548-00aeb9caf318 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:13.164239 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbc146-40ea-4208-9548-00aeb9caf318 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:13.164518 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbc146-40ea-4208-9548-00aeb9caf318 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:13.165358 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbc146-40ea-4208-9548-00aeb9caf318 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:13.165476 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976512a-85cb-4d44-a001-d5bba1686ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:13.165862 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976512a-85cb-4d44-a001-d5bba1686ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:13.166238 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976512a-85cb-4d44-a001-d5bba1686ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:13.167769 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbc146-40ea-4208-9548-00aeb9caf318 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:13.168644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-b976512a-85cb-4d44-a001-d5bba1686ad8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:13.182606 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b976512a-85cb-4d44-a001-d5bba1686ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:13.184454 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b976512a-85cb-4d44-a001-d5bba1686ad8 service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:13.193958 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1239/2484] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:30:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:30:13.283947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1246/2485] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:30:13 2022] POST /identity/v3/projects => generated 367 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:30:13.288206 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976512a-85cb-4d44-a001-d5bba1686ad8 service neutron] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:13.299672 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976512a-85cb-4d44-a001-d5bba1686ad8 service neutron] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:13.361303 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98159c3-6b1c-48f8-ab0b-41eb7afbe0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:13.361925 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98159c3-6b1c-48f8-ab0b-41eb7afbe0c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:13.362725 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98159c3-6b1c-48f8-ab0b-41eb7afbe0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:13.363004 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98159c3-6b1c-48f8-ab0b-41eb7afbe0c4 admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:13.363633 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98159c3-6b1c-48f8-ab0b-41eb7afbe0c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:13.365620 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98159c3-6b1c-48f8-ab0b-41eb7afbe0c4 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:13.486460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1240/2486] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:30:13 2022] POST /identity/v3/users => generated 284 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:30:13.491131 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbc146-40ea-4208-9548-00aeb9caf318 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:13.501625 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbc146-40ea-4208-9548-00aeb9caf318 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:13.508450 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4a60c-6e42-45e2-ae9e-db13b6ac3ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:13.509062 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4a60c-6e42-45e2-ae9e-db13b6ac3ebb admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:13.509385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4a60c-6e42-45e2-ae9e-db13b6ac3ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:13.509656 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4a60c-6e42-45e2-ae9e-db13b6ac3ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:13.510308 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4a60c-6e42-45e2-ae9e-db13b6ac3ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:13.512000 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4a60c-6e42-45e2-ae9e-db13b6ac3ebb admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:13.523075 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1247/2487] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:30:13.526999 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98159c3-6b1c-48f8-ab0b-41eb7afbe0c4 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:13.537461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98159c3-6b1c-48f8-ab0b-41eb7afbe0c4 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:13.542584 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd317340-d482-425e-b635-ab25205e2837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:13.543138 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd317340-d482-425e-b635-ab25205e2837 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:13.546197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd317340-d482-425e-b635-ab25205e2837 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:13.546197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd317340-d482-425e-b635-ab25205e2837 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:13.546197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd317340-d482-425e-b635-ab25205e2837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:13.546197 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd317340-d482-425e-b635-ab25205e2837 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:13.547923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:13.561557 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1241/2488] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:30:13.562909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4a60c-6e42-45e2-ae9e-db13b6ac3ebb admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:13.573747 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4a60c-6e42-45e2-ae9e-db13b6ac3ebb admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:13.578683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c6fda-60c3-401b-a22d-450b68d590f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:13.579335 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c6fda-60c3-401b-a22d-450b68d590f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:13.579625 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c6fda-60c3-401b-a22d-450b68d590f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:13.579945 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c6fda-60c3-401b-a22d-450b68d590f9 admin admin] PATH_INFO: `/v3/projects/c0707ee5062640ba8687d52a31bed35f/users/0df9ff2caad5443487406a32d5bb1375/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:13.594975 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c6fda-60c3-401b-a22d-450b68d590f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0707ee5062640ba8687d52a31bed35f, user_id=0df9ff2caad5443487406a32d5bb1375, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:13.597778 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c6fda-60c3-401b-a22d-450b68d590f9 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:13.668959 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1248/2489] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:30:13 2022] PUT /identity/v3/projects/c0707ee5062640ba8687d52a31bed35f/users/0df9ff2caad5443487406a32d5bb1375/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:30:13.679644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5770e-5f21-43e9-9cad-f79b53788bec None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:13.679865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5770e-5f21-43e9-9cad-f79b53788bec None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:13.680145 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5770e-5f21-43e9-9cad-f79b53788bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:13.709618 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-3ad5770e-5f21-43e9-9cad-f79b53788bec None None] MFA Rules not processed for user `0df9ff2caad5443487406a32d5bb1375`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:13.710853 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-3ad5770e-5f21-43e9-9cad-f79b53788bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:13.775698 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1242/2490] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:13.780251 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c6fda-60c3-401b-a22d-450b68d590f9 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:13.830866 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:13.845834 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c6fda-60c3-401b-a22d-450b68d590f9 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:13.851039 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735031af-06e4-4317-adfb-1e21e27b28be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:13.851661 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735031af-06e4-4317-adfb-1e21e27b28be admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:13.851944 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735031af-06e4-4317-adfb-1e21e27b28be admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:13.852220 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735031af-06e4-4317-adfb-1e21e27b28be admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:13.852867 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735031af-06e4-4317-adfb-1e21e27b28be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:13.854823 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735031af-06e4-4317-adfb-1e21e27b28be admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:13.965561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5770e-5f21-43e9-9cad-f79b53788bec None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:13.967521 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-3ad5770e-5f21-43e9-9cad-f79b53788bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:13.978946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1249/2491] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:30:13 2022] POST /identity/v3/projects => generated 369 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:30:13.985794 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735031af-06e4-4317-adfb-1e21e27b28be admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:14.050503 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735031af-06e4-4317-adfb-1e21e27b28be admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:14.055185 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d3dc5-11ae-4a60-99b6-c2ed6e202736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:14.055813 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d3dc5-11ae-4a60-99b6-c2ed6e202736 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:14.056093 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d3dc5-11ae-4a60-99b6-c2ed6e202736 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:14.056364 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d3dc5-11ae-4a60-99b6-c2ed6e202736 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:14.057283 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d3dc5-11ae-4a60-99b6-c2ed6e202736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:14.059203 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d3dc5-11ae-4a60-99b6-c2ed6e202736 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:14.059443 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5770e-5f21-43e9-9cad-f79b53788bec None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:14.135350 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e118da-130a-4543-a175-07dfbd06a715 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:14.135350 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e118da-130a-4543-a175-07dfbd06a715 service nova] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:14.135350 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e118da-130a-4543-a175-07dfbd06a715 service nova] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:14.135350 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e118da-130a-4543-a175-07dfbd06a715 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:14.136770 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-01e118da-130a-4543-a175-07dfbd06a715 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:14.150083 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e118da-130a-4543-a175-07dfbd06a715 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:14.151707 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e118da-130a-4543-a175-07dfbd06a715 service nova] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:14.162806 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1250/2492] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:30:13 2022] POST /identity/v3/users => generated 291 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:30:14.164672 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1243/2493] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:30:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:30:14.166543 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d3dc5-11ae-4a60-99b6-c2ed6e202736 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:14.182288 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d3dc5-11ae-4a60-99b6-c2ed6e202736 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:14.189632 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b53f3-8e7e-4368-985f-0f6c71538806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:14.191017 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b53f3-8e7e-4368-985f-0f6c71538806 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:14.191162 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b53f3-8e7e-4368-985f-0f6c71538806 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:14.191330 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b53f3-8e7e-4368-985f-0f6c71538806 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:14.192005 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b53f3-8e7e-4368-985f-0f6c71538806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:14.194653 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b53f3-8e7e-4368-985f-0f6c71538806 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:14.220750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1251/2494] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:30:14.225789 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e118da-130a-4543-a175-07dfbd06a715 service nova] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:14.238140 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e118da-130a-4543-a175-07dfbd06a715 service nova] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:14.243295 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f42935-a606-420d-b51e-1020122e4180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:14.244059 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f42935-a606-420d-b51e-1020122e4180 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:14.244403 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f42935-a606-420d-b51e-1020122e4180 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:14.244743 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f42935-a606-420d-b51e-1020122e4180 admin admin] PATH_INFO: `/v3/projects/824289a51ef4493b9db80628728f34c1/users/4683f309507d45e48cb4120c42d2da42/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:14.248586 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:14.269402 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f42935-a606-420d-b51e-1020122e4180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=824289a51ef4493b9db80628728f34c1, user_id=4683f309507d45e48cb4120c42d2da42, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:14.271922 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f42935-a606-420d-b51e-1020122e4180 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:14.391977 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1244/2495] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:30:14 2022] PUT /identity/v3/projects/824289a51ef4493b9db80628728f34c1/users/4683f309507d45e48cb4120c42d2da42/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:14.396495 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b53f3-8e7e-4368-985f-0f6c71538806 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:14.407409 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b53f3-8e7e-4368-985f-0f6c71538806 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:14.521821 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9b345-fac8-4b85-90f3-ae17dab52952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:14.522473 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9b345-fac8-4b85-90f3-ae17dab52952 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:14.523707 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9b345-fac8-4b85-90f3-ae17dab52952 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:14.524006 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9b345-fac8-4b85-90f3-ae17dab52952 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:14.525212 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9b345-fac8-4b85-90f3-ae17dab52952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:14.531530 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9b345-fac8-4b85-90f3-ae17dab52952 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:14.550594 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1252/2496] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:30:14.554707 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f42935-a606-420d-b51e-1020122e4180 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:14.571912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f42935-a606-420d-b51e-1020122e4180 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:14.580264 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d098f0-a2a7-4392-b8ed-4a2a2c9a4755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:14.582069 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d098f0-a2a7-4392-b8ed-4a2a2c9a4755 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:14.583990 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d098f0-a2a7-4392-b8ed-4a2a2c9a4755 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:14.589277 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d098f0-a2a7-4392-b8ed-4a2a2c9a4755 admin admin] PATH_INFO: `/v3/projects/824289a51ef4493b9db80628728f34c1/users/4683f309507d45e48cb4120c42d2da42/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:14.592191 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d098f0-a2a7-4392-b8ed-4a2a2c9a4755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=824289a51ef4493b9db80628728f34c1, user_id=4683f309507d45e48cb4120c42d2da42, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:14.595036 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d098f0-a2a7-4392-b8ed-4a2a2c9a4755 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:14.632077 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1245/2497] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:30:14 2022] PUT /identity/v3/projects/824289a51ef4493b9db80628728f34c1/users/4683f309507d45e48cb4120c42d2da42/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:30:14.644845 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792cc38-7d37-4376-9754-4014074fb7d8 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:14.645181 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792cc38-7d37-4376-9754-4014074fb7d8 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:14.645502 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792cc38-7d37-4376-9754-4014074fb7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:14.684956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-b792cc38-7d37-4376-9754-4014074fb7d8 None None] MFA Rules not processed for user `4683f309507d45e48cb4120c42d2da42`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:14.686200 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-b792cc38-7d37-4376-9754-4014074fb7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:14.733442 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:14.794578 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1253/2498] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:14 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:14.806390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d098f0-a2a7-4392-b8ed-4a2a2c9a4755 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:14.812881 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-14d098f0-a2a7-4392-b8ed-4a2a2c9a4755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:14.883835 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d098f0-a2a7-4392-b8ed-4a2a2c9a4755 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:14.887887 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d9d7d-2146-4247-8cb4-413c837e97ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:14.890817 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d9d7d-2146-4247-8cb4-413c837e97ea service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:14.890817 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d9d7d-2146-4247-8cb4-413c837e97ea service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:14.890817 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d9d7d-2146-4247-8cb4-413c837e97ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:14.901527 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d9d7d-2146-4247-8cb4-413c837e97ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:14.903466 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d9d7d-2146-4247-8cb4-413c837e97ea service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:14.916187 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1246/2499] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:30:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:30:15.062157 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792cc38-7d37-4376-9754-4014074fb7d8 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:15.063583 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-b792cc38-7d37-4376-9754-4014074fb7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:15.076136 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792cc38-7d37-4376-9754-4014074fb7d8 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:15.079709 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e334b9-38f9-45fb-9c76-5bf6e83a01e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:15.080334 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e334b9-38f9-45fb-9c76-5bf6e83a01e7 service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:15.080597 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e334b9-38f9-45fb-9c76-5bf6e83a01e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:15.080866 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e334b9-38f9-45fb-9c76-5bf6e83a01e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:15.136285 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e334b9-38f9-45fb-9c76-5bf6e83a01e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:15.137831 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e334b9-38f9-45fb-9c76-5bf6e83a01e7 service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:15.146829 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1254/2500] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:30:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:30:19.744213 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d9d7d-2146-4247-8cb4-413c837e97ea service cinder] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:19.745859 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-487d9d7d-2146-4247-8cb4-413c837e97ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:19.819356 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d9d7d-2146-4247-8cb4-413c837e97ea service cinder] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:19.825432 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5d521-2463-4677-a0e4-1526f13c6d73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:19.825758 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5d521-2463-4677-a0e4-1526f13c6d73 service nova] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:19.826039 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5d521-2463-4677-a0e4-1526f13c6d73 service nova] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:19.826313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5d521-2463-4677-a0e4-1526f13c6d73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:19.828054 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-5fc5d521-2463-4677-a0e4-1526f13c6d73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:19.832725 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e334b9-38f9-45fb-9c76-5bf6e83a01e7 service cinder] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:19.840933 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5d521-2463-4677-a0e4-1526f13c6d73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:19.844294 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5d521-2463-4677-a0e4-1526f13c6d73 service nova] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:19.857375 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1247/2501] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:30:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:30:19.906224 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e334b9-38f9-45fb-9c76-5bf6e83a01e7 service cinder] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:19.911837 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b21ca-e04f-48ea-9dc0-6b458802fc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:19.912536 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b21ca-e04f-48ea-9dc0-6b458802fc8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:19.912762 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b21ca-e04f-48ea-9dc0-6b458802fc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:19.913039 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b21ca-e04f-48ea-9dc0-6b458802fc8d admin admin] PATH_INFO: `/v3/users/0df9ff2caad5443487406a32d5bb1375` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:19.914221 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b21ca-e04f-48ea-9dc0-6b458802fc8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0df9ff2caad5443487406a32d5bb1375)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:19.916154 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b21ca-e04f-48ea-9dc0-6b458802fc8d admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:20.157502 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-971b21ca-e04f-48ea-9dc0-6b458802fc8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0df9ff2caad5443487406a32d5bb1375'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:20.227978 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-971b21ca-e04f-48ea-9dc0-6b458802fc8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0df9ff2caad5443487406a32d5bb1375'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:20.236508 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-971b21ca-e04f-48ea-9dc0-6b458802fc8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0df9ff2caad5443487406a32d5bb1375'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:20.244537 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:20.251040 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-971b21ca-e04f-48ea-9dc0-6b458802fc8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0df9ff2caad5443487406a32d5bb1375'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:20.252402 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-971b21ca-e04f-48ea-9dc0-6b458802fc8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0df9ff2caad5443487406a32d5bb1375'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:20.262016 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1255/2502] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:30:19 2022] DELETE /identity/v3/users/0df9ff2caad5443487406a32d5bb1375 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:30:20.264622 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2da7f-9c78-4f5c-be62-a3db61c684ad None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:20.264622 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2da7f-9c78-4f5c-be62-a3db61c684ad None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:20.264622 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2da7f-9c78-4f5c-be62-a3db61c684ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:20.286626 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-22d2da7f-9c78-4f5c-be62-a3db61c684ad None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:20.287845 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-22d2da7f-9c78-4f5c-be62-a3db61c684ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:20.356624 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:20.358754 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1248/2503] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:30:20.368880 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b21ca-e04f-48ea-9dc0-6b458802fc8d admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:20.370347 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-971b21ca-e04f-48ea-9dc0-6b458802fc8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:20.444776 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b21ca-e04f-48ea-9dc0-6b458802fc8d admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:20.448553 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde98989-51f5-4134-b494-80bccc3b20a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:20.449266 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde98989-51f5-4134-b494-80bccc3b20a3 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:20.449621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde98989-51f5-4134-b494-80bccc3b20a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:20.449965 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde98989-51f5-4134-b494-80bccc3b20a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:20.460079 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde98989-51f5-4134-b494-80bccc3b20a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:20.461636 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde98989-51f5-4134-b494-80bccc3b20a3 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:20.472051 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1256/2504] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:30:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:30:20.992309 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2da7f-9c78-4f5c-be62-a3db61c684ad None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:20.993867 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-22d2da7f-9c78-4f5c-be62-a3db61c684ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:21.008586 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2da7f-9c78-4f5c-be62-a3db61c684ad None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:21.013871 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc78199-8165-4d45-875a-7270830845c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:21.014519 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc78199-8165-4d45-875a-7270830845c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:21.014826 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc78199-8165-4d45-875a-7270830845c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:21.015103 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc78199-8165-4d45-875a-7270830845c9 admin admin] PATH_INFO: `/v3/projects/c0707ee5062640ba8687d52a31bed35f` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:21.016227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc78199-8165-4d45-875a-7270830845c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0707ee5062640ba8687d52a31bed35f)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:21.018951 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc78199-8165-4d45-875a-7270830845c9 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:21.160734 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-cbc78199-8165-4d45-875a-7270830845c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0707ee5062640ba8687d52a31bed35f', 'request_id': 'req-cbc78199-8165-4d45-875a-7270830845c9'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:21.167150 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-cbc78199-8165-4d45-875a-7270830845c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0707ee5062640ba8687d52a31bed35f', 'request_id': 'req-cbc78199-8165-4d45-875a-7270830845c9'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:21.172780 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-cbc78199-8165-4d45-875a-7270830845c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0707ee5062640ba8687d52a31bed35f', 'request_id': 'req-cbc78199-8165-4d45-875a-7270830845c9'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:21.241169 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-cbc78199-8165-4d45-875a-7270830845c9 admin admin] The token cache is being invalidate because project c0707ee5062640ba8687d52a31bed35f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:30:21.241406 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-cbc78199-8165-4d45-875a-7270830845c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:21.242025 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-cbc78199-8165-4d45-875a-7270830845c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:21.243573 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1249/2505] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:30:20 2022] DELETE /identity/v3/projects/c0707ee5062640ba8687d52a31bed35f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:21.247625 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde98989-51f5-4134-b494-80bccc3b20a3 service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:21.257629 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde98989-51f5-4134-b494-80bccc3b20a3 service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:21.314086 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0674b-bc80-4e18-8778-f67a3f066cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:21.314790 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0674b-bc80-4e18-8778-f67a3f066cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:21.315072 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0674b-bc80-4e18-8778-f67a3f066cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:21.315350 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0674b-bc80-4e18-8778-f67a3f066cb5 admin admin] PATH_INFO: `/v3/users/4683f309507d45e48cb4120c42d2da42` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:21.316511 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0674b-bc80-4e18-8778-f67a3f066cb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4683f309507d45e48cb4120c42d2da42)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:21.318487 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0674b-bc80-4e18-8778-f67a3f066cb5 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:21.512253 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-edc0674b-bc80-4e18-8778-f67a3f066cb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4683f309507d45e48cb4120c42d2da42'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:21.584236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-edc0674b-bc80-4e18-8778-f67a3f066cb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4683f309507d45e48cb4120c42d2da42'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:21.591998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-edc0674b-bc80-4e18-8778-f67a3f066cb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4683f309507d45e48cb4120c42d2da42'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:21.604318 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-edc0674b-bc80-4e18-8778-f67a3f066cb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4683f309507d45e48cb4120c42d2da42'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:21.604953 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-edc0674b-bc80-4e18-8778-f67a3f066cb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4683f309507d45e48cb4120c42d2da42'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:21.610833 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1257/2506] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:30:21 2022] DELETE /identity/v3/users/4683f309507d45e48cb4120c42d2da42 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:22.014641 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc78199-8165-4d45-875a-7270830845c9 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:22.016077 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-cbc78199-8165-4d45-875a-7270830845c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:22.037588 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc78199-8165-4d45-875a-7270830845c9 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:22.103541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdcbaf-ef8a-4b28-8931-2e9c286719a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:22.104263 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdcbaf-ef8a-4b28-8931-2e9c286719a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:22.104552 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdcbaf-ef8a-4b28-8931-2e9c286719a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:22.104822 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdcbaf-ef8a-4b28-8931-2e9c286719a0 admin admin] PATH_INFO: `/v3/projects/824289a51ef4493b9db80628728f34c1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:22.105984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cdcbaf-ef8a-4b28-8931-2e9c286719a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=824289a51ef4493b9db80628728f34c1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:22.107946 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cdcbaf-ef8a-4b28-8931-2e9c286719a0 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:22.224851 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-43cdcbaf-ef8a-4b28-8931-2e9c286719a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '824289a51ef4493b9db80628728f34c1', 'request_id': 'req-43cdcbaf-ef8a-4b28-8931-2e9c286719a0'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:22.231005 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-43cdcbaf-ef8a-4b28-8931-2e9c286719a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '824289a51ef4493b9db80628728f34c1', 'request_id': 'req-43cdcbaf-ef8a-4b28-8931-2e9c286719a0'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:22.236525 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-43cdcbaf-ef8a-4b28-8931-2e9c286719a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '824289a51ef4493b9db80628728f34c1', 'request_id': 'req-43cdcbaf-ef8a-4b28-8931-2e9c286719a0'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:22.321387 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-43cdcbaf-ef8a-4b28-8931-2e9c286719a0 admin admin] The token cache is being invalidate because project 824289a51ef4493b9db80628728f34c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:30:22.321685 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-43cdcbaf-ef8a-4b28-8931-2e9c286719a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:22.322296 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-43cdcbaf-ef8a-4b28-8931-2e9c286719a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:22.323812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1250/2507] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:30:22 2022] DELETE /identity/v3/projects/824289a51ef4493b9db80628728f34c1 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:22.328684 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f96e6-1c89-4549-a5b4-8cf6420479ea None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:22.329158 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f96e6-1c89-4549-a5b4-8cf6420479ea None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:22.329260 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f96e6-1c89-4549-a5b4-8cf6420479ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:22.349244 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-079f96e6-1c89-4549-a5b4-8cf6420479ea None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:22.350438 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-079f96e6-1c89-4549-a5b4-8cf6420479ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:22.355627 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:22.408888 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1258/2508] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:22.416598 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff04a31-0734-4213-8f21-644aeddad89b None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:22.416889 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff04a31-0734-4213-8f21-644aeddad89b None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:22.417207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff04a31-0734-4213-8f21-644aeddad89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:22.437178 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-7ff04a31-0734-4213-8f21-644aeddad89b None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:22.438381 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-7ff04a31-0734-4213-8f21-644aeddad89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:22.447009 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1251/2509] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:22.451093 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f96e6-1c89-4549-a5b4-8cf6420479ea None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:22.461398 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f96e6-1c89-4549-a5b4-8cf6420479ea None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:22.465973 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a77210-5758-49f6-9129-2387fa46dffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:22.466568 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a77210-5758-49f6-9129-2387fa46dffb admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:22.466855 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a77210-5758-49f6-9129-2387fa46dffb admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:22.467132 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a77210-5758-49f6-9129-2387fa46dffb admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:22.467784 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a77210-5758-49f6-9129-2387fa46dffb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:30:22.468092 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a77210-5758-49f6-9129-2387fa46dffb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:22.469732 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a77210-5758-49f6-9129-2387fa46dffb admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:22.481104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1259/2510] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:30:22.485187 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff04a31-0734-4213-8f21-644aeddad89b None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:22.494874 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff04a31-0734-4213-8f21-644aeddad89b None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:22.499672 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495584a-05e2-45dc-97c6-1b19d14e2f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:22.500342 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495584a-05e2-45dc-97c6-1b19d14e2f8d admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:22.500619 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495584a-05e2-45dc-97c6-1b19d14e2f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:22.500892 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495584a-05e2-45dc-97c6-1b19d14e2f8d admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:22.501582 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495584a-05e2-45dc-97c6-1b19d14e2f8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:22.503498 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495584a-05e2-45dc-97c6-1b19d14e2f8d admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:22.508579 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:22.620887 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1252/2511] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:30:22 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:30:22.625255 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a77210-5758-49f6-9129-2387fa46dffb admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:22.635575 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a77210-5758-49f6-9129-2387fa46dffb admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:22.693981 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666ab66-14e8-40b7-b9a9-baea7a28e18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:22.694591 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666ab66-14e8-40b7-b9a9-baea7a28e18e admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:22.694877 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666ab66-14e8-40b7-b9a9-baea7a28e18e admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:22.695148 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666ab66-14e8-40b7-b9a9-baea7a28e18e admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:22.695793 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666ab66-14e8-40b7-b9a9-baea7a28e18e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:22.697781 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666ab66-14e8-40b7-b9a9-baea7a28e18e admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:22.794983 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1260/2512] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:30:22 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:30:22.796163 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495584a-05e2-45dc-97c6-1b19d14e2f8d admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:22.806619 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495584a-05e2-45dc-97c6-1b19d14e2f8d admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:22.811452 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0727b8-88e3-45a4-a997-32585eb779b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:22.812215 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0727b8-88e3-45a4-a997-32585eb779b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:22.814715 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0727b8-88e3-45a4-a997-32585eb779b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:22.814715 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0727b8-88e3-45a4-a997-32585eb779b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:22.814715 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0727b8-88e3-45a4-a997-32585eb779b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:22.815072 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0727b8-88e3-45a4-a997-32585eb779b6 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:22.827824 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1253/2513] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:30:22.831780 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666ab66-14e8-40b7-b9a9-baea7a28e18e admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:22.843419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666ab66-14e8-40b7-b9a9-baea7a28e18e admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:22.848562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ed322-5430-41b0-ad83-8e51b4b50ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:22.849205 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ed322-5430-41b0-ad83-8e51b4b50ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:22.849491 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ed322-5430-41b0-ad83-8e51b4b50ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:22.849767 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ed322-5430-41b0-ad83-8e51b4b50ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:22.850549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ed322-5430-41b0-ad83-8e51b4b50ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:22.852153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ed322-5430-41b0-ad83-8e51b4b50ac9 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:22.863700 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1261/2514] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:30:22.869333 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0727b8-88e3-45a4-a997-32585eb779b6 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:22.880079 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0727b8-88e3-45a4-a997-32585eb779b6 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:22.884965 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146acc93-c249-430a-9028-1f5abd013205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:22.885705 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146acc93-c249-430a-9028-1f5abd013205 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:22.886059 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146acc93-c249-430a-9028-1f5abd013205 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:22.886405 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146acc93-c249-430a-9028-1f5abd013205 admin admin] PATH_INFO: `/v3/projects/495e1ad8292a4d8f9a2e3d1f54fbb055/users/1b0155eb317243ba8ccc23af917312ff/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:22.902397 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146acc93-c249-430a-9028-1f5abd013205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=495e1ad8292a4d8f9a2e3d1f54fbb055, user_id=1b0155eb317243ba8ccc23af917312ff, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:22.905279 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146acc93-c249-430a-9028-1f5abd013205 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:22.917249 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ed322-5430-41b0-ad83-8e51b4b50ac9 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:22.919048 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-898ed322-5430-41b0-ad83-8e51b4b50ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:22.980513 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ed322-5430-41b0-ad83-8e51b4b50ac9 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:22.984374 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb64a58-d1c5-4d92-8250-3fde5bbed323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:22.984993 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb64a58-d1c5-4d92-8250-3fde5bbed323 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:22.985584 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb64a58-d1c5-4d92-8250-3fde5bbed323 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:22.985869 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb64a58-d1c5-4d92-8250-3fde5bbed323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:22.988458 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-dbb64a58-d1c5-4d92-8250-3fde5bbed323 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:22.990261 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1254/2515] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:30:22 2022] PUT /identity/v3/projects/495e1ad8292a4d8f9a2e3d1f54fbb055/users/1b0155eb317243ba8ccc23af917312ff/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:23.000467 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6624729-a202-4800-a11d-957b41570456 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:23.000865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6624729-a202-4800-a11d-957b41570456 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:23.001281 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6624729-a202-4800-a11d-957b41570456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:23.021582 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:23.029295 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-c6624729-a202-4800-a11d-957b41570456 None None] MFA Rules not processed for user `1b0155eb317243ba8ccc23af917312ff`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:23.030598 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-c6624729-a202-4800-a11d-957b41570456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:23.057460 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb64a58-d1c5-4d92-8250-3fde5bbed323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:23.058972 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb64a58-d1c5-4d92-8250-3fde5bbed323 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:23.069699 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1262/2516] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:30:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:30:23.098571 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1255/2517] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:30:23.106142 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb64a58-d1c5-4d92-8250-3fde5bbed323 service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:23.118247 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb64a58-d1c5-4d92-8250-3fde5bbed323 service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:23.179628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b6854-4bff-4dad-9129-8fcd2aa29cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:23.180247 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b6854-4bff-4dad-9129-8fcd2aa29cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:23.180532 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b6854-4bff-4dad-9129-8fcd2aa29cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:23.180807 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b6854-4bff-4dad-9129-8fcd2aa29cc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:23.181481 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b6854-4bff-4dad-9129-8fcd2aa29cc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:23.183708 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b6854-4bff-4dad-9129-8fcd2aa29cc0 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:23.275564 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1263/2518] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:30:23 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:30:23.279656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6624729-a202-4800-a11d-957b41570456 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:23.290984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6624729-a202-4800-a11d-957b41570456 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:23.366771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5beb8-5673-4dae-987f-5ca2fc961cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:23.367322 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5beb8-5673-4dae-987f-5ca2fc961cff admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:23.367607 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5beb8-5673-4dae-987f-5ca2fc961cff admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:23.367883 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5beb8-5673-4dae-987f-5ca2fc961cff admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:23.368516 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5beb8-5673-4dae-987f-5ca2fc961cff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:23.370584 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5beb8-5673-4dae-987f-5ca2fc961cff admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:23.468559 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1256/2519] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:30:23 2022] POST /identity/v3/users => generated 299 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:30:23.473030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b6854-4bff-4dad-9129-8fcd2aa29cc0 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:23.483486 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b6854-4bff-4dad-9129-8fcd2aa29cc0 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:23.489315 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434256b-80ff-46ff-9824-2b3911f1859c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:23.489870 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434256b-80ff-46ff-9824-2b3911f1859c admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:23.498372 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434256b-80ff-46ff-9824-2b3911f1859c admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:23.498372 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434256b-80ff-46ff-9824-2b3911f1859c admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:23.498372 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434256b-80ff-46ff-9824-2b3911f1859c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:23.498372 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434256b-80ff-46ff-9824-2b3911f1859c admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:23.504136 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1264/2520] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:30:23.508549 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5beb8-5673-4dae-987f-5ca2fc961cff admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:23.519070 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5beb8-5673-4dae-987f-5ca2fc961cff admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:23.523821 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ffd47-0da3-4720-9381-d3fe9b418237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:23.524480 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ffd47-0da3-4720-9381-d3fe9b418237 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:23.524767 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ffd47-0da3-4720-9381-d3fe9b418237 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:23.525041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ffd47-0da3-4720-9381-d3fe9b418237 admin admin] PATH_INFO: `/v3/projects/0f6cc05e7c024c86890b0ed74f8e4d4a/users/9cdf28392460449cb8d4d64a185096e2/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:23.540910 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ffd47-0da3-4720-9381-d3fe9b418237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f6cc05e7c024c86890b0ed74f8e4d4a, user_id=9cdf28392460449cb8d4d64a185096e2, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:23.543631 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ffd47-0da3-4720-9381-d3fe9b418237 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:23.612666 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1257/2521] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:30:23 2022] PUT /identity/v3/projects/0f6cc05e7c024c86890b0ed74f8e4d4a/users/9cdf28392460449cb8d4d64a185096e2/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:23.617387 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434256b-80ff-46ff-9824-2b3911f1859c admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:23.627395 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434256b-80ff-46ff-9824-2b3911f1859c admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:23.696824 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c31b49-91f7-4a5d-9542-aed61de0d2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:23.697574 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c31b49-91f7-4a5d-9542-aed61de0d2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:23.697857 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c31b49-91f7-4a5d-9542-aed61de0d2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:23.698293 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c31b49-91f7-4a5d-9542-aed61de0d2e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:23.698954 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c31b49-91f7-4a5d-9542-aed61de0d2e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:23.700555 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c31b49-91f7-4a5d-9542-aed61de0d2e4 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:23.713738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1265/2522] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:30:23.714941 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ffd47-0da3-4720-9381-d3fe9b418237 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:23.721722 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:23.726132 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ffd47-0da3-4720-9381-d3fe9b418237 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:23.731033 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4310b3-1598-41a0-b277-fcc6e49e29c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:23.731734 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4310b3-1598-41a0-b277-fcc6e49e29c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:23.733916 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4310b3-1598-41a0-b277-fcc6e49e29c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:23.733916 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4310b3-1598-41a0-b277-fcc6e49e29c4 admin admin] PATH_INFO: `/v3/projects/0f6cc05e7c024c86890b0ed74f8e4d4a/users/9cdf28392460449cb8d4d64a185096e2/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:23.734542 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4310b3-1598-41a0-b277-fcc6e49e29c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f6cc05e7c024c86890b0ed74f8e4d4a, user_id=9cdf28392460449cb8d4d64a185096e2, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:23.737304 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4310b3-1598-41a0-b277-fcc6e49e29c4 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:23.748927 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1258/2523] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:30:23 2022] PUT /identity/v3/projects/0f6cc05e7c024c86890b0ed74f8e4d4a/users/9cdf28392460449cb8d4d64a185096e2/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:23.759972 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97e1c7-9127-46fe-971e-d78d97fcdd9c None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:23.760333 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97e1c7-9127-46fe-971e-d78d97fcdd9c None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:23.764915 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97e1c7-9127-46fe-971e-d78d97fcdd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:23.792813 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-6d97e1c7-9127-46fe-971e-d78d97fcdd9c None None] MFA Rules not processed for user `9cdf28392460449cb8d4d64a185096e2`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:23.794137 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-6d97e1c7-9127-46fe-971e-d78d97fcdd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:23.821398 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:23.866079 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1266/2524] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:23.877287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4310b3-1598-41a0-b277-fcc6e49e29c4 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:23.879013 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-8c4310b3-1598-41a0-b277-fcc6e49e29c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:23.941238 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4310b3-1598-41a0-b277-fcc6e49e29c4 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:23.949674 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ac203-d62c-46b9-a9a7-a9a00284706e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:23.950461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ac203-d62c-46b9-a9a7-a9a00284706e service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:23.950866 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ac203-d62c-46b9-a9a7-a9a00284706e service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:23.951121 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ac203-d62c-46b9-a9a7-a9a00284706e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:23.962568 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ac203-d62c-46b9-a9a7-a9a00284706e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:23.964074 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ac203-d62c-46b9-a9a7-a9a00284706e service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:23.974941 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1259/2525] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:30:23 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:30:24.043398 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97e1c7-9127-46fe-971e-d78d97fcdd9c None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:24.117432 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97e1c7-9127-46fe-971e-d78d97fcdd9c None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:24.122163 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b1204-2e5b-4caf-a029-7e3bdb221946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:24.122817 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b1204-2e5b-4caf-a029-7e3bdb221946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:24.123170 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b1204-2e5b-4caf-a029-7e3bdb221946 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:24.123516 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b1204-2e5b-4caf-a029-7e3bdb221946 admin admin] PATH_INFO: `/v3/users/1b0155eb317243ba8ccc23af917312ff` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:24.124728 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b1204-2e5b-4caf-a029-7e3bdb221946 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b0155eb317243ba8ccc23af917312ff)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:24.126845 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b1204-2e5b-4caf-a029-7e3bdb221946 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:24.299090 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-5d1b1204-2e5b-4caf-a029-7e3bdb221946 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b0155eb317243ba8ccc23af917312ff'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:24.416998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-5d1b1204-2e5b-4caf-a029-7e3bdb221946 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b0155eb317243ba8ccc23af917312ff'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:24.425963 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-5d1b1204-2e5b-4caf-a029-7e3bdb221946 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b0155eb317243ba8ccc23af917312ff'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:24.443127 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-5d1b1204-2e5b-4caf-a029-7e3bdb221946 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b0155eb317243ba8ccc23af917312ff'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:24.443860 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-5d1b1204-2e5b-4caf-a029-7e3bdb221946 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b0155eb317243ba8ccc23af917312ff'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:24.451004 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1267/2526] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:30:24 2022] DELETE /identity/v3/users/1b0155eb317243ba8ccc23af917312ff => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:24.455355 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b019156-a498-47fc-b10f-31cb530193da None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:24.455872 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b019156-a498-47fc-b10f-31cb530193da None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:24.455973 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b019156-a498-47fc-b10f-31cb530193da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:24.476016 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-8b019156-a498-47fc-b10f-31cb530193da None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:24.477288 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-8b019156-a498-47fc-b10f-31cb530193da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:24.557247 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1260/2527] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:24.567838 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b1204-2e5b-4caf-a029-7e3bdb221946 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:24.569537 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-5d1b1204-2e5b-4caf-a029-7e3bdb221946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:24.643327 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:24.655993 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b1204-2e5b-4caf-a029-7e3bdb221946 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:24.660592 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99389182-9e1a-4881-ad84-1a9d0430b7b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:24.661351 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99389182-9e1a-4881-ad84-1a9d0430b7b8 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:24.661638 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99389182-9e1a-4881-ad84-1a9d0430b7b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:24.662041 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99389182-9e1a-4881-ad84-1a9d0430b7b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:24.672813 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99389182-9e1a-4881-ad84-1a9d0430b7b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:24.677058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99389182-9e1a-4881-ad84-1a9d0430b7b8 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:24.685443 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1268/2528] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:30:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:30:25.123649 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b019156-a498-47fc-b10f-31cb530193da None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:25.125233 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-8b019156-a498-47fc-b10f-31cb530193da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:25.143765 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b019156-a498-47fc-b10f-31cb530193da None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:25.150711 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b227ab-5d71-4c18-8c2b-eff61f395ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:25.151572 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b227ab-5d71-4c18-8c2b-eff61f395ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:25.151959 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b227ab-5d71-4c18-8c2b-eff61f395ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:25.152242 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b227ab-5d71-4c18-8c2b-eff61f395ad7 admin admin] PATH_INFO: `/v3/projects/495e1ad8292a4d8f9a2e3d1f54fbb055` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:25.162063 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b227ab-5d71-4c18-8c2b-eff61f395ad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=495e1ad8292a4d8f9a2e3d1f54fbb055)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:25.166929 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b227ab-5d71-4c18-8c2b-eff61f395ad7 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:25.297561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-15b227ab-5d71-4c18-8c2b-eff61f395ad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '495e1ad8292a4d8f9a2e3d1f54fbb055', 'request_id': 'req-15b227ab-5d71-4c18-8c2b-eff61f395ad7'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:25.305493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-15b227ab-5d71-4c18-8c2b-eff61f395ad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '495e1ad8292a4d8f9a2e3d1f54fbb055', 'request_id': 'req-15b227ab-5d71-4c18-8c2b-eff61f395ad7'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:25.311727 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-15b227ab-5d71-4c18-8c2b-eff61f395ad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '495e1ad8292a4d8f9a2e3d1f54fbb055', 'request_id': 'req-15b227ab-5d71-4c18-8c2b-eff61f395ad7'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:25.413232 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-15b227ab-5d71-4c18-8c2b-eff61f395ad7 admin admin] The token cache is being invalidate because project 495e1ad8292a4d8f9a2e3d1f54fbb055 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:30:25.413536 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-15b227ab-5d71-4c18-8c2b-eff61f395ad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:25.414175 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-15b227ab-5d71-4c18-8c2b-eff61f395ad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:25.419575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1261/2529] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:30:25 2022] DELETE /identity/v3/projects/495e1ad8292a4d8f9a2e3d1f54fbb055 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:25.420393 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99389182-9e1a-4881-ad84-1a9d0430b7b8 service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:25.436135 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99389182-9e1a-4881-ad84-1a9d0430b7b8 service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:25.482343 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b227ab-5d71-4c18-8c2b-eff61f395ad7 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:25.483947 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-15b227ab-5d71-4c18-8c2b-eff61f395ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:25.513558 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:25.545718 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d38ac2-e2cc-4bf3-9c8f-1b90b73b2f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:25.546371 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d38ac2-e2cc-4bf3-9c8f-1b90b73b2f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:25.546654 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d38ac2-e2cc-4bf3-9c8f-1b90b73b2f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:25.547461 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d38ac2-e2cc-4bf3-9c8f-1b90b73b2f18 admin admin] PATH_INFO: `/v3/users/9cdf28392460449cb8d4d64a185096e2` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:25.548636 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d38ac2-e2cc-4bf3-9c8f-1b90b73b2f18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cdf28392460449cb8d4d64a185096e2)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:25.550945 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d38ac2-e2cc-4bf3-9c8f-1b90b73b2f18 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:25.594078 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b227ab-5d71-4c18-8c2b-eff61f395ad7 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:25.604639 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976042a9-21ac-48f0-82c6-d2f5be574fe2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:25.607046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976042a9-21ac-48f0-82c6-d2f5be574fe2 service nova] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:25.607334 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976042a9-21ac-48f0-82c6-d2f5be574fe2 service nova] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:25.607611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976042a9-21ac-48f0-82c6-d2f5be574fe2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:25.609723 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-976042a9-21ac-48f0-82c6-d2f5be574fe2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:25.638785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976042a9-21ac-48f0-82c6-d2f5be574fe2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:25.640868 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976042a9-21ac-48f0-82c6-d2f5be574fe2 service nova] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:25.654052 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1262/2530] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:30:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:30:25.798922 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-18d38ac2-e2cc-4bf3-9c8f-1b90b73b2f18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cdf28392460449cb8d4d64a185096e2'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:25.887089 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-18d38ac2-e2cc-4bf3-9c8f-1b90b73b2f18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cdf28392460449cb8d4d64a185096e2'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:25.898742 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-18d38ac2-e2cc-4bf3-9c8f-1b90b73b2f18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cdf28392460449cb8d4d64a185096e2'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:25.912988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-18d38ac2-e2cc-4bf3-9c8f-1b90b73b2f18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cdf28392460449cb8d4d64a185096e2'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:25.913789 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-18d38ac2-e2cc-4bf3-9c8f-1b90b73b2f18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cdf28392460449cb8d4d64a185096e2'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:25.920531 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1269/2531] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:30:25 2022] DELETE /identity/v3/users/9cdf28392460449cb8d4d64a185096e2 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:26.516622 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976042a9-21ac-48f0-82c6-d2f5be574fe2 service nova] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:26.518681 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-976042a9-21ac-48f0-82c6-d2f5be574fe2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:26.545059 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976042a9-21ac-48f0-82c6-d2f5be574fe2 service nova] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:26.681577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1997b94-f11f-4856-a07e-9289fb2831a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:26.696489 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1997b94-f11f-4856-a07e-9289fb2831a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:26.696489 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1997b94-f11f-4856-a07e-9289fb2831a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:26.696489 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1997b94-f11f-4856-a07e-9289fb2831a6 admin admin] PATH_INFO: `/v3/projects/0f6cc05e7c024c86890b0ed74f8e4d4a` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:26.696489 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1997b94-f11f-4856-a07e-9289fb2831a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f6cc05e7c024c86890b0ed74f8e4d4a)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:26.696489 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1997b94-f11f-4856-a07e-9289fb2831a6 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:26.921511 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-b1997b94-f11f-4856-a07e-9289fb2831a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f6cc05e7c024c86890b0ed74f8e4d4a', 'request_id': 'req-b1997b94-f11f-4856-a07e-9289fb2831a6'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:26.936334 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-b1997b94-f11f-4856-a07e-9289fb2831a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f6cc05e7c024c86890b0ed74f8e4d4a', 'request_id': 'req-b1997b94-f11f-4856-a07e-9289fb2831a6'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:26.948404 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-b1997b94-f11f-4856-a07e-9289fb2831a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f6cc05e7c024c86890b0ed74f8e4d4a', 'request_id': 'req-b1997b94-f11f-4856-a07e-9289fb2831a6'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:27.026562 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-b1997b94-f11f-4856-a07e-9289fb2831a6 admin admin] The token cache is being invalidate because project 0f6cc05e7c024c86890b0ed74f8e4d4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:30:27.027156 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-b1997b94-f11f-4856-a07e-9289fb2831a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:27.027855 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-b1997b94-f11f-4856-a07e-9289fb2831a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:27.029567 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1263/2532] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:30:26 2022] DELETE /identity/v3/projects/0f6cc05e7c024c86890b0ed74f8e4d4a => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:27.043112 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5ccb1-720d-49ae-9a7f-bc2810f1c956 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:27.044256 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5ccb1-720d-49ae-9a7f-bc2810f1c956 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:27.044583 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5ccb1-720d-49ae-9a7f-bc2810f1c956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:27.071065 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-35e5ccb1-720d-49ae-9a7f-bc2810f1c956 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:27.072297 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-35e5ccb1-720d-49ae-9a7f-bc2810f1c956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:27.258779 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1270/2533] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:27.266485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33316d1-26b8-4a4b-ba6c-786944d6e89b None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:27.266792 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33316d1-26b8-4a4b-ba6c-786944d6e89b None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:27.267069 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33316d1-26b8-4a4b-ba6c-786944d6e89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:27.287074 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-c33316d1-26b8-4a4b-ba6c-786944d6e89b None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:27.289394 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-c33316d1-26b8-4a4b-ba6c-786944d6e89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:27.296054 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1264/2534] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:27.300211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5ccb1-720d-49ae-9a7f-bc2810f1c956 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:27.306175 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:27.310313 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5ccb1-720d-49ae-9a7f-bc2810f1c956 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:27.314895 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e6700-7ab0-4da3-ba0c-d46f97fdb8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:27.318979 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e6700-7ab0-4da3-ba0c-d46f97fdb8aa admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:27.318979 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e6700-7ab0-4da3-ba0c-d46f97fdb8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:27.318979 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e6700-7ab0-4da3-ba0c-d46f97fdb8aa admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:27.318979 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e6700-7ab0-4da3-ba0c-d46f97fdb8aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:30:27.318979 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e6700-7ab0-4da3-ba0c-d46f97fdb8aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:27.319478 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e6700-7ab0-4da3-ba0c-d46f97fdb8aa admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:27.330885 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1271/2535] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:30:27.335665 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33316d1-26b8-4a4b-ba6c-786944d6e89b None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:27.345708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33316d1-26b8-4a4b-ba6c-786944d6e89b None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:27.353655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98547bd9-e6b3-4f61-a494-887665d59d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:27.353655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98547bd9-e6b3-4f61-a494-887665d59d27 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:27.353655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98547bd9-e6b3-4f61-a494-887665d59d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:27.353655 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98547bd9-e6b3-4f61-a494-887665d59d27 admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:27.354049 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98547bd9-e6b3-4f61-a494-887665d59d27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:27.354319 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98547bd9-e6b3-4f61-a494-887665d59d27 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:27.497402 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1265/2536] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:30:27 2022] POST /identity/v3/projects => generated 399 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:30:27.497514 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e6700-7ab0-4da3-ba0c-d46f97fdb8aa admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:27.502840 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e6700-7ab0-4da3-ba0c-d46f97fdb8aa admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:27.564332 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7282b-b0ac-4564-9c2f-387656746e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:27.564934 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7282b-b0ac-4564-9c2f-387656746e61 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:27.565260 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7282b-b0ac-4564-9c2f-387656746e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:27.565533 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7282b-b0ac-4564-9c2f-387656746e61 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:27.566665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b7282b-b0ac-4564-9c2f-387656746e61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:27.568616 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b7282b-b0ac-4564-9c2f-387656746e61 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:27.659792 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1272/2537] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:30:27 2022] POST /identity/v3/users => generated 300 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:30:27.663548 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98547bd9-e6b3-4f61-a494-887665d59d27 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:27.672742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:27.677241 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98547bd9-e6b3-4f61-a494-887665d59d27 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:27.682350 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f122f2-368b-47aa-9192-259f44972b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:27.682962 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f122f2-368b-47aa-9192-259f44972b16 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:27.683245 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f122f2-368b-47aa-9192-259f44972b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:27.683521 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f122f2-368b-47aa-9192-259f44972b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:27.684204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f122f2-368b-47aa-9192-259f44972b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:27.685858 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f122f2-368b-47aa-9192-259f44972b16 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:27.696810 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1266/2538] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:30:27.701006 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7282b-b0ac-4564-9c2f-387656746e61 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:27.711064 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7282b-b0ac-4564-9c2f-387656746e61 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:27.716041 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a92fe9-633b-437f-ad39-ae512b3e9730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:27.716460 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a92fe9-633b-437f-ad39-ae512b3e9730 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:27.716740 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a92fe9-633b-437f-ad39-ae512b3e9730 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:27.717010 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a92fe9-633b-437f-ad39-ae512b3e9730 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:27.717700 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a92fe9-633b-437f-ad39-ae512b3e9730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:27.719442 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a92fe9-633b-437f-ad39-ae512b3e9730 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:27.733536 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1273/2539] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:30:27.737732 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f122f2-368b-47aa-9192-259f44972b16 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:27.748281 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f122f2-368b-47aa-9192-259f44972b16 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:27.753464 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d7f08-9af0-4baa-9a5b-a489399bb679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:27.759741 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d7f08-9af0-4baa-9a5b-a489399bb679 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:27.759741 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d7f08-9af0-4baa-9a5b-a489399bb679 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:27.759741 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d7f08-9af0-4baa-9a5b-a489399bb679 admin admin] PATH_INFO: `/v3/projects/efbb324842574d6e90c9862471369ea7/users/1e352f75a6e94ab3af16df66b3b0bd67/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:27.769868 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d7f08-9af0-4baa-9a5b-a489399bb679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efbb324842574d6e90c9862471369ea7, user_id=1e352f75a6e94ab3af16df66b3b0bd67, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:27.772726 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d7f08-9af0-4baa-9a5b-a489399bb679 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:27.873584 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1267/2540] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:30:27 2022] PUT /identity/v3/projects/efbb324842574d6e90c9862471369ea7/users/1e352f75a6e94ab3af16df66b3b0bd67/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:27.883869 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9f041-221d-461d-b736-c1e71326d9ed None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:27.884223 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9f041-221d-461d-b736-c1e71326d9ed None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:27.884506 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9f041-221d-461d-b736-c1e71326d9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:27.913659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-01b9f041-221d-461d-b736-c1e71326d9ed None None] MFA Rules not processed for user `1e352f75a6e94ab3af16df66b3b0bd67`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:27.915456 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-01b9f041-221d-461d-b736-c1e71326d9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:28.001136 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1274/2541] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:27 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:28.003454 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d7f08-9af0-4baa-9a5b-a489399bb679 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:28.070660 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d7f08-9af0-4baa-9a5b-a489399bb679 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:28.076795 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e725bc-3e43-4fd6-a2b6-1bcdc8908f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:28.079281 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e725bc-3e43-4fd6-a2b6-1bcdc8908f19 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:28.079281 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e725bc-3e43-4fd6-a2b6-1bcdc8908f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:28.079281 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e725bc-3e43-4fd6-a2b6-1bcdc8908f19 admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:28.079281 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e725bc-3e43-4fd6-a2b6-1bcdc8908f19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:28.080609 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e725bc-3e43-4fd6-a2b6-1bcdc8908f19 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:28.157144 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1268/2542] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:30:28 2022] POST /identity/v3/projects => generated 401 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:30:28.161639 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9f041-221d-461d-b736-c1e71326d9ed None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:28.172598 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9f041-221d-461d-b736-c1e71326d9ed None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:28.233984 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c33fd5-587b-467b-a813-d2a431cf503c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:28.234590 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c33fd5-587b-467b-a813-d2a431cf503c admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:28.234869 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c33fd5-587b-467b-a813-d2a431cf503c admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:28.235142 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c33fd5-587b-467b-a813-d2a431cf503c admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:28.235759 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c33fd5-587b-467b-a813-d2a431cf503c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:28.237696 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c33fd5-587b-467b-a813-d2a431cf503c admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:28.246138 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:28.325232 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1275/2543] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:30:28 2022] POST /identity/v3/users => generated 307 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:30:28.329365 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e725bc-3e43-4fd6-a2b6-1bcdc8908f19 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:28.340362 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e725bc-3e43-4fd6-a2b6-1bcdc8908f19 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:28.344970 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca8315-5d0d-4dbf-9bf7-b51069af36d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:28.345603 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca8315-5d0d-4dbf-9bf7-b51069af36d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:28.345885 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca8315-5d0d-4dbf-9bf7-b51069af36d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:28.346184 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca8315-5d0d-4dbf-9bf7-b51069af36d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:28.346908 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca8315-5d0d-4dbf-9bf7-b51069af36d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:28.349218 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca8315-5d0d-4dbf-9bf7-b51069af36d1 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:28.361044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1269/2544] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:30:28.365287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c33fd5-587b-467b-a813-d2a431cf503c admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:28.375677 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c33fd5-587b-467b-a813-d2a431cf503c admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:28.380367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8f253-66a3-41a4-bd73-94e85b7b385c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:28.381011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8f253-66a3-41a4-bd73-94e85b7b385c admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:28.381325 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8f253-66a3-41a4-bd73-94e85b7b385c admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:28.381599 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8f253-66a3-41a4-bd73-94e85b7b385c admin admin] PATH_INFO: `/v3/projects/fcafbe8a56ca40b89ebba3a7c5a3d324/users/a14a2c1046e945418b15f42fd0150dee/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:28.396640 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8f253-66a3-41a4-bd73-94e85b7b385c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcafbe8a56ca40b89ebba3a7c5a3d324, user_id=a14a2c1046e945418b15f42fd0150dee, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:28.399383 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8f253-66a3-41a4-bd73-94e85b7b385c admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:28.476282 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1276/2545] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:30:28 2022] PUT /identity/v3/projects/fcafbe8a56ca40b89ebba3a7c5a3d324/users/a14a2c1046e945418b15f42fd0150dee/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:30:28.480231 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca8315-5d0d-4dbf-9bf7-b51069af36d1 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:28.490541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca8315-5d0d-4dbf-9bf7-b51069af36d1 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:28.548998 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e83b9-0ad0-4ca5-a56e-8e6c65163626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:28.549656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e83b9-0ad0-4ca5-a56e-8e6c65163626 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:28.549937 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e83b9-0ad0-4ca5-a56e-8e6c65163626 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:28.550215 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e83b9-0ad0-4ca5-a56e-8e6c65163626 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:28.551036 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e83b9-0ad0-4ca5-a56e-8e6c65163626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:28.552764 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e83b9-0ad0-4ca5-a56e-8e6c65163626 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:28.563604 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1270/2546] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:30:28.567871 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8f253-66a3-41a4-bd73-94e85b7b385c admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:28.580830 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8f253-66a3-41a4-bd73-94e85b7b385c admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:28.586419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de648d87-8df5-4894-af00-a2f3784da526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:28.587238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de648d87-8df5-4894-af00-a2f3784da526 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:28.587673 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de648d87-8df5-4894-af00-a2f3784da526 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:28.588149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de648d87-8df5-4894-af00-a2f3784da526 admin admin] PATH_INFO: `/v3/projects/fcafbe8a56ca40b89ebba3a7c5a3d324/users/a14a2c1046e945418b15f42fd0150dee/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:28.590283 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de648d87-8df5-4894-af00-a2f3784da526 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcafbe8a56ca40b89ebba3a7c5a3d324, user_id=a14a2c1046e945418b15f42fd0150dee, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:28.593241 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de648d87-8df5-4894-af00-a2f3784da526 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:28.610083 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1277/2547] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:30:28 2022] PUT /identity/v3/projects/fcafbe8a56ca40b89ebba3a7c5a3d324/users/a14a2c1046e945418b15f42fd0150dee/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:28.621412 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accef491-1363-4508-bdb8-86b9d2fca531 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:28.621708 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accef491-1363-4508-bdb8-86b9d2fca531 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:28.621995 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accef491-1363-4508-bdb8-86b9d2fca531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:28.651445 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-accef491-1363-4508-bdb8-86b9d2fca531 None None] MFA Rules not processed for user `a14a2c1046e945418b15f42fd0150dee`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:28.652661 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-accef491-1363-4508-bdb8-86b9d2fca531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:28.682556 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:28.724581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1271/2548] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:28 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:28.737874 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de648d87-8df5-4894-af00-a2f3784da526 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:28.739632 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-de648d87-8df5-4894-af00-a2f3784da526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:28.806318 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de648d87-8df5-4894-af00-a2f3784da526 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:28.810222 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff198696-a0a5-4d52-aeb9-e9a099f28a78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:28.810825 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff198696-a0a5-4d52-aeb9-e9a099f28a78 service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:28.811104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff198696-a0a5-4d52-aeb9-e9a099f28a78 service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:28.811376 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff198696-a0a5-4d52-aeb9-e9a099f28a78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:28.820670 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff198696-a0a5-4d52-aeb9-e9a099f28a78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:28.822109 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff198696-a0a5-4d52-aeb9-e9a099f28a78 service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:28.831597 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1278/2549] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:30:28 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:30:29.089644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accef491-1363-4508-bdb8-86b9d2fca531 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:29.089644 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-accef491-1363-4508-bdb8-86b9d2fca531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:29.091257 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accef491-1363-4508-bdb8-86b9d2fca531 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:29.095703 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e62e9c-bb5b-40f4-90cb-d254fee31959 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:29.096319 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e62e9c-bb5b-40f4-90cb-d254fee31959 service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:29.096612 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e62e9c-bb5b-40f4-90cb-d254fee31959 service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:29.096923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e62e9c-bb5b-40f4-90cb-d254fee31959 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:29.160048 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e62e9c-bb5b-40f4-90cb-d254fee31959 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:29.161743 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e62e9c-bb5b-40f4-90cb-d254fee31959 service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:29.162403 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699c2d1-7764-49fa-affb-fa13fb88fb91 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:29.162852 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699c2d1-7764-49fa-affb-fa13fb88fb91 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:29.163104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699c2d1-7764-49fa-affb-fa13fb88fb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:29.173139 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1272/2550] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:30:29 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:30:29.186531 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-a699c2d1-7764-49fa-affb-fa13fb88fb91 None None] MFA Rules not processed for user `826b9a7c343b4dbc9aeb3dbc0b75fc92`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:29.191844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-a699c2d1-7764-49fa-affb-fa13fb88fb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:29.270644 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1279/2551] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 23 04:30:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:29.452066 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e62e9c-bb5b-40f4-90cb-d254fee31959 service cinder] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:29.453573 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-b8e62e9c-bb5b-40f4-90cb-d254fee31959 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:29.524325 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e62e9c-bb5b-40f4-90cb-d254fee31959 service cinder] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:29.529390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc2026-fa7c-4347-94a0-6ac87edcf9e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63190c62bc92403880ffaedc4737485a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:29.530009 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc2026-fa7c-4347-94a0-6ac87edcf9e2 service swift] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:29.530294 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc2026-fa7c-4347-94a0-6ac87edcf9e2 service swift] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:29.530596 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc2026-fa7c-4347-94a0-6ac87edcf9e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:29.545449 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fc2026-fa7c-4347-94a0-6ac87edcf9e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:29.547070 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fc2026-fa7c-4347-94a0-6ac87edcf9e2 service swift] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:29.556637 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1273/2552] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 23 04:30:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 04:30:34.696443 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699c2d1-7764-49fa-affb-fa13fb88fb91 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:34.812303 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699c2d1-7764-49fa-affb-fa13fb88fb91 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:34.819819 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1041546-0fcf-448d-99f0-b063a41d3752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:34.820606 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1041546-0fcf-448d-99f0-b063a41d3752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:34.820980 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1041546-0fcf-448d-99f0-b063a41d3752 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:34.821407 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1041546-0fcf-448d-99f0-b063a41d3752 admin admin] PATH_INFO: `/v3/users/1e352f75a6e94ab3af16df66b3b0bd67` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:34.823739 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1041546-0fcf-448d-99f0-b063a41d3752 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e352f75a6e94ab3af16df66b3b0bd67)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:34.826028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1041546-0fcf-448d-99f0-b063a41d3752 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:34.828766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:35.088964 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-f1041546-0fcf-448d-99f0-b063a41d3752 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e352f75a6e94ab3af16df66b3b0bd67'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:35.162180 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-f1041546-0fcf-448d-99f0-b063a41d3752 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e352f75a6e94ab3af16df66b3b0bd67'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:35.172281 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-f1041546-0fcf-448d-99f0-b063a41d3752 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e352f75a6e94ab3af16df66b3b0bd67'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:35.200748 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-f1041546-0fcf-448d-99f0-b063a41d3752 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e352f75a6e94ab3af16df66b3b0bd67'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:35.200953 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-f1041546-0fcf-448d-99f0-b063a41d3752 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e352f75a6e94ab3af16df66b3b0bd67'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:35.218256 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1280/2553] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:30:34 2022] DELETE /identity/v3/users/1e352f75a6e94ab3af16df66b3b0bd67 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:35.224685 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856631d-de8c-44bd-b35e-8aa85ae9b42e None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:35.224685 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856631d-de8c-44bd-b35e-8aa85ae9b42e None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:35.224685 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856631d-de8c-44bd-b35e-8aa85ae9b42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:35.259126 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-c856631d-de8c-44bd-b35e-8aa85ae9b42e None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:35.260457 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-c856631d-de8c-44bd-b35e-8aa85ae9b42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:35.345359 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:35.367288 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1274/2554] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:30:35.377618 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1041546-0fcf-448d-99f0-b063a41d3752 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:35.380218 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-f1041546-0fcf-448d-99f0-b063a41d3752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:35.450736 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1041546-0fcf-448d-99f0-b063a41d3752 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:35.463242 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccef6b-10e0-4c73-9255-6be0d6136941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:35.464010 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccef6b-10e0-4c73-9255-6be0d6136941 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:35.464305 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccef6b-10e0-4c73-9255-6be0d6136941 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:35.464582 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccef6b-10e0-4c73-9255-6be0d6136941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:35.475628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ccef6b-10e0-4c73-9255-6be0d6136941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:35.481442 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ccef6b-10e0-4c73-9255-6be0d6136941 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:35.493979 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1281/2555] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:30:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:30:36.060636 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856631d-de8c-44bd-b35e-8aa85ae9b42e None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:36.063625 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-c856631d-de8c-44bd-b35e-8aa85ae9b42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:36.087381 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856631d-de8c-44bd-b35e-8aa85ae9b42e None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:36.092705 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbed77-74e0-4c93-893a-e0547b8e9ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:36.093850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbed77-74e0-4c93-893a-e0547b8e9ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:36.094112 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbed77-74e0-4c93-893a-e0547b8e9ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:36.094450 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbed77-74e0-4c93-893a-e0547b8e9ab4 admin admin] PATH_INFO: `/v3/projects/efbb324842574d6e90c9862471369ea7` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:36.095716 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfbed77-74e0-4c93-893a-e0547b8e9ab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efbb324842574d6e90c9862471369ea7)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:36.098970 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfbed77-74e0-4c93-893a-e0547b8e9ab4 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:36.246356 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-bdfbed77-74e0-4c93-893a-e0547b8e9ab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efbb324842574d6e90c9862471369ea7', 'request_id': 'req-bdfbed77-74e0-4c93-893a-e0547b8e9ab4'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:36.255570 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-bdfbed77-74e0-4c93-893a-e0547b8e9ab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efbb324842574d6e90c9862471369ea7', 'request_id': 'req-bdfbed77-74e0-4c93-893a-e0547b8e9ab4'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:36.266904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-bdfbed77-74e0-4c93-893a-e0547b8e9ab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efbb324842574d6e90c9862471369ea7', 'request_id': 'req-bdfbed77-74e0-4c93-893a-e0547b8e9ab4'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:36.882689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-bdfbed77-74e0-4c93-893a-e0547b8e9ab4 admin admin] The token cache is being invalidate because project efbb324842574d6e90c9862471369ea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:30:36.882689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-bdfbed77-74e0-4c93-893a-e0547b8e9ab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:36.882689 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-bdfbed77-74e0-4c93-893a-e0547b8e9ab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:36.883694 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1275/2556] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:30:36 2022] DELETE /identity/v3/projects/efbb324842574d6e90c9862471369ea7 => generated 0 bytes in 824 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:36.887562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccef6b-10e0-4c73-9255-6be0d6136941 service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:36.897164 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccef6b-10e0-4c73-9255-6be0d6136941 service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:36.966415 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966afe96-a8b9-4b72-947b-0fe7ad88f039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:36.968608 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966afe96-a8b9-4b72-947b-0fe7ad88f039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:36.968608 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966afe96-a8b9-4b72-947b-0fe7ad88f039 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:36.968608 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966afe96-a8b9-4b72-947b-0fe7ad88f039 admin admin] PATH_INFO: `/v3/users/a14a2c1046e945418b15f42fd0150dee` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:36.968858 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966afe96-a8b9-4b72-947b-0fe7ad88f039 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a14a2c1046e945418b15f42fd0150dee)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:36.970721 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966afe96-a8b9-4b72-947b-0fe7ad88f039 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:37.002476 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:37.181848 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-966afe96-a8b9-4b72-947b-0fe7ad88f039 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a14a2c1046e945418b15f42fd0150dee'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:37.258884 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-966afe96-a8b9-4b72-947b-0fe7ad88f039 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a14a2c1046e945418b15f42fd0150dee'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:37.273647 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-966afe96-a8b9-4b72-947b-0fe7ad88f039 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a14a2c1046e945418b15f42fd0150dee'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:37.292555 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-966afe96-a8b9-4b72-947b-0fe7ad88f039 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a14a2c1046e945418b15f42fd0150dee'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:37.293330 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-966afe96-a8b9-4b72-947b-0fe7ad88f039 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a14a2c1046e945418b15f42fd0150dee'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:37.300073 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1282/2557] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:30:36 2022] DELETE /identity/v3/users/a14a2c1046e945418b15f42fd0150dee => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:37.822108 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbed77-74e0-4c93-893a-e0547b8e9ab4 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:37.823768 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-bdfbed77-74e0-4c93-893a-e0547b8e9ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:37.850159 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbed77-74e0-4c93-893a-e0547b8e9ab4 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:37.962030 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98911f42-3739-4b6f-8ce6-925b5c658ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:37.963411 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98911f42-3739-4b6f-8ce6-925b5c658ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:37.963411 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98911f42-3739-4b6f-8ce6-925b5c658ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:37.963769 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98911f42-3739-4b6f-8ce6-925b5c658ad7 admin admin] PATH_INFO: `/v3/projects/fcafbe8a56ca40b89ebba3a7c5a3d324` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:37.965267 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98911f42-3739-4b6f-8ce6-925b5c658ad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcafbe8a56ca40b89ebba3a7c5a3d324)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:37.967280 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98911f42-3739-4b6f-8ce6-925b5c658ad7 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:38.145319 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-98911f42-3739-4b6f-8ce6-925b5c658ad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcafbe8a56ca40b89ebba3a7c5a3d324', 'request_id': 'req-98911f42-3739-4b6f-8ce6-925b5c658ad7'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:38.151943 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-98911f42-3739-4b6f-8ce6-925b5c658ad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcafbe8a56ca40b89ebba3a7c5a3d324', 'request_id': 'req-98911f42-3739-4b6f-8ce6-925b5c658ad7'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:38.157893 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-98911f42-3739-4b6f-8ce6-925b5c658ad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcafbe8a56ca40b89ebba3a7c5a3d324', 'request_id': 'req-98911f42-3739-4b6f-8ce6-925b5c658ad7'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:38.226570 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-98911f42-3739-4b6f-8ce6-925b5c658ad7 admin admin] The token cache is being invalidate because project fcafbe8a56ca40b89ebba3a7c5a3d324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:30:38.226923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-98911f42-3739-4b6f-8ce6-925b5c658ad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:38.227683 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-98911f42-3739-4b6f-8ce6-925b5c658ad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:38.229144 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1276/2558] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:30:37 2022] DELETE /identity/v3/projects/fcafbe8a56ca40b89ebba3a7c5a3d324 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:38.234107 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e20b7-0d7c-490e-93e6-76484c62e4ec None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:38.234688 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e20b7-0d7c-490e-93e6-76484c62e4ec None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:38.234944 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e20b7-0d7c-490e-93e6-76484c62e4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:38.264510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-0d6e20b7-0d7c-490e-93e6-76484c62e4ec None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:38.265945 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-0d6e20b7-0d7c-490e-93e6-76484c62e4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:38.345648 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1283/2559] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:38.353318 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb0067-bca9-4712-ba99-8cd7d714331e None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:38.354200 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb0067-bca9-4712-ba99-8cd7d714331e None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:38.354690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb0067-bca9-4712-ba99-8cd7d714331e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:38.380117 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:38.391262 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-c1bb0067-bca9-4712-ba99-8cd7d714331e None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:38.392691 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-c1bb0067-bca9-4712-ba99-8cd7d714331e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:38.403095 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1277/2560] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:30:38.407674 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e20b7-0d7c-490e-93e6-76484c62e4ec None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:38.421297 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e20b7-0d7c-490e-93e6-76484c62e4ec None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:38.426097 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78675011-56d5-443a-bf12-de6da4b78990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:38.426882 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78675011-56d5-443a-bf12-de6da4b78990 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:38.427180 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78675011-56d5-443a-bf12-de6da4b78990 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:38.427456 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78675011-56d5-443a-bf12-de6da4b78990 admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:38.428111 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78675011-56d5-443a-bf12-de6da4b78990 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:30:38.428419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78675011-56d5-443a-bf12-de6da4b78990 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:38.430111 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78675011-56d5-443a-bf12-de6da4b78990 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:38.450519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1284/2561] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:30:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:30:38.454996 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb0067-bca9-4712-ba99-8cd7d714331e None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:38.471389 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb0067-bca9-4712-ba99-8cd7d714331e None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:38.476946 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01facfa6-7b28-4429-ad62-b90d5a587c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:38.477677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01facfa6-7b28-4429-ad62-b90d5a587c43 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:38.478033 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01facfa6-7b28-4429-ad62-b90d5a587c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:38.478399 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01facfa6-7b28-4429-ad62-b90d5a587c43 admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:38.479106 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01facfa6-7b28-4429-ad62-b90d5a587c43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:38.481124 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01facfa6-7b28-4429-ad62-b90d5a587c43 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:38.611824 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1278/2562] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:30:38 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:30:38.612044 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78675011-56d5-443a-bf12-de6da4b78990 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:38.618193 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78675011-56d5-443a-bf12-de6da4b78990 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:38.690336 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908af07-3a8a-4e53-a015-4ce111a88f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:38.691100 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908af07-3a8a-4e53-a015-4ce111a88f9c admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:38.691491 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908af07-3a8a-4e53-a015-4ce111a88f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:38.691981 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908af07-3a8a-4e53-a015-4ce111a88f9c admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:38.692727 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9908af07-3a8a-4e53-a015-4ce111a88f9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:38.694849 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9908af07-3a8a-4e53-a015-4ce111a88f9c admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:38.794646 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1285/2563] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:30:38 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:30:38.798699 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01facfa6-7b28-4429-ad62-b90d5a587c43 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:38.810650 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01facfa6-7b28-4429-ad62-b90d5a587c43 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:38.816018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f4ca0-1c09-4e62-b1df-2140a63f4c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:38.816641 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f4ca0-1c09-4e62-b1df-2140a63f4c70 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:38.816924 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f4ca0-1c09-4e62-b1df-2140a63f4c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:38.817236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f4ca0-1c09-4e62-b1df-2140a63f4c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:38.817892 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f4ca0-1c09-4e62-b1df-2140a63f4c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:38.819488 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f4ca0-1c09-4e62-b1df-2140a63f4c70 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:38.832336 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1279/2564] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:30:38.836502 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908af07-3a8a-4e53-a015-4ce111a88f9c admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:38.846991 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908af07-3a8a-4e53-a015-4ce111a88f9c admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:38.852302 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292161a4-d675-4f54-9600-539253be0735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:38.852916 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292161a4-d675-4f54-9600-539253be0735 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:38.853243 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292161a4-d675-4f54-9600-539253be0735 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:38.853522 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292161a4-d675-4f54-9600-539253be0735 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:38.854166 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292161a4-d675-4f54-9600-539253be0735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:38.855761 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292161a4-d675-4f54-9600-539253be0735 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:38.867011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1286/2565] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:30:38.871315 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f4ca0-1c09-4e62-b1df-2140a63f4c70 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:38.881819 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f4ca0-1c09-4e62-b1df-2140a63f4c70 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:38.888813 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63559754-998f-4899-9ad2-d7d13fca0d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:38.888813 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63559754-998f-4899-9ad2-d7d13fca0d4c admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:38.889061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63559754-998f-4899-9ad2-d7d13fca0d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:38.890827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63559754-998f-4899-9ad2-d7d13fca0d4c admin admin] PATH_INFO: `/v3/projects/6a19061b1fde418d80c81256b78469f5/users/fd857f59228a442590edd470ab978542/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:38.908155 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63559754-998f-4899-9ad2-d7d13fca0d4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a19061b1fde418d80c81256b78469f5, user_id=fd857f59228a442590edd470ab978542, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:38.911870 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63559754-998f-4899-9ad2-d7d13fca0d4c admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:38.984294 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1280/2566] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:30:38 2022] PUT /identity/v3/projects/6a19061b1fde418d80c81256b78469f5/users/fd857f59228a442590edd470ab978542/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:39.000024 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbd120-fdfa-4805-82be-c7be2b70c949 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:39.000024 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbd120-fdfa-4805-82be-c7be2b70c949 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:39.000333 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbd120-fdfa-4805-82be-c7be2b70c949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:39.024211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:39.053720 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-62fbd120-fdfa-4805-82be-c7be2b70c949 None None] MFA Rules not processed for user `fd857f59228a442590edd470ab978542`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:39.056554 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-62fbd120-fdfa-4805-82be-c7be2b70c949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:39.158515 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1287/2567] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:39.159528 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63559754-998f-4899-9ad2-d7d13fca0d4c admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:39.258692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63559754-998f-4899-9ad2-d7d13fca0d4c admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:39.273953 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630031a-029b-4201-95d4-37ba89738506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:39.274794 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630031a-029b-4201-95d4-37ba89738506 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:39.275298 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630031a-029b-4201-95d4-37ba89738506 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:39.275737 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630031a-029b-4201-95d4-37ba89738506 admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:39.276539 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630031a-029b-4201-95d4-37ba89738506 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:39.279017 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630031a-029b-4201-95d4-37ba89738506 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:39.410382 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1281/2568] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:30:39 2022] POST /identity/v3/projects => generated 377 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:30:39.411820 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbd120-fdfa-4805-82be-c7be2b70c949 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:39.422982 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbd120-fdfa-4805-82be-c7be2b70c949 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:39.493602 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36d8c4-1587-4aa6-8b91-35900103cd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:39.494315 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36d8c4-1587-4aa6-8b91-35900103cd09 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:39.494677 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36d8c4-1587-4aa6-8b91-35900103cd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:39.495017 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36d8c4-1587-4aa6-8b91-35900103cd09 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:39.495763 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36d8c4-1587-4aa6-8b91-35900103cd09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:39.497910 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36d8c4-1587-4aa6-8b91-35900103cd09 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:39.599385 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1288/2569] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:30:39 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:30:39.600873 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630031a-029b-4201-95d4-37ba89738506 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:39.614647 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630031a-029b-4201-95d4-37ba89738506 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:39.631203 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cd971-05be-46ba-a6b7-01a43ed8349b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:39.632122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cd971-05be-46ba-a6b7-01a43ed8349b admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:39.632555 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cd971-05be-46ba-a6b7-01a43ed8349b admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:39.633002 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cd971-05be-46ba-a6b7-01a43ed8349b admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:39.633947 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6cd971-05be-46ba-a6b7-01a43ed8349b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:39.635904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6cd971-05be-46ba-a6b7-01a43ed8349b admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:39.655638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1282/2570] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:30:39.656484 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36d8c4-1587-4aa6-8b91-35900103cd09 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:39.669578 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36d8c4-1587-4aa6-8b91-35900103cd09 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:39.676533 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f18e5-be73-4b80-bf03-1eae7432d808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:39.677182 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f18e5-be73-4b80-bf03-1eae7432d808 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:39.677475 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f18e5-be73-4b80-bf03-1eae7432d808 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:39.677759 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f18e5-be73-4b80-bf03-1eae7432d808 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:39.678417 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f18e5-be73-4b80-bf03-1eae7432d808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:39.680080 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f18e5-be73-4b80-bf03-1eae7432d808 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:39.693145 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1289/2571] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:30:39.697348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cd971-05be-46ba-a6b7-01a43ed8349b admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:39.711761 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cd971-05be-46ba-a6b7-01a43ed8349b admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:39.717904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af4009-4521-4b8f-80dd-77efd5852cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:39.718581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af4009-4521-4b8f-80dd-77efd5852cdf admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:39.718929 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af4009-4521-4b8f-80dd-77efd5852cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:39.719214 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af4009-4521-4b8f-80dd-77efd5852cdf admin admin] PATH_INFO: `/v3/projects/8f247ee6e66d46babd59e446f7e25676/users/3460a7af07ca4f6a93c81fd4ed8f8238/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:39.739507 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af4009-4521-4b8f-80dd-77efd5852cdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f247ee6e66d46babd59e446f7e25676, user_id=3460a7af07ca4f6a93c81fd4ed8f8238, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:39.742441 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af4009-4521-4b8f-80dd-77efd5852cdf admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:39.802961 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1283/2572] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:30:39 2022] PUT /identity/v3/projects/8f247ee6e66d46babd59e446f7e25676/users/3460a7af07ca4f6a93c81fd4ed8f8238/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:30:39.814053 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b25440-dabb-4d46-bf98-a65dce4aa67f None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:39.814403 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b25440-dabb-4d46-bf98-a65dce4aa67f None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:39.814689 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b25440-dabb-4d46-bf98-a65dce4aa67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:39.849606 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-c7b25440-dabb-4d46-bf98-a65dce4aa67f None None] MFA Rules not processed for user `3460a7af07ca4f6a93c81fd4ed8f8238`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:39.850988 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c7b25440-dabb-4d46-bf98-a65dce4aa67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:39.923789 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1290/2573] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:39.928459 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af4009-4521-4b8f-80dd-77efd5852cdf admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:39.990676 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:40.000842 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af4009-4521-4b8f-80dd-77efd5852cdf admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:40.006182 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141fb82-8238-4efb-9993-a93d269c8d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:40.006796 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141fb82-8238-4efb-9993-a93d269c8d81 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:40.007080 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141fb82-8238-4efb-9993-a93d269c8d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:40.007356 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141fb82-8238-4efb-9993-a93d269c8d81 admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:40.007997 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141fb82-8238-4efb-9993-a93d269c8d81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:40.009961 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141fb82-8238-4efb-9993-a93d269c8d81 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:40.222804 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1284/2574] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:30:39 2022] POST /identity/v3/projects => generated 379 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:30:40.223880 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b25440-dabb-4d46-bf98-a65dce4aa67f None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:40.230659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:40.234750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b25440-dabb-4d46-bf98-a65dce4aa67f None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:40.290461 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924793a1-5cd4-4560-91ec-c389ec4e012d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:40.291075 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924793a1-5cd4-4560-91ec-c389ec4e012d admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:40.291355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924793a1-5cd4-4560-91ec-c389ec4e012d admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:40.291627 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924793a1-5cd4-4560-91ec-c389ec4e012d admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:40.292250 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924793a1-5cd4-4560-91ec-c389ec4e012d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:40.294202 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924793a1-5cd4-4560-91ec-c389ec4e012d admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:40.395330 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1291/2575] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:30:40 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:30:40.395982 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141fb82-8238-4efb-9993-a93d269c8d81 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:40.413916 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141fb82-8238-4efb-9993-a93d269c8d81 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:40.426562 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0444da-23ce-4491-bd4f-9252aa2163b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:40.427317 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0444da-23ce-4491-bd4f-9252aa2163b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:40.427696 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0444da-23ce-4491-bd4f-9252aa2163b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:40.428263 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0444da-23ce-4491-bd4f-9252aa2163b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:40.429210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0444da-23ce-4491-bd4f-9252aa2163b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:40.431082 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0444da-23ce-4491-bd4f-9252aa2163b5 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:40.450824 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924793a1-5cd4-4560-91ec-c389ec4e012d admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:40.468854 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1285/2576] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:30:40.471168 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924793a1-5cd4-4560-91ec-c389ec4e012d admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:40.478642 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75acb89-9d63-447a-9555-87866dd224dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:40.480093 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75acb89-9d63-447a-9555-87866dd224dd admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:40.481199 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75acb89-9d63-447a-9555-87866dd224dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:40.481668 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75acb89-9d63-447a-9555-87866dd224dd admin admin] PATH_INFO: `/v3/projects/4ee2907ed60f4eed81b968507cc670dc/users/36eba377b109451a99c243382c4228b1/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:40.513849 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75acb89-9d63-447a-9555-87866dd224dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee2907ed60f4eed81b968507cc670dc, user_id=36eba377b109451a99c243382c4228b1, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:40.517512 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75acb89-9d63-447a-9555-87866dd224dd admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:40.580306 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1292/2577] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:30:40 2022] PUT /identity/v3/projects/4ee2907ed60f4eed81b968507cc670dc/users/36eba377b109451a99c243382c4228b1/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:40.585147 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0444da-23ce-4491-bd4f-9252aa2163b5 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:40.603143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0444da-23ce-4491-bd4f-9252aa2163b5 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:40.678413 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b544a-cc1e-44b3-b865-4f0ce5593754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:40.679050 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b544a-cc1e-44b3-b865-4f0ce5593754 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:40.679342 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b544a-cc1e-44b3-b865-4f0ce5593754 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:40.679673 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b544a-cc1e-44b3-b865-4f0ce5593754 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:40.680334 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b544a-cc1e-44b3-b865-4f0ce5593754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:40.682024 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b544a-cc1e-44b3-b865-4f0ce5593754 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:40.697940 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1286/2578] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:30:40.699576 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75acb89-9d63-447a-9555-87866dd224dd admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:40.713194 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75acb89-9d63-447a-9555-87866dd224dd admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:40.718004 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2ad22-d202-4eec-9007-d61d7e257cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:40.718803 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2ad22-d202-4eec-9007-d61d7e257cb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:40.719089 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2ad22-d202-4eec-9007-d61d7e257cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:40.719372 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2ad22-d202-4eec-9007-d61d7e257cb0 admin admin] PATH_INFO: `/v3/projects/4ee2907ed60f4eed81b968507cc670dc/users/36eba377b109451a99c243382c4228b1/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:40.721786 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2ad22-d202-4eec-9007-d61d7e257cb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee2907ed60f4eed81b968507cc670dc, user_id=36eba377b109451a99c243382c4228b1, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:40.725023 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2ad22-d202-4eec-9007-d61d7e257cb0 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:40.738460 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1293/2579] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:30:40 2022] PUT /identity/v3/projects/4ee2907ed60f4eed81b968507cc670dc/users/36eba377b109451a99c243382c4228b1/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:30:40.749782 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ea60b-0aa5-42d3-899c-2c196f88ce75 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:40.750374 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ea60b-0aa5-42d3-899c-2c196f88ce75 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:40.751009 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ea60b-0aa5-42d3-899c-2c196f88ce75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:40.797709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-648ea60b-0aa5-42d3-899c-2c196f88ce75 None None] MFA Rules not processed for user `36eba377b109451a99c243382c4228b1`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:40.799144 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-648ea60b-0aa5-42d3-899c-2c196f88ce75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:40.932052 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1287/2580] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:40 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:30:40.943179 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2ad22-d202-4eec-9007-d61d7e257cb0 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:40.950171 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-4ff2ad22-d202-4eec-9007-d61d7e257cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:41.019667 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2ad22-d202-4eec-9007-d61d7e257cb0 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:41.023850 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f040aa-e87b-4e35-87a0-c5c45bb298e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:41.026667 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f040aa-e87b-4e35-87a0-c5c45bb298e9 service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:41.026667 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f040aa-e87b-4e35-87a0-c5c45bb298e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:41.026667 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f040aa-e87b-4e35-87a0-c5c45bb298e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:41.036756 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f040aa-e87b-4e35-87a0-c5c45bb298e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:41.038269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f040aa-e87b-4e35-87a0-c5c45bb298e9 service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:41.049669 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1294/2581] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:30:40 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:30:41.237814 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ea60b-0aa5-42d3-899c-2c196f88ce75 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:41.239292 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-648ea60b-0aa5-42d3-899c-2c196f88ce75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:41.253828 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ea60b-0aa5-42d3-899c-2c196f88ce75 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:41.257825 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd4ba5-2572-4495-87e4-e5c365168d87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:41.258566 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd4ba5-2572-4495-87e4-e5c365168d87 service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:41.258859 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd4ba5-2572-4495-87e4-e5c365168d87 service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:41.259187 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd4ba5-2572-4495-87e4-e5c365168d87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:41.313300 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:41.327013 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd4ba5-2572-4495-87e4-e5c365168d87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:41.328478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd4ba5-2572-4495-87e4-e5c365168d87 service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:41.338512 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1288/2582] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:30:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:30:41.984793 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f040aa-e87b-4e35-87a0-c5c45bb298e9 service cinder] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:41.986290 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-18f040aa-e87b-4e35-87a0-c5c45bb298e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:42.048317 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f040aa-e87b-4e35-87a0-c5c45bb298e9 service cinder] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:42.052922 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02762b2b-9ab7-4ec0-8d99-e254fe7e79a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:42.053592 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02762b2b-9ab7-4ec0-8d99-e254fe7e79a8 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:42.053872 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02762b2b-9ab7-4ec0-8d99-e254fe7e79a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:42.054142 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02762b2b-9ab7-4ec0-8d99-e254fe7e79a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:42.055924 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-02762b2b-9ab7-4ec0-8d99-e254fe7e79a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:42.079562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:42.154473 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02762b2b-9ab7-4ec0-8d99-e254fe7e79a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:42.156068 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02762b2b-9ab7-4ec0-8d99-e254fe7e79a8 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:42.167499 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1295/2583] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:30:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:30:45.794883 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd4ba5-2572-4495-87e4-e5c365168d87 service cinder] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:45.884369 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd4ba5-2572-4495-87e4-e5c365168d87 service cinder] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:45.892854 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bfedc-1031-4409-9eba-4f7ab80f9fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:45.892854 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bfedc-1031-4409-9eba-4f7ab80f9fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:45.892854 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bfedc-1031-4409-9eba-4f7ab80f9fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:45.892854 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bfedc-1031-4409-9eba-4f7ab80f9fb5 admin admin] PATH_INFO: `/v3/users/fd857f59228a442590edd470ab978542` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:45.893299 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590bfedc-1031-4409-9eba-4f7ab80f9fb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd857f59228a442590edd470ab978542)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:45.894486 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590bfedc-1031-4409-9eba-4f7ab80f9fb5 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:46.166422 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-590bfedc-1031-4409-9eba-4f7ab80f9fb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd857f59228a442590edd470ab978542'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:46.166422 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-590bfedc-1031-4409-9eba-4f7ab80f9fb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd857f59228a442590edd470ab978542'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:46.182100 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-590bfedc-1031-4409-9eba-4f7ab80f9fb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd857f59228a442590edd470ab978542'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:46.183624 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-590bfedc-1031-4409-9eba-4f7ab80f9fb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd857f59228a442590edd470ab978542'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:46.209919 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-590bfedc-1031-4409-9eba-4f7ab80f9fb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd857f59228a442590edd470ab978542'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:46.313928 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1289/2584] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:30:45 2022] DELETE /identity/v3/users/fd857f59228a442590edd470ab978542 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:46.315845 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f54918-7bf8-426f-a7c7-80f1ffc49c0e None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:46.316673 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f54918-7bf8-426f-a7c7-80f1ffc49c0e None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:46.317022 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f54918-7bf8-426f-a7c7-80f1ffc49c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:46.423995 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-49f54918-7bf8-426f-a7c7-80f1ffc49c0e None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:46.425731 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-49f54918-7bf8-426f-a7c7-80f1ffc49c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:46.540857 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1296/2585] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:30:46.558171 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bfedc-1031-4409-9eba-4f7ab80f9fb5 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:46.559674 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-590bfedc-1031-4409-9eba-4f7ab80f9fb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:46.676435 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bfedc-1031-4409-9eba-4f7ab80f9fb5 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:46.681323 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338e06c-dd28-461a-a556-ec19122af7a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:46.681323 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338e06c-dd28-461a-a556-ec19122af7a1 service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:46.681660 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338e06c-dd28-461a-a556-ec19122af7a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:46.682051 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338e06c-dd28-461a-a556-ec19122af7a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:46.693105 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c338e06c-dd28-461a-a556-ec19122af7a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:46.695743 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c338e06c-dd28-461a-a556-ec19122af7a1 service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:46.699218 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:46.707667 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1290/2586] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:30:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:30:46.916283 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f54918-7bf8-426f-a7c7-80f1ffc49c0e None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:46.917797 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-49f54918-7bf8-426f-a7c7-80f1ffc49c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:46.943543 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f54918-7bf8-426f-a7c7-80f1ffc49c0e None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:46.961287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7e79f-b09a-4310-9ac5-a3e3d0618b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:46.961940 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7e79f-b09a-4310-9ac5-a3e3d0618b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:46.962672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7e79f-b09a-4310-9ac5-a3e3d0618b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:46.962672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7e79f-b09a-4310-9ac5-a3e3d0618b9c admin admin] PATH_INFO: `/v3/users/34e3236e7dfc447fb287403a386d33da` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:46.963747 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7e79f-b09a-4310-9ac5-a3e3d0618b9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=34e3236e7dfc447fb287403a386d33da)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:46.965673 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7e79f-b09a-4310-9ac5-a3e3d0618b9c admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:47.182910 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-5fe7e79f-b09a-4310-9ac5-a3e3d0618b9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34e3236e7dfc447fb287403a386d33da'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:47.222710 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338e06c-dd28-461a-a556-ec19122af7a1 service neutron] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:47.225753 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-c338e06c-dd28-461a-a556-ec19122af7a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:47.241624 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338e06c-dd28-461a-a556-ec19122af7a1 service neutron] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:47.252898 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af111381-1f27-4d1a-85b6-041fadc796cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:47.252898 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af111381-1f27-4d1a-85b6-041fadc796cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:47.252898 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af111381-1f27-4d1a-85b6-041fadc796cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:47.252898 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af111381-1f27-4d1a-85b6-041fadc796cd admin admin] PATH_INFO: `/v3/projects/6a19061b1fde418d80c81256b78469f5` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:47.254320 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af111381-1f27-4d1a-85b6-041fadc796cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a19061b1fde418d80c81256b78469f5)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:47.254320 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af111381-1f27-4d1a-85b6-041fadc796cd admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:47.292458 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-5fe7e79f-b09a-4310-9ac5-a3e3d0618b9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34e3236e7dfc447fb287403a386d33da'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:47.302351 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-5fe7e79f-b09a-4310-9ac5-a3e3d0618b9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34e3236e7dfc447fb287403a386d33da'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:47.324151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:47.324995 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-5fe7e79f-b09a-4310-9ac5-a3e3d0618b9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34e3236e7dfc447fb287403a386d33da'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:47.328028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-5fe7e79f-b09a-4310-9ac5-a3e3d0618b9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34e3236e7dfc447fb287403a386d33da'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:47.332865 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1297/2587] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:30:46 2022] DELETE /identity/v3/users/34e3236e7dfc447fb287403a386d33da => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:47.371599 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-af111381-1f27-4d1a-85b6-041fadc796cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a19061b1fde418d80c81256b78469f5', 'request_id': 'req-af111381-1f27-4d1a-85b6-041fadc796cd'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:47.380605 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-af111381-1f27-4d1a-85b6-041fadc796cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a19061b1fde418d80c81256b78469f5', 'request_id': 'req-af111381-1f27-4d1a-85b6-041fadc796cd'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:47.387270 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-af111381-1f27-4d1a-85b6-041fadc796cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a19061b1fde418d80c81256b78469f5', 'request_id': 'req-af111381-1f27-4d1a-85b6-041fadc796cd'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:47.408591 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7e79f-b09a-4310-9ac5-a3e3d0618b9c admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:47.410323 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-5fe7e79f-b09a-4310-9ac5-a3e3d0618b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:47.479282 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7e79f-b09a-4310-9ac5-a3e3d0618b9c admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:47.522630 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-af111381-1f27-4d1a-85b6-041fadc796cd admin admin] The token cache is being invalidate because project 6a19061b1fde418d80c81256b78469f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:30:47.522932 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-af111381-1f27-4d1a-85b6-041fadc796cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:47.523719 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-af111381-1f27-4d1a-85b6-041fadc796cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:47.525126 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1291/2588] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:30:47 2022] DELETE /identity/v3/projects/6a19061b1fde418d80c81256b78469f5 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:47.529202 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af111381-1f27-4d1a-85b6-041fadc796cd admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:47.533616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-af111381-1f27-4d1a-85b6-041fadc796cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:47.549486 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80ad60-47b3-4a87-99b4-93a1916b17cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:47.550836 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80ad60-47b3-4a87-99b4-93a1916b17cd service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:47.551513 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80ad60-47b3-4a87-99b4-93a1916b17cd service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:47.552076 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80ad60-47b3-4a87-99b4-93a1916b17cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:47.553943 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-0f80ad60-47b3-4a87-99b4-93a1916b17cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:47.564155 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80ad60-47b3-4a87-99b4-93a1916b17cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:47.565642 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80ad60-47b3-4a87-99b4-93a1916b17cd service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:47.574294 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1298/2589] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:30:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:30:47.605859 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af111381-1f27-4d1a-85b6-041fadc796cd admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:47.612050 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6728e-34c7-489c-bf15-6ff60b355d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:47.614053 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6728e-34c7-489c-bf15-6ff60b355d36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:47.614173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6728e-34c7-489c-bf15-6ff60b355d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:47.614502 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6728e-34c7-489c-bf15-6ff60b355d36 admin admin] PATH_INFO: `/v3/users/3460a7af07ca4f6a93c81fd4ed8f8238` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:47.615842 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6728e-34c7-489c-bf15-6ff60b355d36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3460a7af07ca4f6a93c81fd4ed8f8238)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:47.617944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6728e-34c7-489c-bf15-6ff60b355d36 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:47.624417 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80ad60-47b3-4a87-99b4-93a1916b17cd service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:47.628169 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-0f80ad60-47b3-4a87-99b4-93a1916b17cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:47.652578 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80ad60-47b3-4a87-99b4-93a1916b17cd service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:47.658822 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69020f-f975-4846-855c-4c470608854d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:47.659368 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69020f-f975-4846-855c-4c470608854d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:47.660176 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69020f-f975-4846-855c-4c470608854d admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:47.660466 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69020f-f975-4846-855c-4c470608854d admin admin] PATH_INFO: `/v3/projects/9c5a2da9f32b41229ebee8a3cc2f6d54` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:47.661952 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69020f-f975-4846-855c-4c470608854d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c5a2da9f32b41229ebee8a3cc2f6d54)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:47.665679 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69020f-f975-4846-855c-4c470608854d admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:47.849574 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-5d69020f-f975-4846-855c-4c470608854d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c5a2da9f32b41229ebee8a3cc2f6d54', 'request_id': 'req-5d69020f-f975-4846-855c-4c470608854d'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:47.849759 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-d7e6728e-34c7-489c-bf15-6ff60b355d36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3460a7af07ca4f6a93c81fd4ed8f8238'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:47.850407 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-d7e6728e-34c7-489c-bf15-6ff60b355d36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3460a7af07ca4f6a93c81fd4ed8f8238'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:47.856281 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-5d69020f-f975-4846-855c-4c470608854d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c5a2da9f32b41229ebee8a3cc2f6d54', 'request_id': 'req-5d69020f-f975-4846-855c-4c470608854d'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:47.858384 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-d7e6728e-34c7-489c-bf15-6ff60b355d36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3460a7af07ca4f6a93c81fd4ed8f8238'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:47.859064 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-d7e6728e-34c7-489c-bf15-6ff60b355d36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3460a7af07ca4f6a93c81fd4ed8f8238'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:47.867731 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-5d69020f-f975-4846-855c-4c470608854d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c5a2da9f32b41229ebee8a3cc2f6d54', 'request_id': 'req-5d69020f-f975-4846-855c-4c470608854d'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:47.871471 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-d7e6728e-34c7-489c-bf15-6ff60b355d36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3460a7af07ca4f6a93c81fd4ed8f8238'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:47.954826 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-5d69020f-f975-4846-855c-4c470608854d admin admin] The token cache is being invalidate because project 9c5a2da9f32b41229ebee8a3cc2f6d54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:30:47.965286 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-5d69020f-f975-4846-855c-4c470608854d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:47.966442 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-5d69020f-f975-4846-855c-4c470608854d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:47.968641 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1299/2590] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:30:47 2022] DELETE /identity/v3/projects/9c5a2da9f32b41229ebee8a3cc2f6d54 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:47.975963 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedec7c-5a99-4d11-b53a-cbf12fb5cb1a None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:47.976436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedec7c-5a99-4d11-b53a-cbf12fb5cb1a None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:47.976798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedec7c-5a99-4d11-b53a-cbf12fb5cb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:47.997455 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-dcedec7c-5a99-4d11-b53a-cbf12fb5cb1a None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:47.998736 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-dcedec7c-5a99-4d11-b53a-cbf12fb5cb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:48.035488 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:48.037297 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:48.042382 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1292/2591] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:30:47 2022] DELETE /identity/v3/users/3460a7af07ca4f6a93c81fd4ed8f8238 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:48.082112 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e525a68-eca6-4349-9264-69ef4cf99a84 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:48.085685 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e525a68-eca6-4349-9264-69ef4cf99a84 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:48.085975 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e525a68-eca6-4349-9264-69ef4cf99a84 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:48.093154 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1293/2592] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 23 04:30:48 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:30:48.094560 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd473c07-42ce-4adc-b6fb-3b69e5e2d9d5 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:48.094871 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd473c07-42ce-4adc-b6fb-3b69e5e2d9d5 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:48.095208 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd473c07-42ce-4adc-b6fb-3b69e5e2d9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:48.097713 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1300/2593] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:48.099488 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4e860-2ca6-4d19-9090-63eecbfc2ee4 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:48.099791 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4e860-2ca6-4d19-9090-63eecbfc2ee4 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:48.100021 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4e860-2ca6-4d19-9090-63eecbfc2ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:48.136650 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-fd473c07-42ce-4adc-b6fb-3b69e5e2d9d5 None None] MFA Rules not processed for user `1e0236a0acac4b87be977878b5186551`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:48.138466 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-fd473c07-42ce-4adc-b6fb-3b69e5e2d9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:48.140224 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-e6c4e860-2ca6-4d19-9090-63eecbfc2ee4 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:48.141477 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-e6c4e860-2ca6-4d19-9090-63eecbfc2ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:48.237070 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1301/2594] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:48.241465 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4e860-2ca6-4d19-9090-63eecbfc2ee4 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:48.247810 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1294/2595] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 23 04:30:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:30:48.255463 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4e860-2ca6-4d19-9090-63eecbfc2ee4 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:48.260203 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366954dc-98b9-4840-816b-5137dce82b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:48.260821 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366954dc-98b9-4840-816b-5137dce82b50 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:48.261127 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366954dc-98b9-4840-816b-5137dce82b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:48.261252 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd473c07-42ce-4adc-b6fb-3b69e5e2d9d5 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:48.261417 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366954dc-98b9-4840-816b-5137dce82b50 admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:48.262238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366954dc-98b9-4840-816b-5137dce82b50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:30:48.262563 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366954dc-98b9-4840-816b-5137dce82b50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:48.262736 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-fd473c07-42ce-4adc-b6fb-3b69e5e2d9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:48.264219 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366954dc-98b9-4840-816b-5137dce82b50 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:48.278778 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1302/2596] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:30:48.283254 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366954dc-98b9-4840-816b-5137dce82b50 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:48.294503 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366954dc-98b9-4840-816b-5137dce82b50 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:48.302264 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d438c7f-26a8-4181-99ed-fb7347fe489e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:48.302876 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d438c7f-26a8-4181-99ed-fb7347fe489e admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:48.303261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d438c7f-26a8-4181-99ed-fb7347fe489e admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:48.303463 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d438c7f-26a8-4181-99ed-fb7347fe489e admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:48.304054 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d438c7f-26a8-4181-99ed-fb7347fe489e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:48.306229 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d438c7f-26a8-4181-99ed-fb7347fe489e admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:48.356621 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd473c07-42ce-4adc-b6fb-3b69e5e2d9d5 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:48.360863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f707cf-55db-4312-83e9-0603e9e084e3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '020af86302e447a6b3973df4abbabafa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:48.361613 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f707cf-55db-4312-83e9-0603e9e084e3 service glance] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:48.361895 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f707cf-55db-4312-83e9-0603e9e084e3 service glance] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:48.362332 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f707cf-55db-4312-83e9-0603e9e084e3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:48.374996 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f707cf-55db-4312-83e9-0603e9e084e3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:48.376435 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f707cf-55db-4312-83e9-0603e9e084e3 service glance] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:48.389457 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1295/2597] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:30:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:30:48.473558 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1303/2598] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:30:48 2022] POST /identity/v3/projects => generated 405 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:30:48.477861 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f707cf-55db-4312-83e9-0603e9e084e3 service glance] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:48.488495 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f707cf-55db-4312-83e9-0603e9e084e3 service glance] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:48.546893 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a911134-d318-495a-a916-f64017e5c0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:48.547516 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a911134-d318-495a-a916-f64017e5c0e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:48.547798 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a911134-d318-495a-a916-f64017e5c0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:48.548075 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a911134-d318-495a-a916-f64017e5c0e3 admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:48.548735 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a911134-d318-495a-a916-f64017e5c0e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:48.550745 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a911134-d318-495a-a916-f64017e5c0e3 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:48.623852 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d438c7f-26a8-4181-99ed-fb7347fe489e admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:48.625747 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-2d438c7f-26a8-4181-99ed-fb7347fe489e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:48.644925 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d438c7f-26a8-4181-99ed-fb7347fe489e admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:48.649663 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a8194-2a7c-45fe-b462-ec8116eb47a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:48.650301 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a8194-2a7c-45fe-b462-ec8116eb47a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:48.651508 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a8194-2a7c-45fe-b462-ec8116eb47a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:48.651788 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a8194-2a7c-45fe-b462-ec8116eb47a9 admin admin] PATH_INFO: `/v3/projects/8f247ee6e66d46babd59e446f7e25676` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:48.652964 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a8194-2a7c-45fe-b462-ec8116eb47a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f247ee6e66d46babd59e446f7e25676)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:48.654964 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a8194-2a7c-45fe-b462-ec8116eb47a9 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:48.670080 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1296/2599] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:30:48 2022] POST /identity/v3/users => generated 303 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:30:48.674145 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a911134-d318-495a-a916-f64017e5c0e3 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:48.686495 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a911134-d318-495a-a916-f64017e5c0e3 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:48.692640 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf53b2-de38-46c5-afee-e22af50bedb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:48.693742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf53b2-de38-46c5-afee-e22af50bedb2 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:48.694028 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf53b2-de38-46c5-afee-e22af50bedb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:48.694306 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf53b2-de38-46c5-afee-e22af50bedb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:48.694962 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf53b2-de38-46c5-afee-e22af50bedb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:48.696572 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf53b2-de38-46c5-afee-e22af50bedb2 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:48.709187 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1297/2600] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:30:48.709187 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ae508-34f2-4e92-a252-cc497f1aefcf None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:48.709438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ae508-34f2-4e92-a252-cc497f1aefcf None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:48.709551 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ae508-34f2-4e92-a252-cc497f1aefcf None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:48.711916 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1298/2601] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 23 04:30:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:30:48.712728 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ae508-34f2-4e92-a252-cc497f1aefcf None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:48.726388 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ae508-34f2-4e92-a252-cc497f1aefcf None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:48.731600 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b7343-b5e0-45a7-8e29-bb87b8fbd434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:48.732216 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b7343-b5e0-45a7-8e29-bb87b8fbd434 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:48.732515 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b7343-b5e0-45a7-8e29-bb87b8fbd434 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:48.732791 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b7343-b5e0-45a7-8e29-bb87b8fbd434 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:48.733477 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b7343-b5e0-45a7-8e29-bb87b8fbd434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:48.735091 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b7343-b5e0-45a7-8e29-bb87b8fbd434 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:48.747051 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1299/2602] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:30:48.748151 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da2e92-360a-4e98-a6ec-f510d60de3a4 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:48.748437 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da2e92-360a-4e98-a6ec-f510d60de3a4 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:48.748709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da2e92-360a-4e98-a6ec-f510d60de3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:48.756909 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:48.768856 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-31da2e92-360a-4e98-a6ec-f510d60de3a4 None None] MFA Rules not processed for user `8304ca06f82742ef8ce74396884e90b4`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:48.770291 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-31da2e92-360a-4e98-a6ec-f510d60de3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:48.786716 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-cc8a8194-2a7c-45fe-b462-ec8116eb47a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f247ee6e66d46babd59e446f7e25676', 'request_id': 'req-cc8a8194-2a7c-45fe-b462-ec8116eb47a9'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:48.795063 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-cc8a8194-2a7c-45fe-b462-ec8116eb47a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f247ee6e66d46babd59e446f7e25676', 'request_id': 'req-cc8a8194-2a7c-45fe-b462-ec8116eb47a9'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:48.801796 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-cc8a8194-2a7c-45fe-b462-ec8116eb47a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f247ee6e66d46babd59e446f7e25676', 'request_id': 'req-cc8a8194-2a7c-45fe-b462-ec8116eb47a9'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:48.839552 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1300/2603] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 23 04:30:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:48.840395 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da2e92-360a-4e98-a6ec-f510d60de3a4 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:48.898615 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-cc8a8194-2a7c-45fe-b462-ec8116eb47a9 admin admin] The token cache is being invalidate because project 8f247ee6e66d46babd59e446f7e25676 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:30:48.898918 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-cc8a8194-2a7c-45fe-b462-ec8116eb47a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:48.899705 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-cc8a8194-2a7c-45fe-b462-ec8116eb47a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:48.901470 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1304/2604] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:30:48 2022] DELETE /identity/v3/projects/8f247ee6e66d46babd59e446f7e25676 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:48.902428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a8194-2a7c-45fe-b462-ec8116eb47a9 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:48.903797 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-cc8a8194-2a7c-45fe-b462-ec8116eb47a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:48.907411 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da2e92-360a-4e98-a6ec-f510d60de3a4 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:48.912877 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf64fe-1f03-4754-9f2e-57556bdcc8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:48.917803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf64fe-1f03-4754-9f2e-57556bdcc8be admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:48.917803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf64fe-1f03-4754-9f2e-57556bdcc8be admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:48.917803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf64fe-1f03-4754-9f2e-57556bdcc8be admin admin] PATH_INFO: `/v3/projects/205201f46c1e459eb208461c8410592a/users/4575aafed54945479054bd1ef0e4fbce/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:48.918888 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a8194-2a7c-45fe-b462-ec8116eb47a9 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:48.922686 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7c3c3-ab3d-4397-bf2c-61e164309893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:48.923303 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7c3c3-ab3d-4397-bf2c-61e164309893 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:48.923588 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7c3c3-ab3d-4397-bf2c-61e164309893 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:48.923868 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7c3c3-ab3d-4397-bf2c-61e164309893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:48.926278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-00e7c3c3-ab3d-4397-bf2c-61e164309893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:48.933493 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf64fe-1f03-4754-9f2e-57556bdcc8be admin admin] RBAC: Authorizing `identity:create_grant(project_id=205201f46c1e459eb208461c8410592a, user_id=4575aafed54945479054bd1ef0e4fbce, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:48.936239 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf64fe-1f03-4754-9f2e-57556bdcc8be admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:48.936866 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7c3c3-ab3d-4397-bf2c-61e164309893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:48.938246 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7c3c3-ab3d-4397-bf2c-61e164309893 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:48.955265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1305/2605] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:30:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:30:48.956143 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7c3c3-ab3d-4397-bf2c-61e164309893 service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:48.957543 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-00e7c3c3-ab3d-4397-bf2c-61e164309893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:48.974854 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7c3c3-ab3d-4397-bf2c-61e164309893 service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:48.979638 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be8bf9-73fa-4556-90fe-e1cdf3839237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:48.981329 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be8bf9-73fa-4556-90fe-e1cdf3839237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:48.981329 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be8bf9-73fa-4556-90fe-e1cdf3839237 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:48.981329 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be8bf9-73fa-4556-90fe-e1cdf3839237 admin admin] PATH_INFO: `/v3/users/36eba377b109451a99c243382c4228b1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:48.982539 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be8bf9-73fa-4556-90fe-e1cdf3839237 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36eba377b109451a99c243382c4228b1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:48.984557 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be8bf9-73fa-4556-90fe-e1cdf3839237 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:48.992030 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:49.010180 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1301/2606] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:30:48 2022] PUT /identity/v3/projects/205201f46c1e459eb208461c8410592a/users/4575aafed54945479054bd1ef0e4fbce/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:49.020909 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08577046-8dc9-43b0-99a3-c5b0092f499e None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:49.021429 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08577046-8dc9-43b0-99a3-c5b0092f499e None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:49.021713 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08577046-8dc9-43b0-99a3-c5b0092f499e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:49.058097 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-08577046-8dc9-43b0-99a3-c5b0092f499e None None] MFA Rules not processed for user `4575aafed54945479054bd1ef0e4fbce`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:49.059378 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-08577046-8dc9-43b0-99a3-c5b0092f499e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:49.128979 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1302/2607] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:49 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:49.130426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3fa0c-47f8-4f14-a2d6-1d0c866e3e6b None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:49.130727 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3fa0c-47f8-4f14-a2d6-1d0c866e3e6b None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:49.131006 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3fa0c-47f8-4f14-a2d6-1d0c866e3e6b None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:49.132480 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1303/2608] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 23 04:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:30:49.133437 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3fa0c-47f8-4f14-a2d6-1d0c866e3e6b None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:49.137292 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-85f3fa0c-47f8-4f14-a2d6-1d0c866e3e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:49.168280 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:49.212577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3fa0c-47f8-4f14-a2d6-1d0c866e3e6b None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:49.217960 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36776b-4aa1-41a4-8c58-228b6804721f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:49.218273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36776b-4aa1-41a4-8c58-228b6804721f admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:49.218552 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36776b-4aa1-41a4-8c58-228b6804721f admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:49.218825 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36776b-4aa1-41a4-8c58-228b6804721f admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:49.219814 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36776b-4aa1-41a4-8c58-228b6804721f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:49.221768 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36776b-4aa1-41a4-8c58-228b6804721f admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:49.224718 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-03be8bf9-73fa-4556-90fe-e1cdf3839237 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36eba377b109451a99c243382c4228b1'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:49.309738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-03be8bf9-73fa-4556-90fe-e1cdf3839237 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36eba377b109451a99c243382c4228b1'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:49.318436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-03be8bf9-73fa-4556-90fe-e1cdf3839237 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36eba377b109451a99c243382c4228b1'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:49.332785 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-03be8bf9-73fa-4556-90fe-e1cdf3839237 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36eba377b109451a99c243382c4228b1'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:49.333004 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-03be8bf9-73fa-4556-90fe-e1cdf3839237 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36eba377b109451a99c243382c4228b1'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:49.339470 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1306/2609] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:30:48 2022] DELETE /identity/v3/users/36eba377b109451a99c243382c4228b1 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:49.340592 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbda44-9ed7-4140-abb6-ffa48c9ee4d5 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:49.340811 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbda44-9ed7-4140-abb6-ffa48c9ee4d5 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:49.341177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbda44-9ed7-4140-abb6-ffa48c9ee4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:49.357677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1304/2610] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:30:49 2022] POST /identity/v3/projects => generated 403 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:30:49.361016 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36776b-4aa1-41a4-8c58-228b6804721f admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:49.364313 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-1bcbda44-9ed7-4140-abb6-ffa48c9ee4d5 None None] MFA Rules not processed for user `1e0236a0acac4b87be977878b5186551`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:49.364447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-8f36776b-4aa1-41a4-8c58-228b6804721f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:49.365721 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-1bcbda44-9ed7-4140-abb6-ffa48c9ee4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:49.462906 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1307/2611] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 23 04:30:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:49.467866 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbda44-9ed7-4140-abb6-ffa48c9ee4d5 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:49.470105 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-1bcbda44-9ed7-4140-abb6-ffa48c9ee4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:49.470966 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36776b-4aa1-41a4-8c58-228b6804721f admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:49.477025 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e2434-d0ff-4ea7-9531-2ddc02671792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:49.477755 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e2434-d0ff-4ea7-9531-2ddc02671792 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:49.478046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e2434-d0ff-4ea7-9531-2ddc02671792 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:49.478408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e2434-d0ff-4ea7-9531-2ddc02671792 admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:49.479104 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e2434-d0ff-4ea7-9531-2ddc02671792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:49.482754 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e2434-d0ff-4ea7-9531-2ddc02671792 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:49.537362 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbda44-9ed7-4140-abb6-ffa48c9ee4d5 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:49.541456 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e91a59-cd4b-49c8-b05d-b5598ec96421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:49.542280 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e91a59-cd4b-49c8-b05d-b5598ec96421 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:49.542521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e91a59-cd4b-49c8-b05d-b5598ec96421 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:49.542800 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e91a59-cd4b-49c8-b05d-b5598ec96421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:49.553525 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e91a59-cd4b-49c8-b05d-b5598ec96421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:49.558732 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e91a59-cd4b-49c8-b05d-b5598ec96421 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:49.567393 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1305/2612] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:30:49 2022] POST /identity/v3/users => generated 308 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:30:49.568608 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e2434-d0ff-4ea7-9531-2ddc02671792 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:49.570568 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1308/2613] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:30:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:30:49.580928 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e2434-d0ff-4ea7-9531-2ddc02671792 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:49.593535 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0679f90-f11b-4635-890a-bec86bd7ac51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:49.595385 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0679f90-f11b-4635-890a-bec86bd7ac51 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:49.595682 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0679f90-f11b-4635-890a-bec86bd7ac51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:49.595968 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0679f90-f11b-4635-890a-bec86bd7ac51 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:49.596694 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0679f90-f11b-4635-890a-bec86bd7ac51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:49.599272 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0679f90-f11b-4635-890a-bec86bd7ac51 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:49.616044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1306/2614] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:30:49.629297 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e91a59-cd4b-49c8-b05d-b5598ec96421 service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:49.651647 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e91a59-cd4b-49c8-b05d-b5598ec96421 service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:49.659310 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a470f9e-7969-4cb6-bf91-a630487fc389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:49.660469 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a470f9e-7969-4cb6-bf91-a630487fc389 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:49.660826 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a470f9e-7969-4cb6-bf91-a630487fc389 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:49.661392 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a470f9e-7969-4cb6-bf91-a630487fc389 admin admin] PATH_INFO: `/v3/projects/3c8a4591529542e78dce050eb17d5c10/users/ab503fbe146f4e8082015a22e1803a5d/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:49.681169 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a470f9e-7969-4cb6-bf91-a630487fc389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c8a4591529542e78dce050eb17d5c10, user_id=ab503fbe146f4e8082015a22e1803a5d, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:49.684452 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a470f9e-7969-4cb6-bf91-a630487fc389 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:49.688404 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:49.764041 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1309/2615] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:30:49 2022] PUT /identity/v3/projects/3c8a4591529542e78dce050eb17d5c10/users/ab503fbe146f4e8082015a22e1803a5d/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:49.768069 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0679f90-f11b-4635-890a-bec86bd7ac51 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:49.782739 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0679f90-f11b-4635-890a-bec86bd7ac51 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:49.857528 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a751b-57ad-4188-9d6d-de59db3b338d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:49.858157 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a751b-57ad-4188-9d6d-de59db3b338d admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:49.858442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a751b-57ad-4188-9d6d-de59db3b338d admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:49.858719 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a751b-57ad-4188-9d6d-de59db3b338d admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:49.859439 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a751b-57ad-4188-9d6d-de59db3b338d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:49.861047 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a751b-57ad-4188-9d6d-de59db3b338d admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:49.871466 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1307/2616] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:30:49.876019 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a470f9e-7969-4cb6-bf91-a630487fc389 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:49.887908 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a751b-57ad-4188-9d6d-de59db3b338d admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:49.890598 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a470f9e-7969-4cb6-bf91-a630487fc389 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:49.893291 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-321a751b-57ad-4188-9d6d-de59db3b338d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:49.896853 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b0625-dd3c-4e94-ab33-d5200ff38b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:49.897569 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b0625-dd3c-4e94-ab33-d5200ff38b1c admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:49.897969 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b0625-dd3c-4e94-ab33-d5200ff38b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:49.898248 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b0625-dd3c-4e94-ab33-d5200ff38b1c admin admin] PATH_INFO: `/v3/projects/3c8a4591529542e78dce050eb17d5c10/users/ab503fbe146f4e8082015a22e1803a5d/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:49.907240 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a751b-57ad-4188-9d6d-de59db3b338d admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:49.907738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b0625-dd3c-4e94-ab33-d5200ff38b1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c8a4591529542e78dce050eb17d5c10, user_id=ab503fbe146f4e8082015a22e1803a5d, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:49.915159 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78344497-bcf0-4c1e-b8da-18dc8e845d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:49.915159 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78344497-bcf0-4c1e-b8da-18dc8e845d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:49.915159 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78344497-bcf0-4c1e-b8da-18dc8e845d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:49.915407 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b0625-dd3c-4e94-ab33-d5200ff38b1c admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:49.917366 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78344497-bcf0-4c1e-b8da-18dc8e845d1b admin admin] PATH_INFO: `/v3/projects/4ee2907ed60f4eed81b968507cc670dc` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:49.920312 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78344497-bcf0-4c1e-b8da-18dc8e845d1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ee2907ed60f4eed81b968507cc670dc)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:49.923909 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78344497-bcf0-4c1e-b8da-18dc8e845d1b admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:49.933405 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1310/2617] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:30:49 2022] PUT /identity/v3/projects/3c8a4591529542e78dce050eb17d5c10/users/ab503fbe146f4e8082015a22e1803a5d/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:49.960186 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:49.962058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfe3d2-6fec-4a21-b2ae-dcef00647d34 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:49.962356 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfe3d2-6fec-4a21-b2ae-dcef00647d34 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:49.963081 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfe3d2-6fec-4a21-b2ae-dcef00647d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:49.993013 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-b7cfe3d2-6fec-4a21-b2ae-dcef00647d34 None None] MFA Rules not processed for user `ab503fbe146f4e8082015a22e1803a5d`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:49.994269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-b7cfe3d2-6fec-4a21-b2ae-dcef00647d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:50.074377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-78344497-bcf0-4c1e-b8da-18dc8e845d1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ee2907ed60f4eed81b968507cc670dc', 'request_id': 'req-78344497-bcf0-4c1e-b8da-18dc8e845d1b'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:50.078675 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1311/2618] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:49 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:50.084555 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-78344497-bcf0-4c1e-b8da-18dc8e845d1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ee2907ed60f4eed81b968507cc670dc', 'request_id': 'req-78344497-bcf0-4c1e-b8da-18dc8e845d1b'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:50.091529 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-78344497-bcf0-4c1e-b8da-18dc8e845d1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ee2907ed60f4eed81b968507cc670dc', 'request_id': 'req-78344497-bcf0-4c1e-b8da-18dc8e845d1b'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:50.093648 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cfe3d2-6fec-4a21-b2ae-dcef00647d34 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:50.095343 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-b7cfe3d2-6fec-4a21-b2ae-dcef00647d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:50.158199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-78344497-bcf0-4c1e-b8da-18dc8e845d1b admin admin] The token cache is being invalidate because project 4ee2907ed60f4eed81b968507cc670dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:30:50.158729 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-78344497-bcf0-4c1e-b8da-18dc8e845d1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:50.160207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-78344497-bcf0-4c1e-b8da-18dc8e845d1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:50.162886 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1308/2619] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:30:49 2022] DELETE /identity/v3/projects/4ee2907ed60f4eed81b968507cc670dc => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:30:50.167286 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cfe3d2-6fec-4a21-b2ae-dcef00647d34 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:50.169451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0ba9a-9ec9-4e19-ad39-f22be7000b15 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:50.169908 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0ba9a-9ec9-4e19-ad39-f22be7000b15 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:50.170186 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0ba9a-9ec9-4e19-ad39-f22be7000b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:50.203191 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-9cc0ba9a-9ec9-4e19-ad39-f22be7000b15 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:50.204548 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-9cc0ba9a-9ec9-4e19-ad39-f22be7000b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:50.240213 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e956fa-a86e-4a5b-8ee9-014366ef53dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:50.240831 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e956fa-a86e-4a5b-8ee9-014366ef53dd service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:50.241136 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e956fa-a86e-4a5b-8ee9-014366ef53dd service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:50.241413 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e956fa-a86e-4a5b-8ee9-014366ef53dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:50.243315 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-e6e956fa-a86e-4a5b-8ee9-014366ef53dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:50.272491 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1309/2620] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:50.281404 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d965ad0-c45e-42f2-b029-6567944794cf None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:50.281694 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d965ad0-c45e-42f2-b029-6567944794cf None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:50.281967 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d965ad0-c45e-42f2-b029-6567944794cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:50.289404 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:50.304341 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-6d965ad0-c45e-42f2-b029-6567944794cf None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:50.305827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-6d965ad0-c45e-42f2-b029-6567944794cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:50.321861 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e956fa-a86e-4a5b-8ee9-014366ef53dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:50.323360 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e956fa-a86e-4a5b-8ee9-014366ef53dd service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:50.331427 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1310/2621] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:30:50.335744 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d965ad0-c45e-42f2-b029-6567944794cf None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:50.336039 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1312/2622] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:30:50 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:30:50.347039 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d965ad0-c45e-42f2-b029-6567944794cf None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:50.352133 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77943a1-2e48-489d-a70c-db734daa7d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:50.352782 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77943a1-2e48-489d-a70c-db734daa7d51 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:50.353037 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77943a1-2e48-489d-a70c-db734daa7d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:50.353966 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77943a1-2e48-489d-a70c-db734daa7d51 admin admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:50.354242 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77943a1-2e48-489d-a70c-db734daa7d51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:30:50.354550 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77943a1-2e48-489d-a70c-db734daa7d51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:50.356210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77943a1-2e48-489d-a70c-db734daa7d51 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:50.371443 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1311/2623] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:30:50.376292 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e956fa-a86e-4a5b-8ee9-014366ef53dd service cinder] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:50.393358 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e956fa-a86e-4a5b-8ee9-014366ef53dd service cinder] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:50.398762 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2bbc3a-f95d-420e-8cb6-2121d352d5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:50.401794 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bbc3a-f95d-420e-8cb6-2121d352d5b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:50.402091 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bbc3a-f95d-420e-8cb6-2121d352d5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:50.402416 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bbc3a-f95d-420e-8cb6-2121d352d5b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:50.403053 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2bbc3a-f95d-420e-8cb6-2121d352d5b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:50.404989 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2bbc3a-f95d-420e-8cb6-2121d352d5b6 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:50.519853 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77943a1-2e48-489d-a70c-db734daa7d51 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:50.522029 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-f77943a1-2e48-489d-a70c-db734daa7d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:50.539160 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77943a1-2e48-489d-a70c-db734daa7d51 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:50.547427 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5038db-bedc-4111-a51a-ff849df5a4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:50.548516 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5038db-bedc-4111-a51a-ff849df5a4a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:50.549010 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5038db-bedc-4111-a51a-ff849df5a4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:50.549552 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5038db-bedc-4111-a51a-ff849df5a4a9 admin admin] PATH_INFO: `/v3/users/4575aafed54945479054bd1ef0e4fbce` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:50.551675 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5038db-bedc-4111-a51a-ff849df5a4a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4575aafed54945479054bd1ef0e4fbce)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:50.554168 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5038db-bedc-4111-a51a-ff849df5a4a9 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:50.559548 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1313/2624] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:30:50 2022] POST /identity/v3/projects => generated 381 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:30:50.560560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2bbc3a-f95d-420e-8cb6-2121d352d5b6 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:50.649622 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2bbc3a-f95d-420e-8cb6-2121d352d5b6 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:50.654316 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea0f1b-25b3-4156-b6f3-05b923606538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:50.654976 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea0f1b-25b3-4156-b6f3-05b923606538 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:50.655261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea0f1b-25b3-4156-b6f3-05b923606538 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:50.655540 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea0f1b-25b3-4156-b6f3-05b923606538 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:50.656169 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea0f1b-25b3-4156-b6f3-05b923606538 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:50.658265 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea0f1b-25b3-4156-b6f3-05b923606538 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:50.802672 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-cf5038db-bedc-4111-a51a-ff849df5a4a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4575aafed54945479054bd1ef0e4fbce'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:50.803335 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-cf5038db-bedc-4111-a51a-ff849df5a4a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4575aafed54945479054bd1ef0e4fbce'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:50.813621 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-cf5038db-bedc-4111-a51a-ff849df5a4a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4575aafed54945479054bd1ef0e4fbce'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:50.814361 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-cf5038db-bedc-4111-a51a-ff849df5a4a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4575aafed54945479054bd1ef0e4fbce'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:50.819570 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1314/2625] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:30:50 2022] POST /identity/v3/users => generated 291 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:30:50.824033 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea0f1b-25b3-4156-b6f3-05b923606538 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:50.825728 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-29ea0f1b-25b3-4156-b6f3-05b923606538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:50.828351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-cf5038db-bedc-4111-a51a-ff849df5a4a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4575aafed54945479054bd1ef0e4fbce'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:50.841118 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea0f1b-25b3-4156-b6f3-05b923606538 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:50.846141 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97674225-ac74-4976-9deb-c6e689ee0494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:50.850603 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97674225-ac74-4976-9deb-c6e689ee0494 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:50.850603 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97674225-ac74-4976-9deb-c6e689ee0494 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:50.850603 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97674225-ac74-4976-9deb-c6e689ee0494 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:50.850603 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97674225-ac74-4976-9deb-c6e689ee0494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:50.851069 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97674225-ac74-4976-9deb-c6e689ee0494 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:50.862683 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1315/2626] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:30:50.866518 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97674225-ac74-4976-9deb-c6e689ee0494 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:50.877201 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97674225-ac74-4976-9deb-c6e689ee0494 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:50.882084 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4cb0d-8057-483b-94cc-1bfe365d0ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:50.882651 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4cb0d-8057-483b-94cc-1bfe365d0ddb admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:50.882929 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4cb0d-8057-483b-94cc-1bfe365d0ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:50.883195 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4cb0d-8057-483b-94cc-1bfe365d0ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:50.883833 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4cb0d-8057-483b-94cc-1bfe365d0ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:50.885479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4cb0d-8057-483b-94cc-1bfe365d0ddb admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:50.897299 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1316/2627] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:30:50.900154 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:50.900738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4cb0d-8057-483b-94cc-1bfe365d0ddb admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:50.905053 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1312/2628] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:30:50 2022] DELETE /identity/v3/users/4575aafed54945479054bd1ef0e4fbce => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:50.909338 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840e03f-85fe-4f6c-9356-de376f2ad4c0 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:50.910770 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840e03f-85fe-4f6c-9356-de376f2ad4c0 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:50.910770 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840e03f-85fe-4f6c-9356-de376f2ad4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:50.916953 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4cb0d-8057-483b-94cc-1bfe365d0ddb admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:50.933962 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-1840e03f-85fe-4f6c-9356-de376f2ad4c0 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:50.935233 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-1840e03f-85fe-4f6c-9356-de376f2ad4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:50.988563 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0065b1e-b841-46ee-90e9-6d210f5f8821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:50.989277 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0065b1e-b841-46ee-90e9-6d210f5f8821 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:50.989562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0065b1e-b841-46ee-90e9-6d210f5f8821 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:50.990051 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0065b1e-b841-46ee-90e9-6d210f5f8821 admin admin] PATH_INFO: `/v3/projects/e033baa2dd0f4a3094eabf64d08696fc/users/a92eb9c77026445f80def315737608fc/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:51.002625 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1313/2629] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:51.011186 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0065b1e-b841-46ee-90e9-6d210f5f8821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e033baa2dd0f4a3094eabf64d08696fc, user_id=a92eb9c77026445f80def315737608fc, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:51.014073 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0065b1e-b841-46ee-90e9-6d210f5f8821 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:51.015942 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840e03f-85fe-4f6c-9356-de376f2ad4c0 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:51.017598 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-1840e03f-85fe-4f6c-9356-de376f2ad4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:51.082582 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840e03f-85fe-4f6c-9356-de376f2ad4c0 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:51.087788 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f2936-b435-46d0-ab3d-50d1dc1e5d23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:51.088404 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f2936-b435-46d0-ab3d-50d1dc1e5d23 service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:51.088681 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f2936-b435-46d0-ab3d-50d1dc1e5d23 service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:51.088957 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f2936-b435-46d0-ab3d-50d1dc1e5d23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:51.102026 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1317/2630] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:30:50 2022] PUT /identity/v3/projects/e033baa2dd0f4a3094eabf64d08696fc/users/a92eb9c77026445f80def315737608fc/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:30:51.104966 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f2936-b435-46d0-ab3d-50d1dc1e5d23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:51.107025 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f2936-b435-46d0-ab3d-50d1dc1e5d23 service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:51.107554 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e508eac-dba0-4b1c-b0ce-6612bcd8cf21 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:51.107961 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e508eac-dba0-4b1c-b0ce-6612bcd8cf21 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:51.108297 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e508eac-dba0-4b1c-b0ce-6612bcd8cf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:51.115820 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:51.119643 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1314/2631] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:30:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:30:51.137597 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-0e508eac-dba0-4b1c-b0ce-6612bcd8cf21 None None] MFA Rules not processed for user `a92eb9c77026445f80def315737608fc`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:51.138833 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-0e508eac-dba0-4b1c-b0ce-6612bcd8cf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:51.220053 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1318/2632] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:30:51.225152 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f2936-b435-46d0-ab3d-50d1dc1e5d23 service neutron] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:51.234844 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f2936-b435-46d0-ab3d-50d1dc1e5d23 service neutron] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:51.293609 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d390955-2d55-4144-ad8a-b1ca24ba079d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:51.294267 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d390955-2d55-4144-ad8a-b1ca24ba079d admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:51.294539 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d390955-2d55-4144-ad8a-b1ca24ba079d admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:51.294850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d390955-2d55-4144-ad8a-b1ca24ba079d admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:51.295449 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d390955-2d55-4144-ad8a-b1ca24ba079d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:51.297617 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d390955-2d55-4144-ad8a-b1ca24ba079d admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:51.471345 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1315/2633] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:30:51 2022] POST /identity/v3/projects => generated 379 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:30:51.475582 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e508eac-dba0-4b1c-b0ce-6612bcd8cf21 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:51.486115 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e508eac-dba0-4b1c-b0ce-6612bcd8cf21 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:51.547068 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb37867-3973-42c4-a957-9ae92deb25df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:51.547620 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb37867-3973-42c4-a957-9ae92deb25df admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:51.547906 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb37867-3973-42c4-a957-9ae92deb25df admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:51.548181 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb37867-3973-42c4-a957-9ae92deb25df admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:51.548807 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb37867-3973-42c4-a957-9ae92deb25df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:51.550829 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb37867-3973-42c4-a957-9ae92deb25df admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:51.572166 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d390955-2d55-4144-ad8a-b1ca24ba079d admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:51.573995 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-7d390955-2d55-4144-ad8a-b1ca24ba079d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:51.587142 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d390955-2d55-4144-ad8a-b1ca24ba079d admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:51.592431 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093898cc-ba52-4e66-b6cf-b4ee74e6e15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:51.593173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093898cc-ba52-4e66-b6cf-b4ee74e6e15a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:51.593468 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093898cc-ba52-4e66-b6cf-b4ee74e6e15a admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:51.593896 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093898cc-ba52-4e66-b6cf-b4ee74e6e15a admin admin] PATH_INFO: `/v3/projects/205201f46c1e459eb208461c8410592a` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:51.595023 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093898cc-ba52-4e66-b6cf-b4ee74e6e15a admin admin] RBAC: Authorizing `identity:delete_project(project_id=205201f46c1e459eb208461c8410592a)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:51.597350 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093898cc-ba52-4e66-b6cf-b4ee74e6e15a admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:51.623753 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:51.701144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1319/2634] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:30:51 2022] POST /identity/v3/users => generated 296 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:30:51.704462 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb37867-3973-42c4-a957-9ae92deb25df admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:51.726186 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-093898cc-ba52-4e66-b6cf-b4ee74e6e15a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '205201f46c1e459eb208461c8410592a', 'request_id': 'req-093898cc-ba52-4e66-b6cf-b4ee74e6e15a'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:51.728907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb37867-3973-42c4-a957-9ae92deb25df admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:51.741314 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-093898cc-ba52-4e66-b6cf-b4ee74e6e15a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '205201f46c1e459eb208461c8410592a', 'request_id': 'req-093898cc-ba52-4e66-b6cf-b4ee74e6e15a'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:51.749561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-093898cc-ba52-4e66-b6cf-b4ee74e6e15a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '205201f46c1e459eb208461c8410592a', 'request_id': 'req-093898cc-ba52-4e66-b6cf-b4ee74e6e15a'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:51.833188 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-093898cc-ba52-4e66-b6cf-b4ee74e6e15a admin admin] The token cache is being invalidate because project 205201f46c1e459eb208461c8410592a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:30:51.833481 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-093898cc-ba52-4e66-b6cf-b4ee74e6e15a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:51.834163 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-093898cc-ba52-4e66-b6cf-b4ee74e6e15a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:51.835918 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1316/2635] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:30:51 2022] DELETE /identity/v3/projects/205201f46c1e459eb208461c8410592a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:30:51.839622 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093898cc-ba52-4e66-b6cf-b4ee74e6e15a admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:51.840963 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-093898cc-ba52-4e66-b6cf-b4ee74e6e15a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:51.856702 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79d278-c157-40e6-af1c-b890f11b8f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:51.857451 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79d278-c157-40e6-af1c-b890f11b8f1c admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:51.857734 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79d278-c157-40e6-af1c-b890f11b8f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:51.858235 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79d278-c157-40e6-af1c-b890f11b8f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:51.860899 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff79d278-c157-40e6-af1c-b890f11b8f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:51.860899 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff79d278-c157-40e6-af1c-b890f11b8f1c admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:51.881131 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1320/2636] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:30:51.884734 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79d278-c157-40e6-af1c-b890f11b8f1c admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:51.886538 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-ff79d278-c157-40e6-af1c-b890f11b8f1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:51.898811 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79d278-c157-40e6-af1c-b890f11b8f1c admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:51.903938 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef733e5e-9eba-4d80-b4b7-ea26870c4d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:51.904764 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef733e5e-9eba-4d80-b4b7-ea26870c4d7e admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:51.905149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef733e5e-9eba-4d80-b4b7-ea26870c4d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:51.905488 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef733e5e-9eba-4d80-b4b7-ea26870c4d7e admin admin] PATH_INFO: `/v3/projects/929a5a4fabcb471f973fa18c15aaab3a/users/2dfb03d97a6843968259bda6bd877be7/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:51.911896 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093898cc-ba52-4e66-b6cf-b4ee74e6e15a admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:51.916760 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261219f-b2ae-47ac-afd6-2d022bf8ddb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:51.917431 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261219f-b2ae-47ac-afd6-2d022bf8ddb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:51.917718 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261219f-b2ae-47ac-afd6-2d022bf8ddb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:51.918261 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261219f-b2ae-47ac-afd6-2d022bf8ddb7 admin admin] PATH_INFO: `/v3/users/ab503fbe146f4e8082015a22e1803a5d` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:51.919188 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261219f-b2ae-47ac-afd6-2d022bf8ddb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab503fbe146f4e8082015a22e1803a5d)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:51.921195 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261219f-b2ae-47ac-afd6-2d022bf8ddb7 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:51.922050 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef733e5e-9eba-4d80-b4b7-ea26870c4d7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=929a5a4fabcb471f973fa18c15aaab3a, user_id=2dfb03d97a6843968259bda6bd877be7, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:51.925691 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef733e5e-9eba-4d80-b4b7-ea26870c4d7e admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:51.928260 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:52.029878 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1321/2637] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:30:51 2022] PUT /identity/v3/projects/929a5a4fabcb471f973fa18c15aaab3a/users/2dfb03d97a6843968259bda6bd877be7/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:52.033757 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef733e5e-9eba-4d80-b4b7-ea26870c4d7e admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:52.100104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef733e5e-9eba-4d80-b4b7-ea26870c4d7e admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:52.104889 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f7d87-97e5-4658-9f29-ab66a11d67d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:52.105537 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f7d87-97e5-4658-9f29-ab66a11d67d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:52.105820 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f7d87-97e5-4658-9f29-ab66a11d67d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:52.106094 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f7d87-97e5-4658-9f29-ab66a11d67d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:52.106747 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f7d87-97e5-4658-9f29-ab66a11d67d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:52.108341 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f7d87-97e5-4658-9f29-ab66a11d67d1 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:52.118714 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1322/2638] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:30:52.122770 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f7d87-97e5-4658-9f29-ab66a11d67d1 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:52.131917 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f7d87-97e5-4658-9f29-ab66a11d67d1 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:52.136531 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec9e90-66fa-4a31-acf0-c9ec11196436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:52.137178 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec9e90-66fa-4a31-acf0-c9ec11196436 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:52.137463 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec9e90-66fa-4a31-acf0-c9ec11196436 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:52.137740 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec9e90-66fa-4a31-acf0-c9ec11196436 admin admin] PATH_INFO: `/v3/projects/929a5a4fabcb471f973fa18c15aaab3a/users/2dfb03d97a6843968259bda6bd877be7/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:52.140612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec9e90-66fa-4a31-acf0-c9ec11196436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=929a5a4fabcb471f973fa18c15aaab3a, user_id=2dfb03d97a6843968259bda6bd877be7, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:52.143269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec9e90-66fa-4a31-acf0-c9ec11196436 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:52.152103 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-7261219f-b2ae-47ac-afd6-2d022bf8ddb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab503fbe146f4e8082015a22e1803a5d'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:52.152739 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-7261219f-b2ae-47ac-afd6-2d022bf8ddb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab503fbe146f4e8082015a22e1803a5d'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:52.154184 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1323/2639] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:30:52 2022] PUT /identity/v3/projects/929a5a4fabcb471f973fa18c15aaab3a/users/2dfb03d97a6843968259bda6bd877be7/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:30:52.164898 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06047a-f876-4848-9be2-5ca1071fad55 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:52.165234 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06047a-f876-4848-9be2-5ca1071fad55 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:52.165501 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06047a-f876-4848-9be2-5ca1071fad55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:52.166053 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-7261219f-b2ae-47ac-afd6-2d022bf8ddb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab503fbe146f4e8082015a22e1803a5d'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:52.166744 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-7261219f-b2ae-47ac-afd6-2d022bf8ddb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab503fbe146f4e8082015a22e1803a5d'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:52.180502 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-7261219f-b2ae-47ac-afd6-2d022bf8ddb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab503fbe146f4e8082015a22e1803a5d'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:52.193637 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-cb06047a-f876-4848-9be2-5ca1071fad55 None None] MFA Rules not processed for user `2dfb03d97a6843968259bda6bd877be7`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:52.194847 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-cb06047a-f876-4848-9be2-5ca1071fad55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:52.259540 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1317/2640] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:30:51 2022] DELETE /identity/v3/users/ab503fbe146f4e8082015a22e1803a5d => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:30:52.270320 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1324/2641] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:30:52.281449 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261219f-b2ae-47ac-afd6-2d022bf8ddb7 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:52.282842 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-7261219f-b2ae-47ac-afd6-2d022bf8ddb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:52.319890 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:52.344090 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261219f-b2ae-47ac-afd6-2d022bf8ddb7 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:52.348812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c1d0b-8332-41e1-bd04-7c7840016712 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:52.349578 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c1d0b-8332-41e1-bd04-7c7840016712 service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:52.349845 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c1d0b-8332-41e1-bd04-7c7840016712 service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:52.350174 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c1d0b-8332-41e1-bd04-7c7840016712 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:52.416442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c1d0b-8332-41e1-bd04-7c7840016712 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:52.417816 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c1d0b-8332-41e1-bd04-7c7840016712 service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:52.427372 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1318/2642] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:30:52 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:30:52.721316 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06047a-f876-4848-9be2-5ca1071fad55 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:52.730711 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-cb06047a-f876-4848-9be2-5ca1071fad55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:52.832950 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06047a-f876-4848-9be2-5ca1071fad55 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:52.839348 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:52.914854 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ac1b4-c71a-4ede-86fe-a80d3db7888d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:52.915743 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ac1b4-c71a-4ede-86fe-a80d3db7888d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:52.916216 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ac1b4-c71a-4ede-86fe-a80d3db7888d admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:52.919264 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ac1b4-c71a-4ede-86fe-a80d3db7888d admin admin] PATH_INFO: `/v3/projects/3c8a4591529542e78dce050eb17d5c10` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:52.919264 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ac1b4-c71a-4ede-86fe-a80d3db7888d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c8a4591529542e78dce050eb17d5c10)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:52.920358 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ac1b4-c71a-4ede-86fe-a80d3db7888d admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:53.052649 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6a5ac1b4-c71a-4ede-86fe-a80d3db7888d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c8a4591529542e78dce050eb17d5c10', 'request_id': 'req-6a5ac1b4-c71a-4ede-86fe-a80d3db7888d'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:53.062693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6a5ac1b4-c71a-4ede-86fe-a80d3db7888d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c8a4591529542e78dce050eb17d5c10', 'request_id': 'req-6a5ac1b4-c71a-4ede-86fe-a80d3db7888d'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:53.069463 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6a5ac1b4-c71a-4ede-86fe-a80d3db7888d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c8a4591529542e78dce050eb17d5c10', 'request_id': 'req-6a5ac1b4-c71a-4ede-86fe-a80d3db7888d'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:53.079504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c1d0b-8332-41e1-bd04-7c7840016712 service cinder] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:53.081069 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-5e5c1d0b-8332-41e1-bd04-7c7840016712 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:53.095231 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c1d0b-8332-41e1-bd04-7c7840016712 service cinder] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:53.135123 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6a5ac1b4-c71a-4ede-86fe-a80d3db7888d admin admin] The token cache is being invalidate because project 3c8a4591529542e78dce050eb17d5c10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:30:53.135568 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6a5ac1b4-c71a-4ede-86fe-a80d3db7888d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:53.136496 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6a5ac1b4-c71a-4ede-86fe-a80d3db7888d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:53.139232 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1325/2643] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:30:52 2022] DELETE /identity/v3/projects/3c8a4591529542e78dce050eb17d5c10 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:53.143845 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7e73d-07ec-48d0-bf81-7fb190233215 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:53.144138 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7e73d-07ec-48d0-bf81-7fb190233215 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:53.144484 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7e73d-07ec-48d0-bf81-7fb190233215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:53.164207 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328fe23-fd8c-485b-8e00-5f5b49aba852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:53.164853 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328fe23-fd8c-485b-8e00-5f5b49aba852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:53.169980 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328fe23-fd8c-485b-8e00-5f5b49aba852 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:53.169980 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328fe23-fd8c-485b-8e00-5f5b49aba852 admin admin] PATH_INFO: `/v3/users/a92eb9c77026445f80def315737608fc` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:53.170210 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-f7d7e73d-07ec-48d0-bf81-7fb190233215 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:53.170310 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328fe23-fd8c-485b-8e00-5f5b49aba852 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a92eb9c77026445f80def315737608fc)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:53.170412 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-f7d7e73d-07ec-48d0-bf81-7fb190233215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:53.170513 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328fe23-fd8c-485b-8e00-5f5b49aba852 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:53.179444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1326/2644] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:30:53.187161 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd9d9e-6b09-4b6b-b598-6f67c8aaf6cc None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:53.188607 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd9d9e-6b09-4b6b-b598-6f67c8aaf6cc None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:53.189075 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd9d9e-6b09-4b6b-b598-6f67c8aaf6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:53.210547 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-44bd9d9e-6b09-4b6b-b598-6f67c8aaf6cc None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:53.211749 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-44bd9d9e-6b09-4b6b-b598-6f67c8aaf6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:53.219953 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1327/2645] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:30:53.224112 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd9d9e-6b09-4b6b-b598-6f67c8aaf6cc None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:53.233460 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd9d9e-6b09-4b6b-b598-6f67c8aaf6cc None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:53.239199 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79249874-de72-4303-a259-9ef294dea4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:53.239805 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79249874-de72-4303-a259-9ef294dea4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:53.240087 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79249874-de72-4303-a259-9ef294dea4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:53.240358 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79249874-de72-4303-a259-9ef294dea4d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:53.241038 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79249874-de72-4303-a259-9ef294dea4d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:30:53.241354 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79249874-de72-4303-a259-9ef294dea4d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:53.242970 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79249874-de72-4303-a259-9ef294dea4d7 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:53.261181 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1328/2646] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:30:53.263531 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79249874-de72-4303-a259-9ef294dea4d7 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:53.274339 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79249874-de72-4303-a259-9ef294dea4d7 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:53.279399 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b114ce-e795-4796-8b3e-af6592ff9610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:53.280178 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b114ce-e795-4796-8b3e-af6592ff9610 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:53.280596 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b114ce-e795-4796-8b3e-af6592ff9610 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:53.280880 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b114ce-e795-4796-8b3e-af6592ff9610 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:53.281598 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b114ce-e795-4796-8b3e-af6592ff9610 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:53.283512 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b114ce-e795-4796-8b3e-af6592ff9610 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:53.381433 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2328fe23-fd8c-485b-8e00-5f5b49aba852 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a92eb9c77026445f80def315737608fc'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:53.382085 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2328fe23-fd8c-485b-8e00-5f5b49aba852 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a92eb9c77026445f80def315737608fc'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:53.389485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2328fe23-fd8c-485b-8e00-5f5b49aba852 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a92eb9c77026445f80def315737608fc'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:53.390123 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2328fe23-fd8c-485b-8e00-5f5b49aba852 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a92eb9c77026445f80def315737608fc'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:53.402447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-2328fe23-fd8c-485b-8e00-5f5b49aba852 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a92eb9c77026445f80def315737608fc'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:53.412771 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1329/2647] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:30:53 2022] POST /identity/v3/projects => generated 381 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:30:53.414174 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adeb447-2c39-4cd8-a627-b6524d224cc6 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:53.414464 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adeb447-2c39-4cd8-a627-b6524d224cc6 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:53.414734 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adeb447-2c39-4cd8-a627-b6524d224cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:53.436471 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-5adeb447-2c39-4cd8-a627-b6524d224cc6 None None] MFA Rules not processed for user `826b9a7c343b4dbc9aeb3dbc0b75fc92`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:53.437728 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-5adeb447-2c39-4cd8-a627-b6524d224cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:53.482635 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:53.494508 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1330/2648] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 23 04:30:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:53.495366 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adeb447-2c39-4cd8-a627-b6524d224cc6 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:53.496758 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-5adeb447-2c39-4cd8-a627-b6524d224cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:53.535063 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:53.539987 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1319/2649] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:30:53 2022] DELETE /identity/v3/users/a92eb9c77026445f80def315737608fc => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:53.540815 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328fe23-fd8c-485b-8e00-5f5b49aba852 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:53.542437 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-2328fe23-fd8c-485b-8e00-5f5b49aba852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:53.562546 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adeb447-2c39-4cd8-a627-b6524d224cc6 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:53.612472 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328fe23-fd8c-485b-8e00-5f5b49aba852 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:53.618445 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706a951-822e-4b9c-8436-59d960a3a950 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63190c62bc92403880ffaedc4737485a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:53.619080 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c4bdd-7936-4fba-a02d-41024814fb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:53.619236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706a951-822e-4b9c-8436-59d960a3a950 service swift] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:53.619444 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706a951-822e-4b9c-8436-59d960a3a950 service swift] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:53.619696 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c4bdd-7936-4fba-a02d-41024814fb1b admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:53.619796 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706a951-822e-4b9c-8436-59d960a3a950 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:53.619982 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c4bdd-7936-4fba-a02d-41024814fb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:53.620264 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c4bdd-7936-4fba-a02d-41024814fb1b admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:53.620897 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c4bdd-7936-4fba-a02d-41024814fb1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:53.622897 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c4bdd-7936-4fba-a02d-41024814fb1b admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:53.674702 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706a951-822e-4b9c-8436-59d960a3a950 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:53.676840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706a951-822e-4b9c-8436-59d960a3a950 service swift] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:53.685212 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1320/2650] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 23 04:30:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 04:30:53.686865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95771396-37ab-4c97-9ef7-68b26969e6d7 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:53.687253 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95771396-37ab-4c97-9ef7-68b26969e6d7 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:53.687253 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95771396-37ab-4c97-9ef7-68b26969e6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:53.694151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1331/2651] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:30:53 2022] POST /identity/v3/users => generated 291 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:30:53.698019 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c4bdd-7936-4fba-a02d-41024814fb1b admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:53.707994 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-95771396-37ab-4c97-9ef7-68b26969e6d7 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:53.708193 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c4bdd-7936-4fba-a02d-41024814fb1b admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:53.709252 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-95771396-37ab-4c97-9ef7-68b26969e6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:53.712680 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ce714-7ded-4952-acab-0f2b3e80dd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:53.715867 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ce714-7ded-4952-acab-0f2b3e80dd79 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:53.715867 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ce714-7ded-4952-acab-0f2b3e80dd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:53.715867 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ce714-7ded-4952-acab-0f2b3e80dd79 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:53.715867 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ce714-7ded-4952-acab-0f2b3e80dd79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:53.716214 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ce714-7ded-4952-acab-0f2b3e80dd79 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:53.717047 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1321/2652] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:53.727089 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95771396-37ab-4c97-9ef7-68b26969e6d7 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:53.728548 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-95771396-37ab-4c97-9ef7-68b26969e6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:53.730620 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1332/2653] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:30:53.739612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ce714-7ded-4952-acab-0f2b3e80dd79 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:53.749881 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ce714-7ded-4952-acab-0f2b3e80dd79 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:53.755811 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223bfdf2-e8be-461f-bf72-af0e735c4e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:53.756573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bfdf2-e8be-461f-bf72-af0e735c4e47 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:53.756859 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bfdf2-e8be-461f-bf72-af0e735c4e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:53.757213 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bfdf2-e8be-461f-bf72-af0e735c4e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:53.757892 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223bfdf2-e8be-461f-bf72-af0e735c4e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:53.759560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223bfdf2-e8be-461f-bf72-af0e735c4e47 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:53.773912 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1333/2654] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:30:53.775128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223bfdf2-e8be-461f-bf72-af0e735c4e47 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:53.785047 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223bfdf2-e8be-461f-bf72-af0e735c4e47 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:53.786229 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95771396-37ab-4c97-9ef7-68b26969e6d7 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:53.789652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a0141-da82-459f-bea2-2aff5348c0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:53.790064 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09a4c9-5723-48d2-8696-b9ede22a5e0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:53.790291 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a0141-da82-459f-bea2-2aff5348c0b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:53.790571 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a0141-da82-459f-bea2-2aff5348c0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:53.790903 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09a4c9-5723-48d2-8696-b9ede22a5e0d service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:53.791020 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a0141-da82-459f-bea2-2aff5348c0b3 admin admin] PATH_INFO: `/v3/projects/841d88d16b95497cb152a0a45db3a25a/users/1878933f9b24463e8c2e0a2cf69250cb/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:53.791117 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09a4c9-5723-48d2-8696-b9ede22a5e0d service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:53.791225 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09a4c9-5723-48d2-8696-b9ede22a5e0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:53.801810 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09a4c9-5723-48d2-8696-b9ede22a5e0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:53.803256 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09a4c9-5723-48d2-8696-b9ede22a5e0d service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:53.806580 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a0141-da82-459f-bea2-2aff5348c0b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=841d88d16b95497cb152a0a45db3a25a, user_id=1878933f9b24463e8c2e0a2cf69250cb, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:53.810321 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a0141-da82-459f-bea2-2aff5348c0b3 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:53.813684 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1322/2655] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:30:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:30:53.909008 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1334/2656] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:30:53 2022] PUT /identity/v3/projects/841d88d16b95497cb152a0a45db3a25a/users/1878933f9b24463e8c2e0a2cf69250cb/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:53.921359 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15379f8-b1a2-43a3-bae5-34dc9eb43388 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:53.921600 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15379f8-b1a2-43a3-bae5-34dc9eb43388 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:53.922106 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15379f8-b1a2-43a3-bae5-34dc9eb43388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:53.968340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-e15379f8-b1a2-43a3-bae5-34dc9eb43388 None None] MFA Rules not processed for user `1878933f9b24463e8c2e0a2cf69250cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:53.974480 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-e15379f8-b1a2-43a3-bae5-34dc9eb43388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:54.002051 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:54.058058 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1323/2657] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:54.064063 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a0141-da82-459f-bea2-2aff5348c0b3 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:54.161828 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:54.183605 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a0141-da82-459f-bea2-2aff5348c0b3 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:54.196934 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558a5a4-2e8f-412b-8ef0-f4fe695d4d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:54.197669 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558a5a4-2e8f-412b-8ef0-f4fe695d4d42 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:54.197966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558a5a4-2e8f-412b-8ef0-f4fe695d4d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:54.198315 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558a5a4-2e8f-412b-8ef0-f4fe695d4d42 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:54.199033 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558a5a4-2e8f-412b-8ef0-f4fe695d4d42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:54.201774 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558a5a4-2e8f-412b-8ef0-f4fe695d4d42 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:54.316811 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15379f8-b1a2-43a3-bae5-34dc9eb43388 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:54.333454 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1335/2658] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:30:54 2022] POST /identity/v3/projects => generated 379 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:30:54.343673 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15379f8-b1a2-43a3-bae5-34dc9eb43388 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:54.422750 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c760db-3c6d-4f61-b372-18035ec4143c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:54.423744 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c760db-3c6d-4f61-b372-18035ec4143c admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:54.424202 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c760db-3c6d-4f61-b372-18035ec4143c admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:54.424672 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c760db-3c6d-4f61-b372-18035ec4143c admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:54.425602 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c760db-3c6d-4f61-b372-18035ec4143c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:54.428019 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c760db-3c6d-4f61-b372-18035ec4143c admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:54.528521 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1324/2659] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:30:54 2022] POST /identity/v3/users => generated 296 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:30:54.532477 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558a5a4-2e8f-412b-8ef0-f4fe695d4d42 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:54.555938 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558a5a4-2e8f-412b-8ef0-f4fe695d4d42 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:54.570831 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5ecd4-fd85-405b-9fc6-1211ffa47dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:54.573659 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5ecd4-fd85-405b-9fc6-1211ffa47dfa admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:54.574639 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5ecd4-fd85-405b-9fc6-1211ffa47dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:54.574927 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5ecd4-fd85-405b-9fc6-1211ffa47dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:54.576685 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5ecd4-fd85-405b-9fc6-1211ffa47dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:54.584557 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5ecd4-fd85-405b-9fc6-1211ffa47dfa admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:54.614225 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1336/2660] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:30:54.618898 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c760db-3c6d-4f61-b372-18035ec4143c admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:54.632630 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c760db-3c6d-4f61-b372-18035ec4143c admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:54.644828 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744371c-92ea-484a-bce0-44162d264d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:54.645604 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744371c-92ea-484a-bce0-44162d264d50 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:54.649007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744371c-92ea-484a-bce0-44162d264d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:54.649007 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744371c-92ea-484a-bce0-44162d264d50 admin admin] PATH_INFO: `/v3/projects/cc2ebf9b342448929a057b008d43c417/users/09819b97c277466784e4148a7a1dfede/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:54.664930 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744371c-92ea-484a-bce0-44162d264d50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc2ebf9b342448929a057b008d43c417, user_id=09819b97c277466784e4148a7a1dfede, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:54.667726 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744371c-92ea-484a-bce0-44162d264d50 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:54.686106 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5ecd4-fd85-405b-9fc6-1211ffa47dfa admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:54.686106 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-d5a5ecd4-fd85-405b-9fc6-1211ffa47dfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:54.698373 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5ecd4-fd85-405b-9fc6-1211ffa47dfa admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:54.703421 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27827600-525a-4d9d-952d-02f33c57e604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:54.704144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27827600-525a-4d9d-952d-02f33c57e604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:54.704476 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27827600-525a-4d9d-952d-02f33c57e604 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:54.704817 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27827600-525a-4d9d-952d-02f33c57e604 admin admin] PATH_INFO: `/v3/projects/e033baa2dd0f4a3094eabf64d08696fc` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:54.706744 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27827600-525a-4d9d-952d-02f33c57e604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e033baa2dd0f4a3094eabf64d08696fc)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:54.709249 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27827600-525a-4d9d-952d-02f33c57e604 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:54.740130 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1325/2661] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:30:54 2022] PUT /identity/v3/projects/cc2ebf9b342448929a057b008d43c417/users/09819b97c277466784e4148a7a1dfede/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:54.744261 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744371c-92ea-484a-bce0-44162d264d50 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:54.825455 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744371c-92ea-484a-bce0-44162d264d50 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:54.833716 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f3986-ba38-4938-a424-d5922a60c00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:54.834757 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f3986-ba38-4938-a424-d5922a60c00a admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:54.835194 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f3986-ba38-4938-a424-d5922a60c00a admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:54.835851 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f3986-ba38-4938-a424-d5922a60c00a admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:54.836942 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f3986-ba38-4938-a424-d5922a60c00a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:54.839621 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f3986-ba38-4938-a424-d5922a60c00a admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:54.852751 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1326/2662] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:30:54.856046 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-27827600-525a-4d9d-952d-02f33c57e604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e033baa2dd0f4a3094eabf64d08696fc', 'request_id': 'req-27827600-525a-4d9d-952d-02f33c57e604'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:54.857012 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f3986-ba38-4938-a424-d5922a60c00a admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:54.873460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f3986-ba38-4938-a424-d5922a60c00a admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:54.876722 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-27827600-525a-4d9d-952d-02f33c57e604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e033baa2dd0f4a3094eabf64d08696fc', 'request_id': 'req-27827600-525a-4d9d-952d-02f33c57e604'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:54.890761 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-27827600-525a-4d9d-952d-02f33c57e604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e033baa2dd0f4a3094eabf64d08696fc', 'request_id': 'req-27827600-525a-4d9d-952d-02f33c57e604'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:54.920526 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:54.964836 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b9739-80b1-4973-85db-dbe87775f375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:54.970344 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b9739-80b1-4973-85db-dbe87775f375 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:54.970761 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b9739-80b1-4973-85db-dbe87775f375 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:54.970968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-27827600-525a-4d9d-952d-02f33c57e604 admin admin] The token cache is being invalidate because project e033baa2dd0f4a3094eabf64d08696fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:30:54.971168 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b9739-80b1-4973-85db-dbe87775f375 admin admin] PATH_INFO: `/v3/projects/cc2ebf9b342448929a057b008d43c417/users/09819b97c277466784e4148a7a1dfede/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:54.971264 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-27827600-525a-4d9d-952d-02f33c57e604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:54.974304 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b9739-80b1-4973-85db-dbe87775f375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc2ebf9b342448929a057b008d43c417, user_id=09819b97c277466784e4148a7a1dfede, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:54.977773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b9739-80b1-4973-85db-dbe87775f375 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:54.979347 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-27827600-525a-4d9d-952d-02f33c57e604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:54.981416 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1337/2663] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:30:54 2022] DELETE /identity/v3/projects/e033baa2dd0f4a3094eabf64d08696fc => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:54.985321 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27827600-525a-4d9d-952d-02f33c57e604 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:54.986748 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-27827600-525a-4d9d-952d-02f33c57e604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:55.002748 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1327/2664] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:30:54 2022] PUT /identity/v3/projects/cc2ebf9b342448929a057b008d43c417/users/09819b97c277466784e4148a7a1dfede/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:55.003553 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27827600-525a-4d9d-952d-02f33c57e604 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:55.026232 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ba08f-3f7b-4858-9d40-dcd8db19cf3f None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:55.026554 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ba08f-3f7b-4858-9d40-dcd8db19cf3f None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:55.026805 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ba08f-3f7b-4858-9d40-dcd8db19cf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:55.086485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-7d2ba08f-3f7b-4858-9d40-dcd8db19cf3f None None] MFA Rules not processed for user `09819b97c277466784e4148a7a1dfede`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:55.088101 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-7d2ba08f-3f7b-4858-9d40-dcd8db19cf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:55.098335 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3a922-a815-42e2-9e7f-cfb249cb2713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:55.099047 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3a922-a815-42e2-9e7f-cfb249cb2713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:55.099330 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3a922-a815-42e2-9e7f-cfb249cb2713 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:55.099606 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3a922-a815-42e2-9e7f-cfb249cb2713 admin admin] PATH_INFO: `/v3/users/2dfb03d97a6843968259bda6bd877be7` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:55.101056 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3a922-a815-42e2-9e7f-cfb249cb2713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dfb03d97a6843968259bda6bd877be7)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:55.103826 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3a922-a815-42e2-9e7f-cfb249cb2713 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:55.196006 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1328/2665] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:55 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:30:55.209626 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ba08f-3f7b-4858-9d40-dcd8db19cf3f None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:55.211096 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-7d2ba08f-3f7b-4858-9d40-dcd8db19cf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:55.277592 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ba08f-3f7b-4858-9d40-dcd8db19cf3f None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:55.281758 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f0d9f-8740-41c2-8070-d018dc4308ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:55.282384 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f0d9f-8740-41c2-8070-d018dc4308ea service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:55.282691 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f0d9f-8740-41c2-8070-d018dc4308ea service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:55.282984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f0d9f-8740-41c2-8070-d018dc4308ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:55.292993 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f0d9f-8740-41c2-8070-d018dc4308ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:55.294473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f0d9f-8740-41c2-8070-d018dc4308ea service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:55.307951 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1329/2666] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:30:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:30:55.322238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:55.323957 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-29f3a922-a815-42e2-9e7f-cfb249cb2713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dfb03d97a6843968259bda6bd877be7'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:55.401498 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-29f3a922-a815-42e2-9e7f-cfb249cb2713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dfb03d97a6843968259bda6bd877be7'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:55.412907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-29f3a922-a815-42e2-9e7f-cfb249cb2713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dfb03d97a6843968259bda6bd877be7'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:55.426313 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-29f3a922-a815-42e2-9e7f-cfb249cb2713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dfb03d97a6843968259bda6bd877be7'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:55.427096 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-29f3a922-a815-42e2-9e7f-cfb249cb2713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dfb03d97a6843968259bda6bd877be7'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:55.434965 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1338/2667] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:30:54 2022] DELETE /identity/v3/users/2dfb03d97a6843968259bda6bd877be7 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:55.915650 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f0d9f-8740-41c2-8070-d018dc4308ea service cinder] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:55.931317 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f0d9f-8740-41c2-8070-d018dc4308ea service cinder] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:56.014771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:56.025461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3dbf8-ff74-4cd3-8621-2956a0e4556b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:56.026235 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3dbf8-ff74-4cd3-8621-2956a0e4556b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:56.026523 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3dbf8-ff74-4cd3-8621-2956a0e4556b admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:56.026800 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3dbf8-ff74-4cd3-8621-2956a0e4556b admin admin] PATH_INFO: `/v3/projects/929a5a4fabcb471f973fa18c15aaab3a` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:56.027986 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a3dbf8-ff74-4cd3-8621-2956a0e4556b admin admin] RBAC: Authorizing `identity:delete_project(project_id=929a5a4fabcb471f973fa18c15aaab3a)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:56.030074 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a3dbf8-ff74-4cd3-8621-2956a0e4556b admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:56.185958 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-d1a3dbf8-ff74-4cd3-8621-2956a0e4556b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '929a5a4fabcb471f973fa18c15aaab3a', 'request_id': 'req-d1a3dbf8-ff74-4cd3-8621-2956a0e4556b'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:56.193585 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-d1a3dbf8-ff74-4cd3-8621-2956a0e4556b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '929a5a4fabcb471f973fa18c15aaab3a', 'request_id': 'req-d1a3dbf8-ff74-4cd3-8621-2956a0e4556b'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:56.199320 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-d1a3dbf8-ff74-4cd3-8621-2956a0e4556b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '929a5a4fabcb471f973fa18c15aaab3a', 'request_id': 'req-d1a3dbf8-ff74-4cd3-8621-2956a0e4556b'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:56.324831 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-d1a3dbf8-ff74-4cd3-8621-2956a0e4556b admin admin] The token cache is being invalidate because project 929a5a4fabcb471f973fa18c15aaab3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:30:56.325311 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-d1a3dbf8-ff74-4cd3-8621-2956a0e4556b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:56.325940 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-d1a3dbf8-ff74-4cd3-8621-2956a0e4556b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:56.327451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1330/2668] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:30:55 2022] DELETE /identity/v3/projects/929a5a4fabcb471f973fa18c15aaab3a => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:56.333276 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972b408-fe5e-4c39-abcb-7178d1bbea49 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:56.333773 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972b408-fe5e-4c39-abcb-7178d1bbea49 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:56.333876 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972b408-fe5e-4c39-abcb-7178d1bbea49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:56.357626 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-2972b408-fe5e-4c39-abcb-7178d1bbea49 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:56.359248 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-2972b408-fe5e-4c39-abcb-7178d1bbea49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:56.436331 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1339/2669] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:56.438881 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af156449-26ff-4c06-a521-373a1a9ac4e7 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:56.439497 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af156449-26ff-4c06-a521-373a1a9ac4e7 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:56.440099 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af156449-26ff-4c06-a521-373a1a9ac4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:56.468888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-af156449-26ff-4c06-a521-373a1a9ac4e7 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:56.470226 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-af156449-26ff-4c06-a521-373a1a9ac4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:56.484414 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1331/2670] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:56.485767 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972b408-fe5e-4c39-abcb-7178d1bbea49 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:56.502894 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af156449-26ff-4c06-a521-373a1a9ac4e7 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:56.504846 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972b408-fe5e-4c39-abcb-7178d1bbea49 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:56.505034 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-af156449-26ff-4c06-a521-373a1a9ac4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:56.509439 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b2a0d-69bd-40af-a0c6-398fcf7f1ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:56.510275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b2a0d-69bd-40af-a0c6-398fcf7f1ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:56.510561 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b2a0d-69bd-40af-a0c6-398fcf7f1ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:56.510839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b2a0d-69bd-40af-a0c6-398fcf7f1ba5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:56.512239 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b2a0d-69bd-40af-a0c6-398fcf7f1ba5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:30:56.512584 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b2a0d-69bd-40af-a0c6-398fcf7f1ba5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:56.514503 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b2a0d-69bd-40af-a0c6-398fcf7f1ba5 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:56.534164 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1340/2671] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 04:30:56.535250 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b2a0d-69bd-40af-a0c6-398fcf7f1ba5 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:56.552217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b2a0d-69bd-40af-a0c6-398fcf7f1ba5 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:56.557726 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342b88d-d0d4-4fde-94b2-2ce3e58f91ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:56.558342 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342b88d-d0d4-4fde-94b2-2ce3e58f91ce admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:56.558628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342b88d-d0d4-4fde-94b2-2ce3e58f91ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:56.558934 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342b88d-d0d4-4fde-94b2-2ce3e58f91ce admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:56.559529 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342b88d-d0d4-4fde-94b2-2ce3e58f91ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:56.561471 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342b88d-d0d4-4fde-94b2-2ce3e58f91ce admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:56.595572 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af156449-26ff-4c06-a521-373a1a9ac4e7 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:56.600579 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40becb7c-3cde-4252-b7a0-11c30aef8bad tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09819b97c277466784e4148a7a1dfede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc2ebf9b342448929a057b008d43c417', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:56.601239 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40becb7c-3cde-4252-b7a0-11c30aef8bad tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:56.601526 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40becb7c-3cde-4252-b7a0-11c30aef8bad tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:56.601803 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40becb7c-3cde-4252-b7a0-11c30aef8bad tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:56.602797 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40becb7c-3cde-4252-b7a0-11c30aef8bad tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:30:56.602929 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40becb7c-3cde-4252-b7a0-11c30aef8bad tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:56.604578 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40becb7c-3cde-4252-b7a0-11c30aef8bad tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:56.618270 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1332/2672] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:30:56.622033 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40becb7c-3cde-4252-b7a0-11c30aef8bad tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:56.634526 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40becb7c-3cde-4252-b7a0-11c30aef8bad tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:56.640860 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc029856-b7fc-4fe1-b733-1af2cacfe5a7 tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09819b97c277466784e4148a7a1dfede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc2ebf9b342448929a057b008d43c417', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:56.641513 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc029856-b7fc-4fe1-b733-1af2cacfe5a7 tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:56.641905 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc029856-b7fc-4fe1-b733-1af2cacfe5a7 tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:56.642188 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc029856-b7fc-4fe1-b733-1af2cacfe5a7 tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:56.642833 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc029856-b7fc-4fe1-b733-1af2cacfe5a7 tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:56.646077 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc029856-b7fc-4fe1-b733-1af2cacfe5a7 tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:56.663288 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1341/2673] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:30:56 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:30:56.669223 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342b88d-d0d4-4fde-94b2-2ce3e58f91ce admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:56.755266 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1333/2674] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:30:56 2022] POST /identity/v3/projects => generated 354 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:30:56.755959 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342b88d-d0d4-4fde-94b2-2ce3e58f91ce admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:56.756438 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc029856-b7fc-4fe1-b733-1af2cacfe5a7 tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:56.802946 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:56.834405 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:56.837029 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8be63d-755b-45ca-8798-722a4a1e1880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:56.837863 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8be63d-755b-45ca-8798-722a4a1e1880 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:56.838212 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8be63d-755b-45ca-8798-722a4a1e1880 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:56.838623 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8be63d-755b-45ca-8798-722a4a1e1880 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:56.839460 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8be63d-755b-45ca-8798-722a4a1e1880 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:56.841742 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8be63d-755b-45ca-8798-722a4a1e1880 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:56.873162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc029856-b7fc-4fe1-b733-1af2cacfe5a7 tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:56.884935 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a315db-0201-4d6e-82e5-77e6c85cd9b3 tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09819b97c277466784e4148a7a1dfede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc2ebf9b342448929a057b008d43c417', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:56.885893 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a315db-0201-4d6e-82e5-77e6c85cd9b3 tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:56.886181 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a315db-0201-4d6e-82e5-77e6c85cd9b3 tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:56.886464 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a315db-0201-4d6e-82e5-77e6c85cd9b3 tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:56.887145 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a315db-0201-4d6e-82e5-77e6c85cd9b3 tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:30:56.887459 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a315db-0201-4d6e-82e5-77e6c85cd9b3 tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:56.889115 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a315db-0201-4d6e-82e5-77e6c85cd9b3 tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:56.902539 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1334/2675] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:30:56.934083 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1342/2676] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:30:56 2022] POST /identity/v3/users => generated 288 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:30:56.947069 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a315db-0201-4d6e-82e5-77e6c85cd9b3 tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:56.960235 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a315db-0201-4d6e-82e5-77e6c85cd9b3 tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:56.965018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23ea51-188c-4cc4-9c24-78f4e9578afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:56.965899 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23ea51-188c-4cc4-9c24-78f4e9578afc admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:56.972143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23ea51-188c-4cc4-9c24-78f4e9578afc admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:56.972143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23ea51-188c-4cc4-9c24-78f4e9578afc admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:56.972421 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8be63d-755b-45ca-8798-722a4a1e1880 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:56.972524 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23ea51-188c-4cc4-9c24-78f4e9578afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:56.972524 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23ea51-188c-4cc4-9c24-78f4e9578afc admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:56.978464 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8be63d-755b-45ca-8798-722a4a1e1880 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:56.982392 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1335/2677] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:30:56.988961 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23ea51-188c-4cc4-9c24-78f4e9578afc admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:56.993701 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9df6c-ae3b-4300-be1d-35707ec08536 tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09819b97c277466784e4148a7a1dfede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc2ebf9b342448929a057b008d43c417', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:56.994582 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9df6c-ae3b-4300-be1d-35707ec08536 tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:56.994884 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9df6c-ae3b-4300-be1d-35707ec08536 tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:56.995140 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9df6c-ae3b-4300-be1d-35707ec08536 tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] PATH_INFO: `/v3/projects/c1a38a6598444dea8d9cf90e4da23355` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:56.998594 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9df6c-ae3b-4300-be1d-35707ec08536 tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c1a38a6598444dea8d9cf90e4da23355)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:57.001015 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9df6c-ae3b-4300-be1d-35707ec08536 tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:57.006899 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23ea51-188c-4cc4-9c24-78f4e9578afc admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:57.017641 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15265b-7853-4dc2-a026-aaa088ab5b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:57.018278 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15265b-7853-4dc2-a026-aaa088ab5b4a admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:57.018597 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15265b-7853-4dc2-a026-aaa088ab5b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:57.018898 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15265b-7853-4dc2-a026-aaa088ab5b4a admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:57.019527 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15265b-7853-4dc2-a026-aaa088ab5b4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:57.021454 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15265b-7853-4dc2-a026-aaa088ab5b4a admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:57.032929 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1336/2678] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:30:57.037199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15265b-7853-4dc2-a026-aaa088ab5b4a admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:57.047707 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15265b-7853-4dc2-a026-aaa088ab5b4a admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:57.054276 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738185d0-d202-43c0-b1b6-62d74599a843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:57.058518 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738185d0-d202-43c0-b1b6-62d74599a843 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:57.058518 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738185d0-d202-43c0-b1b6-62d74599a843 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:57.058518 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738185d0-d202-43c0-b1b6-62d74599a843 admin admin] PATH_INFO: `/v3/projects/4f2d9e1ba0074e63822981a5c80edcf4/users/12f824ffcc7d415788c7a7ae2aba9663/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:57.076509 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738185d0-d202-43c0-b1b6-62d74599a843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f2d9e1ba0074e63822981a5c80edcf4, user_id=12f824ffcc7d415788c7a7ae2aba9663, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:57.079836 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738185d0-d202-43c0-b1b6-62d74599a843 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:57.158838 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1337/2679] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:30:57 2022] PUT /identity/v3/projects/4f2d9e1ba0074e63822981a5c80edcf4/users/12f824ffcc7d415788c7a7ae2aba9663/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:30:57.167055 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-afd9df6c-ae3b-4300-be1d-35707ec08536 tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1a38a6598444dea8d9cf90e4da23355', 'request_id': 'req-afd9df6c-ae3b-4300-be1d-35707ec08536'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:57.169135 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbb7f1-2e82-4b96-acf6-3ed27364524d None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:57.169433 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbb7f1-2e82-4b96-acf6-3ed27364524d None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:57.169711 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbb7f1-2e82-4b96-acf6-3ed27364524d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:57.176414 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-afd9df6c-ae3b-4300-be1d-35707ec08536 tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1a38a6598444dea8d9cf90e4da23355', 'request_id': 'req-afd9df6c-ae3b-4300-be1d-35707ec08536'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:57.183599 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-afd9df6c-ae3b-4300-be1d-35707ec08536 tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1a38a6598444dea8d9cf90e4da23355', 'request_id': 'req-afd9df6c-ae3b-4300-be1d-35707ec08536'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:57.206982 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-51dbb7f1-2e82-4b96-acf6-3ed27364524d None None] MFA Rules not processed for user `12f824ffcc7d415788c7a7ae2aba9663`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:57.208225 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-51dbb7f1-2e82-4b96-acf6-3ed27364524d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:57.263890 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-afd9df6c-ae3b-4300-be1d-35707ec08536 tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] The token cache is being invalidate because project c1a38a6598444dea8d9cf90e4da23355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:30:57.264118 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-afd9df6c-ae3b-4300-be1d-35707ec08536 tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:57.264757 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-afd9df6c-ae3b-4300-be1d-35707ec08536 tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:57.266595 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1343/2680] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:30:56 2022] DELETE /identity/v3/projects/c1a38a6598444dea8d9cf90e4da23355 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:30:57.308800 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1338/2681] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:30:57.323474 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9df6c-ae3b-4300-be1d-35707ec08536 tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:57.324892 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-afd9df6c-ae3b-4300-be1d-35707ec08536 tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:57.390553 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9df6c-ae3b-4300-be1d-35707ec08536 tempest-VolumeQuotaClassesTest-205537865 tempest-VolumeQuotaClassesTest-205537865-project-admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:57.394933 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503fc55-f137-40f8-8e4b-96e084ee8d3f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '020af86302e447a6b3973df4abbabafa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:57.395617 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503fc55-f137-40f8-8e4b-96e084ee8d3f service glance] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:57.395898 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503fc55-f137-40f8-8e4b-96e084ee8d3f service glance] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:57.396171 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503fc55-f137-40f8-8e4b-96e084ee8d3f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:57.406666 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503fc55-f137-40f8-8e4b-96e084ee8d3f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:57.408141 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503fc55-f137-40f8-8e4b-96e084ee8d3f service glance] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:57.418693 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1344/2682] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:30:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:30:58.594477 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbb7f1-2e82-4b96-acf6-3ed27364524d None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:58.596005 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-51dbb7f1-2e82-4b96-acf6-3ed27364524d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:58.686372 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbb7f1-2e82-4b96-acf6-3ed27364524d None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:58.694698 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cee01-0779-4b17-a1bd-d7e5e57c64fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:58.696221 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cee01-0779-4b17-a1bd-d7e5e57c64fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:58.696221 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cee01-0779-4b17-a1bd-d7e5e57c64fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:58.696221 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cee01-0779-4b17-a1bd-d7e5e57c64fb admin admin] PATH_INFO: `/v3/users/1878933f9b24463e8c2e0a2cf69250cb` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:58.697288 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493cee01-0779-4b17-a1bd-d7e5e57c64fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1878933f9b24463e8c2e0a2cf69250cb)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:58.699264 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493cee01-0779-4b17-a1bd-d7e5e57c64fb admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:58.825071 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:58.957613 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-493cee01-0779-4b17-a1bd-d7e5e57c64fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1878933f9b24463e8c2e0a2cf69250cb'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:58.957613 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-493cee01-0779-4b17-a1bd-d7e5e57c64fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1878933f9b24463e8c2e0a2cf69250cb'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:58.963634 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-493cee01-0779-4b17-a1bd-d7e5e57c64fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1878933f9b24463e8c2e0a2cf69250cb'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:58.964431 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-493cee01-0779-4b17-a1bd-d7e5e57c64fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1878933f9b24463e8c2e0a2cf69250cb'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:58.979044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-493cee01-0779-4b17-a1bd-d7e5e57c64fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1878933f9b24463e8c2e0a2cf69250cb'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:59.051628 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1339/2683] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:30:58 2022] DELETE /identity/v3/users/1878933f9b24463e8c2e0a2cf69250cb => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:30:59.056414 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29ca3a-125b-40b9-83b0-29c6736e0041 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:59.056940 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29ca3a-125b-40b9-83b0-29c6736e0041 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:59.057049 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29ca3a-125b-40b9-83b0-29c6736e0041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:59.077752 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-9f29ca3a-125b-40b9-83b0-29c6736e0041 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:30:59.079007 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-9f29ca3a-125b-40b9-83b0-29c6736e0041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:59.164581 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:30:59.185502 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1345/2684] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:30:59.202096 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cee01-0779-4b17-a1bd-d7e5e57c64fb admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:59.204208 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-493cee01-0779-4b17-a1bd-d7e5e57c64fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:59.301515 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cee01-0779-4b17-a1bd-d7e5e57c64fb admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:59.308875 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cb833-f84a-4349-90e2-9bad9076429d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:59.310200 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cb833-f84a-4349-90e2-9bad9076429d service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:59.310897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cb833-f84a-4349-90e2-9bad9076429d service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:59.311351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cb833-f84a-4349-90e2-9bad9076429d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:59.328158 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7cb833-f84a-4349-90e2-9bad9076429d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:59.329701 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7cb833-f84a-4349-90e2-9bad9076429d service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:59.341814 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1340/2685] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:30:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:30:59.814343 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29ca3a-125b-40b9-83b0-29c6736e0041 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:30:59.816078 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-9f29ca3a-125b-40b9-83b0-29c6736e0041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:30:59.830788 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29ca3a-125b-40b9-83b0-29c6736e0041 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:30:59.836974 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce667e1-b179-4862-9532-e162030e7d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:30:59.841534 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce667e1-b179-4862-9532-e162030e7d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:30:59.841838 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce667e1-b179-4862-9532-e162030e7d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:30:59.842178 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce667e1-b179-4862-9532-e162030e7d02 admin admin] PATH_INFO: `/v3/projects/841d88d16b95497cb152a0a45db3a25a` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:30:59.843562 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce667e1-b179-4862-9532-e162030e7d02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=841d88d16b95497cb152a0a45db3a25a)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:30:59.846420 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce667e1-b179-4862-9532-e162030e7d02 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:30:59.972258 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-0ce667e1-b179-4862-9532-e162030e7d02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '841d88d16b95497cb152a0a45db3a25a', 'request_id': 'req-0ce667e1-b179-4862-9532-e162030e7d02'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:59.981194 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-0ce667e1-b179-4862-9532-e162030e7d02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '841d88d16b95497cb152a0a45db3a25a', 'request_id': 'req-0ce667e1-b179-4862-9532-e162030e7d02'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:30:59.993074 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-0ce667e1-b179-4862-9532-e162030e7d02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '841d88d16b95497cb152a0a45db3a25a', 'request_id': 'req-0ce667e1-b179-4862-9532-e162030e7d02'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:00.067368 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-0ce667e1-b179-4862-9532-e162030e7d02 admin admin] The token cache is being invalidate because project 841d88d16b95497cb152a0a45db3a25a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:31:00.068161 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-0ce667e1-b179-4862-9532-e162030e7d02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:00.068582 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-0ce667e1-b179-4862-9532-e162030e7d02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:00.070613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1346/2686] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:30:59 2022] DELETE /identity/v3/projects/841d88d16b95497cb152a0a45db3a25a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:31:00.074998 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cb833-f84a-4349-90e2-9bad9076429d service neutron] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:00.087478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cb833-f84a-4349-90e2-9bad9076429d service neutron] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:00.157606 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70aa292-5eb4-4603-9edb-09d6e8835cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:00.158354 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70aa292-5eb4-4603-9edb-09d6e8835cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:00.158707 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70aa292-5eb4-4603-9edb-09d6e8835cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:00.159106 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70aa292-5eb4-4603-9edb-09d6e8835cb8 admin admin] PATH_INFO: `/v3/users/09819b97c277466784e4148a7a1dfede` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:00.160791 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70aa292-5eb4-4603-9edb-09d6e8835cb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09819b97c277466784e4148a7a1dfede)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:00.162774 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70aa292-5eb4-4603-9edb-09d6e8835cb8 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:00.418187 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-f70aa292-5eb4-4603-9edb-09d6e8835cb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09819b97c277466784e4148a7a1dfede'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:00.419308 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-f70aa292-5eb4-4603-9edb-09d6e8835cb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09819b97c277466784e4148a7a1dfede'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:00.421654 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:00.429253 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-f70aa292-5eb4-4603-9edb-09d6e8835cb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09819b97c277466784e4148a7a1dfede'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:00.430031 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-f70aa292-5eb4-4603-9edb-09d6e8835cb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09819b97c277466784e4148a7a1dfede'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:00.442905 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-f70aa292-5eb4-4603-9edb-09d6e8835cb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09819b97c277466784e4148a7a1dfede'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:00.544574 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1341/2687] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:31:00 2022] DELETE /identity/v3/users/09819b97c277466784e4148a7a1dfede => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:31:01.011876 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce667e1-b179-4862-9532-e162030e7d02 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:01.013069 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-0ce667e1-b179-4862-9532-e162030e7d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:01.052422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce667e1-b179-4862-9532-e162030e7d02 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:01.122598 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614ea66-fab9-4bbd-adba-6fc923682412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:01.123311 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614ea66-fab9-4bbd-adba-6fc923682412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:01.123522 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614ea66-fab9-4bbd-adba-6fc923682412 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:01.123798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614ea66-fab9-4bbd-adba-6fc923682412 admin admin] PATH_INFO: `/v3/projects/cc2ebf9b342448929a057b008d43c417` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:01.124939 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614ea66-fab9-4bbd-adba-6fc923682412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc2ebf9b342448929a057b008d43c417)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:01.133870 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614ea66-fab9-4bbd-adba-6fc923682412 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:01.260061 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b614ea66-fab9-4bbd-adba-6fc923682412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc2ebf9b342448929a057b008d43c417', 'request_id': 'req-b614ea66-fab9-4bbd-adba-6fc923682412'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:01.266346 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b614ea66-fab9-4bbd-adba-6fc923682412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc2ebf9b342448929a057b008d43c417', 'request_id': 'req-b614ea66-fab9-4bbd-adba-6fc923682412'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:01.272420 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b614ea66-fab9-4bbd-adba-6fc923682412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc2ebf9b342448929a057b008d43c417', 'request_id': 'req-b614ea66-fab9-4bbd-adba-6fc923682412'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:01.361189 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b614ea66-fab9-4bbd-adba-6fc923682412 admin admin] The token cache is being invalidate because project cc2ebf9b342448929a057b008d43c417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:31:01.361599 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b614ea66-fab9-4bbd-adba-6fc923682412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:01.362811 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b614ea66-fab9-4bbd-adba-6fc923682412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:01.364568 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1347/2688] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:31:01 2022] DELETE /identity/v3/projects/cc2ebf9b342448929a057b008d43c417 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:31:01.369335 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37eb5a-ec79-465d-9f2d-67fd53753dfc None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:01.369902 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37eb5a-ec79-465d-9f2d-67fd53753dfc None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:01.369902 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37eb5a-ec79-465d-9f2d-67fd53753dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:01.398907 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-4b37eb5a-ec79-465d-9f2d-67fd53753dfc None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:31:01.400361 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-4b37eb5a-ec79-465d-9f2d-67fd53753dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:01.482176 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1342/2689] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:31:01.490672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dda593-cbcc-4960-9e27-3db0e0dd3acc None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:01.490984 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dda593-cbcc-4960-9e27-3db0e0dd3acc None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:01.491234 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dda593-cbcc-4960-9e27-3db0e0dd3acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:01.499915 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:01.515797 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-c5dda593-cbcc-4960-9e27-3db0e0dd3acc None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:31:01.515797 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c5dda593-cbcc-4960-9e27-3db0e0dd3acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:01.524132 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1348/2690] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:31:01.530027 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37eb5a-ec79-465d-9f2d-67fd53753dfc None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:01.551139 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37eb5a-ec79-465d-9f2d-67fd53753dfc None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:01.556966 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbcaa8-f783-4769-a15e-cf44be14768c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:01.557897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbcaa8-f783-4769-a15e-cf44be14768c admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:01.558186 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbcaa8-f783-4769-a15e-cf44be14768c admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:01.558485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbcaa8-f783-4769-a15e-cf44be14768c admin admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:01.559183 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bbcaa8-f783-4769-a15e-cf44be14768c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:31:01.559491 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bbcaa8-f783-4769-a15e-cf44be14768c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:01.561912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bbcaa8-f783-4769-a15e-cf44be14768c admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:01.586209 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1343/2691] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:31:01.590523 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dda593-cbcc-4960-9e27-3db0e0dd3acc None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:01.605297 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dda593-cbcc-4960-9e27-3db0e0dd3acc None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:01.625533 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a83cc-9adf-4fef-9bf5-5ad7bf2720a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:01.626678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a83cc-9adf-4fef-9bf5-5ad7bf2720a7 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:01.626678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a83cc-9adf-4fef-9bf5-5ad7bf2720a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:01.626898 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a83cc-9adf-4fef-9bf5-5ad7bf2720a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:01.627520 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a83cc-9adf-4fef-9bf5-5ad7bf2720a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:01.629583 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a83cc-9adf-4fef-9bf5-5ad7bf2720a7 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:01.731985 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1349/2692] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:31:01 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:31:01.741446 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbcaa8-f783-4769-a15e-cf44be14768c admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:01.748448 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbcaa8-f783-4769-a15e-cf44be14768c admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:01.832482 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3e122-4c64-4380-97ba-b4d2f449ea5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:01.833331 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3e122-4c64-4380-97ba-b4d2f449ea5e admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:01.833693 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3e122-4c64-4380-97ba-b4d2f449ea5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:01.834097 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3e122-4c64-4380-97ba-b4d2f449ea5e admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:01.834890 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3e122-4c64-4380-97ba-b4d2f449ea5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:01.837844 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3e122-4c64-4380-97ba-b4d2f449ea5e admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:01.937561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1344/2693] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:31:01 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:31:01.942243 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a83cc-9adf-4fef-9bf5-5ad7bf2720a7 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:01.953530 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a83cc-9adf-4fef-9bf5-5ad7bf2720a7 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:01.965864 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1735565-7f2d-4ab5-b442-2b56668a1ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:01.965864 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1735565-7f2d-4ab5-b442-2b56668a1ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:01.965864 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1735565-7f2d-4ab5-b442-2b56668a1ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:01.965864 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1735565-7f2d-4ab5-b442-2b56668a1ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:01.966284 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1735565-7f2d-4ab5-b442-2b56668a1ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:01.967923 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1735565-7f2d-4ab5-b442-2b56668a1ca2 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:01.983285 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1350/2694] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:31:01.984628 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3e122-4c64-4380-97ba-b4d2f449ea5e admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:01.995535 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3e122-4c64-4380-97ba-b4d2f449ea5e admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:02.000147 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc911aad-964c-4364-a7d4-4c03c3eb4642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:02.000749 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc911aad-964c-4364-a7d4-4c03c3eb4642 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:02.001033 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc911aad-964c-4364-a7d4-4c03c3eb4642 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:02.001340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc911aad-964c-4364-a7d4-4c03c3eb4642 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:02.001991 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc911aad-964c-4364-a7d4-4c03c3eb4642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:02.003615 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc911aad-964c-4364-a7d4-4c03c3eb4642 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:02.014716 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1345/2695] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:31:02.018877 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1735565-7f2d-4ab5-b442-2b56668a1ca2 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:02.032944 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1735565-7f2d-4ab5-b442-2b56668a1ca2 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:02.038250 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662beae-d50d-44c7-ab2d-838f68ec390a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:02.038973 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662beae-d50d-44c7-ab2d-838f68ec390a admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:02.039255 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662beae-d50d-44c7-ab2d-838f68ec390a admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:02.039559 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662beae-d50d-44c7-ab2d-838f68ec390a admin admin] PATH_INFO: `/v3/projects/6a4a8f8c76654396bba056923ffec343/users/a180fb11d9b94fed8a9c202c852792f4/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:02.055544 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662beae-d50d-44c7-ab2d-838f68ec390a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a4a8f8c76654396bba056923ffec343, user_id=a180fb11d9b94fed8a9c202c852792f4, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:02.058525 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662beae-d50d-44c7-ab2d-838f68ec390a admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:02.131344 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1351/2696] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:31:02 2022] PUT /identity/v3/projects/6a4a8f8c76654396bba056923ffec343/users/a180fb11d9b94fed8a9c202c852792f4/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:31:02.141703 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761976b5-eb9e-424f-87d0-fe489cfbf5e7 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:02.141995 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761976b5-eb9e-424f-87d0-fe489cfbf5e7 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:02.142276 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761976b5-eb9e-424f-87d0-fe489cfbf5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:02.173375 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-761976b5-eb9e-424f-87d0-fe489cfbf5e7 None None] MFA Rules not processed for user `a180fb11d9b94fed8a9c202c852792f4`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:31:02.175031 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-761976b5-eb9e-424f-87d0-fe489cfbf5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:02.194907 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:02.245872 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1346/2697] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:31:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:31:02.250478 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662beae-d50d-44c7-ab2d-838f68ec390a admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:02.314919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662beae-d50d-44c7-ab2d-838f68ec390a admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:02.319545 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378617d3-ac01-4b3b-bb0f-854b8bf89b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:02.320331 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378617d3-ac01-4b3b-bb0f-854b8bf89b64 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:02.320448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378617d3-ac01-4b3b-bb0f-854b8bf89b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:02.320700 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378617d3-ac01-4b3b-bb0f-854b8bf89b64 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:02.321370 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378617d3-ac01-4b3b-bb0f-854b8bf89b64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:02.323288 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378617d3-ac01-4b3b-bb0f-854b8bf89b64 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:02.438353 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1352/2698] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:31:02 2022] POST /identity/v3/projects => generated 381 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:31:02.439950 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761976b5-eb9e-424f-87d0-fe489cfbf5e7 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:02.451794 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761976b5-eb9e-424f-87d0-fe489cfbf5e7 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:02.509653 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ada6dc-193e-4314-9913-f88b253eb594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:02.510274 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ada6dc-193e-4314-9913-f88b253eb594 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:02.510561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ada6dc-193e-4314-9913-f88b253eb594 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:02.510868 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ada6dc-193e-4314-9913-f88b253eb594 admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:02.511507 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ada6dc-193e-4314-9913-f88b253eb594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:02.513475 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ada6dc-193e-4314-9913-f88b253eb594 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:02.628353 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1347/2699] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:31:02 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:31:02.632694 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378617d3-ac01-4b3b-bb0f-854b8bf89b64 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:02.642865 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378617d3-ac01-4b3b-bb0f-854b8bf89b64 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:02.648124 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae949c-2b2a-4c76-9216-7c8006435b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:02.649834 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae949c-2b2a-4c76-9216-7c8006435b49 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:02.649834 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae949c-2b2a-4c76-9216-7c8006435b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:02.649834 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae949c-2b2a-4c76-9216-7c8006435b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:02.650166 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae949c-2b2a-4c76-9216-7c8006435b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:02.651705 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae949c-2b2a-4c76-9216-7c8006435b49 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:02.662782 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1353/2700] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:31:02.666951 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ada6dc-193e-4314-9913-f88b253eb594 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:02.676863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ada6dc-193e-4314-9913-f88b253eb594 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:02.681663 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db46fae-eacf-436d-aec6-a8ea50e320ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:02.682316 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db46fae-eacf-436d-aec6-a8ea50e320ff admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:02.682852 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db46fae-eacf-436d-aec6-a8ea50e320ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:02.683129 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db46fae-eacf-436d-aec6-a8ea50e320ff admin admin] PATH_INFO: `/v3/projects/1bb55310dba340ba91a0bb29114d2840/users/6bca127736ec49c1abc4bf63afbf8a46/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:02.699904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db46fae-eacf-436d-aec6-a8ea50e320ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bb55310dba340ba91a0bb29114d2840, user_id=6bca127736ec49c1abc4bf63afbf8a46, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:02.702678 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db46fae-eacf-436d-aec6-a8ea50e320ff admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:02.782470 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1348/2701] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:31:02 2022] PUT /identity/v3/projects/1bb55310dba340ba91a0bb29114d2840/users/6bca127736ec49c1abc4bf63afbf8a46/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:31:02.786533 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae949c-2b2a-4c76-9216-7c8006435b49 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:02.797194 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae949c-2b2a-4c76-9216-7c8006435b49 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:02.859179 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ee36f-ef71-4dd8-bfc9-8c62b28311de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:02.859879 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ee36f-ef71-4dd8-bfc9-8c62b28311de admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:02.860163 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ee36f-ef71-4dd8-bfc9-8c62b28311de admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:02.860473 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ee36f-ef71-4dd8-bfc9-8c62b28311de admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:02.861161 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ee36f-ef71-4dd8-bfc9-8c62b28311de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:02.862839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ee36f-ef71-4dd8-bfc9-8c62b28311de admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:02.878509 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1354/2702] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:31:02.880521 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db46fae-eacf-436d-aec6-a8ea50e320ff admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:02.891408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db46fae-eacf-436d-aec6-a8ea50e320ff admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:02.896170 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771070f3-7839-4525-af57-3c9fd4b0fd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:02.896901 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771070f3-7839-4525-af57-3c9fd4b0fd1e admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:02.897298 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771070f3-7839-4525-af57-3c9fd4b0fd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:02.897668 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771070f3-7839-4525-af57-3c9fd4b0fd1e admin admin] PATH_INFO: `/v3/projects/1bb55310dba340ba91a0bb29114d2840/users/6bca127736ec49c1abc4bf63afbf8a46/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:02.899782 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771070f3-7839-4525-af57-3c9fd4b0fd1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bb55310dba340ba91a0bb29114d2840, user_id=6bca127736ec49c1abc4bf63afbf8a46, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:02.902739 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771070f3-7839-4525-af57-3c9fd4b0fd1e admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:02.917945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1349/2703] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:31:02 2022] PUT /identity/v3/projects/1bb55310dba340ba91a0bb29114d2840/users/6bca127736ec49c1abc4bf63afbf8a46/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:31:02.929561 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df984b38-e5d5-488f-a37e-88f42d1639df None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:02.930510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df984b38-e5d5-488f-a37e-88f42d1639df None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:02.930510 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df984b38-e5d5-488f-a37e-88f42d1639df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:02.951781 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:02.963216 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-df984b38-e5d5-488f-a37e-88f42d1639df None None] MFA Rules not processed for user `6bca127736ec49c1abc4bf63afbf8a46`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:31:02.964446 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-df984b38-e5d5-488f-a37e-88f42d1639df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:03.034578 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1355/2704] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:31:02 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:31:03.045852 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771070f3-7839-4525-af57-3c9fd4b0fd1e admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:03.047575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-771070f3-7839-4525-af57-3c9fd4b0fd1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:03.104998 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771070f3-7839-4525-af57-3c9fd4b0fd1e admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:03.108578 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503497c-da48-4954-a526-8e6061bdb1f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:03.109230 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503497c-da48-4954-a526-8e6061bdb1f6 service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:03.109504 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503497c-da48-4954-a526-8e6061bdb1f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:03.109773 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503497c-da48-4954-a526-8e6061bdb1f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:03.119041 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503497c-da48-4954-a526-8e6061bdb1f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:03.120469 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503497c-da48-4954-a526-8e6061bdb1f6 service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:03.131315 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1350/2705] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:31:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:31:03.307903 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df984b38-e5d5-488f-a37e-88f42d1639df None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:03.309375 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-df984b38-e5d5-488f-a37e-88f42d1639df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:03.322039 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df984b38-e5d5-488f-a37e-88f42d1639df None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:03.325722 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2776a-da5e-4a7a-bca1-309635906c12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:03.329303 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2776a-da5e-4a7a-bca1-309635906c12 service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:03.329303 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2776a-da5e-4a7a-bca1-309635906c12 service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:03.329303 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2776a-da5e-4a7a-bca1-309635906c12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:03.386403 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd2776a-da5e-4a7a-bca1-309635906c12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:03.387763 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd2776a-da5e-4a7a-bca1-309635906c12 service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:03.398068 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1356/2706] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:31:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:31:03.873674 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503497c-da48-4954-a526-8e6061bdb1f6 service cinder] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:03.891727 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:03.938800 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503497c-da48-4954-a526-8e6061bdb1f6 service cinder] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:03.944181 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8313b-9328-47b4-b1cc-4091765e15a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:03.944840 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8313b-9328-47b4-b1cc-4091765e15a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:03.945153 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8313b-9328-47b4-b1cc-4091765e15a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:03.945435 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8313b-9328-47b4-b1cc-4091765e15a2 admin admin] PATH_INFO: `/v3/users/a180fb11d9b94fed8a9c202c852792f4` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:03.949551 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8313b-9328-47b4-b1cc-4091765e15a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a180fb11d9b94fed8a9c202c852792f4)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:03.951656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8313b-9328-47b4-b1cc-4091765e15a2 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:04.132929 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-05f8313b-9328-47b4-b1cc-4091765e15a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a180fb11d9b94fed8a9c202c852792f4'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:04.133696 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-05f8313b-9328-47b4-b1cc-4091765e15a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a180fb11d9b94fed8a9c202c852792f4'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:04.142743 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-05f8313b-9328-47b4-b1cc-4091765e15a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a180fb11d9b94fed8a9c202c852792f4'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:04.143461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-05f8313b-9328-47b4-b1cc-4091765e15a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a180fb11d9b94fed8a9c202c852792f4'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:04.155767 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-05f8313b-9328-47b4-b1cc-4091765e15a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a180fb11d9b94fed8a9c202c852792f4'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:04.229959 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1351/2707] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:31:03 2022] DELETE /identity/v3/users/a180fb11d9b94fed8a9c202c852792f4 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:31:04.234778 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db68fa-3a99-4870-9985-fa44b5ac1514 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:04.235111 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db68fa-3a99-4870-9985-fa44b5ac1514 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:04.235500 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db68fa-3a99-4870-9985-fa44b5ac1514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:04.255213 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-d9db68fa-3a99-4870-9985-fa44b5ac1514 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:31:04.256411 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-d9db68fa-3a99-4870-9985-fa44b5ac1514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:04.316280 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1357/2708] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:31:04.326119 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8313b-9328-47b4-b1cc-4091765e15a2 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:04.327533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-05f8313b-9328-47b4-b1cc-4091765e15a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:04.386381 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8313b-9328-47b4-b1cc-4091765e15a2 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:04.390319 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211b259-1a09-440e-8c53-79592a5265a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:04.390957 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211b259-1a09-440e-8c53-79592a5265a5 service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:04.391260 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211b259-1a09-440e-8c53-79592a5265a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:04.391539 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211b259-1a09-440e-8c53-79592a5265a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:04.401998 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211b259-1a09-440e-8c53-79592a5265a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:04.403452 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211b259-1a09-440e-8c53-79592a5265a5 service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:04.413669 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1352/2709] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:31:04.864907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db68fa-3a99-4870-9985-fa44b5ac1514 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:04.866407 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-d9db68fa-3a99-4870-9985-fa44b5ac1514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:04.878974 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db68fa-3a99-4870-9985-fa44b5ac1514 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:04.887459 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633c881-2614-45e3-ba5c-0014176f376c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:04.888128 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633c881-2614-45e3-ba5c-0014176f376c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:04.888413 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633c881-2614-45e3-ba5c-0014176f376c admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:04.888690 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633c881-2614-45e3-ba5c-0014176f376c admin admin] PATH_INFO: `/v3/projects/6a4a8f8c76654396bba056923ffec343` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:04.889859 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633c881-2614-45e3-ba5c-0014176f376c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a4a8f8c76654396bba056923ffec343)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:04.891780 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633c881-2614-45e3-ba5c-0014176f376c admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:05.007907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:05.021298 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-c633c881-2614-45e3-ba5c-0014176f376c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a4a8f8c76654396bba056923ffec343', 'request_id': 'req-c633c881-2614-45e3-ba5c-0014176f376c'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:05.027519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-c633c881-2614-45e3-ba5c-0014176f376c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a4a8f8c76654396bba056923ffec343', 'request_id': 'req-c633c881-2614-45e3-ba5c-0014176f376c'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:05.032882 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-c633c881-2614-45e3-ba5c-0014176f376c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a4a8f8c76654396bba056923ffec343', 'request_id': 'req-c633c881-2614-45e3-ba5c-0014176f376c'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:05.092484 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-c633c881-2614-45e3-ba5c-0014176f376c admin admin] The token cache is being invalidate because project 6a4a8f8c76654396bba056923ffec343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:31:05.092787 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-c633c881-2614-45e3-ba5c-0014176f376c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:05.093570 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-c633c881-2614-45e3-ba5c-0014176f376c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:05.095478 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1358/2710] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:31:04 2022] DELETE /identity/v3/projects/6a4a8f8c76654396bba056923ffec343 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:31:05.099960 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211b259-1a09-440e-8c53-79592a5265a5 service neutron] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:05.110426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211b259-1a09-440e-8c53-79592a5265a5 service neutron] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:05.145997 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:05.174265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce8d86-66fe-4b74-98a5-6fe60fba0884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:05.174671 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce8d86-66fe-4b74-98a5-6fe60fba0884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:05.174954 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce8d86-66fe-4b74-98a5-6fe60fba0884 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:05.175233 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce8d86-66fe-4b74-98a5-6fe60fba0884 admin admin] PATH_INFO: `/v3/users/6bca127736ec49c1abc4bf63afbf8a46` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:05.176904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce8d86-66fe-4b74-98a5-6fe60fba0884 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bca127736ec49c1abc4bf63afbf8a46)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:05.178860 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce8d86-66fe-4b74-98a5-6fe60fba0884 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:05.384604 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-6bce8d86-66fe-4b74-98a5-6fe60fba0884 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bca127736ec49c1abc4bf63afbf8a46'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:05.385415 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-6bce8d86-66fe-4b74-98a5-6fe60fba0884 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bca127736ec49c1abc4bf63afbf8a46'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:05.392360 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-6bce8d86-66fe-4b74-98a5-6fe60fba0884 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bca127736ec49c1abc4bf63afbf8a46'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:05.392977 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-6bce8d86-66fe-4b74-98a5-6fe60fba0884 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bca127736ec49c1abc4bf63afbf8a46'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:05.405312 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-6bce8d86-66fe-4b74-98a5-6fe60fba0884 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bca127736ec49c1abc4bf63afbf8a46'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:05.480018 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1353/2711] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:31:05 2022] DELETE /identity/v3/users/6bca127736ec49c1abc4bf63afbf8a46 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:31:05.934068 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633c881-2614-45e3-ba5c-0014176f376c admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:05.935508 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c633c881-2614-45e3-ba5c-0014176f376c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:05.948718 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633c881-2614-45e3-ba5c-0014176f376c admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:06.014213 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d56d8-acdc-48ec-b130-21dbac3ee345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:06.015177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d56d8-acdc-48ec-b130-21dbac3ee345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:06.015368 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d56d8-acdc-48ec-b130-21dbac3ee345 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:06.015613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d56d8-acdc-48ec-b130-21dbac3ee345 admin admin] PATH_INFO: `/v3/projects/1bb55310dba340ba91a0bb29114d2840` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:06.017507 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d56d8-acdc-48ec-b130-21dbac3ee345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bb55310dba340ba91a0bb29114d2840)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:06.019548 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d56d8-acdc-48ec-b130-21dbac3ee345 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:06.131625 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-d52d56d8-acdc-48ec-b130-21dbac3ee345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bb55310dba340ba91a0bb29114d2840', 'request_id': 'req-d52d56d8-acdc-48ec-b130-21dbac3ee345'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:06.137971 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-d52d56d8-acdc-48ec-b130-21dbac3ee345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bb55310dba340ba91a0bb29114d2840', 'request_id': 'req-d52d56d8-acdc-48ec-b130-21dbac3ee345'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:06.144844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-d52d56d8-acdc-48ec-b130-21dbac3ee345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bb55310dba340ba91a0bb29114d2840', 'request_id': 'req-d52d56d8-acdc-48ec-b130-21dbac3ee345'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:06.233197 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-d52d56d8-acdc-48ec-b130-21dbac3ee345 admin admin] The token cache is being invalidate because project 1bb55310dba340ba91a0bb29114d2840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:31:06.233544 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-d52d56d8-acdc-48ec-b130-21dbac3ee345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:06.234219 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-d52d56d8-acdc-48ec-b130-21dbac3ee345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:06.236020 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1359/2712] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:31:05 2022] DELETE /identity/v3/projects/1bb55310dba340ba91a0bb29114d2840 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:31:06.241605 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6afe6-4cd8-45c3-a2ff-50a84f6945aa None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:06.242172 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6afe6-4cd8-45c3-a2ff-50a84f6945aa None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:06.242172 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6afe6-4cd8-45c3-a2ff-50a84f6945aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:06.265676 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-82f6afe6-4cd8-45c3-a2ff-50a84f6945aa None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:31:06.266998 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-82f6afe6-4cd8-45c3-a2ff-50a84f6945aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:06.348405 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1354/2713] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:31:06.359043 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a98b11-c1d1-4298-9fae-e971bb5bb26e None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:06.359337 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a98b11-c1d1-4298-9fae-e971bb5bb26e None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:06.359616 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a98b11-c1d1-4298-9fae-e971bb5bb26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:06.385057 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-33a98b11-c1d1-4298-9fae-e971bb5bb26e None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:31:06.386312 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-33a98b11-c1d1-4298-9fae-e971bb5bb26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:06.394315 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1360/2714] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:31:06.399425 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6afe6-4cd8-45c3-a2ff-50a84f6945aa None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:06.409280 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6afe6-4cd8-45c3-a2ff-50a84f6945aa None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:06.413897 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ac53b-80a4-4857-8a49-656825a8f76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:06.414521 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ac53b-80a4-4857-8a49-656825a8f76e admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:06.414807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ac53b-80a4-4857-8a49-656825a8f76e admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:06.415084 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ac53b-80a4-4857-8a49-656825a8f76e admin admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:06.415739 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ac53b-80a4-4857-8a49-656825a8f76e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:31:06.416044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ac53b-80a4-4857-8a49-656825a8f76e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:06.417683 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ac53b-80a4-4857-8a49-656825a8f76e admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:06.430844 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1355/2715] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:31:06.435266 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a98b11-c1d1-4298-9fae-e971bb5bb26e None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:06.444940 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a98b11-c1d1-4298-9fae-e971bb5bb26e None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:06.449665 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6aa16-dce4-4910-b677-5253e50004ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:06.450274 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6aa16-dce4-4910-b677-5253e50004ee admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:06.450557 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6aa16-dce4-4910-b677-5253e50004ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:06.450831 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6aa16-dce4-4910-b677-5253e50004ee admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:06.451473 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6aa16-dce4-4910-b677-5253e50004ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:06.453404 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6aa16-dce4-4910-b677-5253e50004ee admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:06.539647 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1361/2716] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:31:06 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:31:06.544271 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ac53b-80a4-4857-8a49-656825a8f76e admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:06.555021 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ac53b-80a4-4857-8a49-656825a8f76e admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:06.598586 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:06.614539 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d94eb-03e0-4411-bc8d-d0e74ff8b926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:06.615220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d94eb-03e0-4411-bc8d-d0e74ff8b926 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:06.615503 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d94eb-03e0-4411-bc8d-d0e74ff8b926 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:06.615881 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d94eb-03e0-4411-bc8d-d0e74ff8b926 admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:06.616703 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d94eb-03e0-4411-bc8d-d0e74ff8b926 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:06.618887 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d94eb-03e0-4411-bc8d-d0e74ff8b926 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:06.761575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1356/2717] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:31:06 2022] POST /identity/v3/users => generated 291 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:31:06.765738 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6aa16-dce4-4910-b677-5253e50004ee admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:06.776655 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6aa16-dce4-4910-b677-5253e50004ee admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:06.781074 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06329bb1-99d2-4645-b628-85454bbf7ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:06.781707 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06329bb1-99d2-4645-b628-85454bbf7ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:06.781984 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06329bb1-99d2-4645-b628-85454bbf7ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:06.782256 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06329bb1-99d2-4645-b628-85454bbf7ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:06.782894 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06329bb1-99d2-4645-b628-85454bbf7ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:06.784478 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06329bb1-99d2-4645-b628-85454bbf7ab9 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:06.794312 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1362/2718] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:31:06.798261 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d94eb-03e0-4411-bc8d-d0e74ff8b926 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:06.809287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d94eb-03e0-4411-bc8d-d0e74ff8b926 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:06.813880 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18663804-b6b0-4957-8175-fa0d8f622bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:06.814510 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18663804-b6b0-4957-8175-fa0d8f622bdd admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:06.814792 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18663804-b6b0-4957-8175-fa0d8f622bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:06.815066 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18663804-b6b0-4957-8175-fa0d8f622bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:06.815713 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18663804-b6b0-4957-8175-fa0d8f622bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:06.817993 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18663804-b6b0-4957-8175-fa0d8f622bdd admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:06.828876 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1357/2719] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:31:06.833141 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06329bb1-99d2-4645-b628-85454bbf7ab9 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:06.842973 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06329bb1-99d2-4645-b628-85454bbf7ab9 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:06.847391 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5550d-df57-4811-8bea-8d76d6049ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:06.848028 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5550d-df57-4811-8bea-8d76d6049ad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:06.848306 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5550d-df57-4811-8bea-8d76d6049ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:06.848579 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5550d-df57-4811-8bea-8d76d6049ad3 admin admin] PATH_INFO: `/v3/projects/e3f4f39e74be4df99c8999992a5c506d/users/9de1fb03fa8d4deb88596949a6420f4e/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:06.851521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:06.863193 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db5550d-df57-4811-8bea-8d76d6049ad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3f4f39e74be4df99c8999992a5c506d, user_id=9de1fb03fa8d4deb88596949a6420f4e, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:06.866803 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db5550d-df57-4811-8bea-8d76d6049ad3 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:06.959557 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1363/2720] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:31:06 2022] PUT /identity/v3/projects/e3f4f39e74be4df99c8999992a5c506d/users/9de1fb03fa8d4deb88596949a6420f4e/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:31:06.971447 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079209bd-f3c3-4697-92ff-795518d8b7f2 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:06.971750 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079209bd-f3c3-4697-92ff-795518d8b7f2 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:06.972021 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079209bd-f3c3-4697-92ff-795518d8b7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:07.000446 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-079209bd-f3c3-4697-92ff-795518d8b7f2 None None] MFA Rules not processed for user `9de1fb03fa8d4deb88596949a6420f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:31:07.001700 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-079209bd-f3c3-4697-92ff-795518d8b7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:07.070491 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1358/2721] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:31:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:31:07.074154 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5550d-df57-4811-8bea-8d76d6049ad3 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:07.143129 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5550d-df57-4811-8bea-8d76d6049ad3 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:07.147784 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df8a2a-617b-4017-b7bb-acc00a2f37ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:07.148392 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df8a2a-617b-4017-b7bb-acc00a2f37ed admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:07.148677 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df8a2a-617b-4017-b7bb-acc00a2f37ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:07.148951 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df8a2a-617b-4017-b7bb-acc00a2f37ed admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:07.149611 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df8a2a-617b-4017-b7bb-acc00a2f37ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:07.151521 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df8a2a-617b-4017-b7bb-acc00a2f37ed admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:07.241135 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1364/2722] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:31:07 2022] POST /identity/v3/projects => generated 383 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:31:07.245260 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079209bd-f3c3-4697-92ff-795518d8b7f2 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:07.256054 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079209bd-f3c3-4697-92ff-795518d8b7f2 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:07.317659 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63261542-7caf-4c3d-b461-2ea2b9df6ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:07.318282 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63261542-7caf-4c3d-b461-2ea2b9df6ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:07.318567 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63261542-7caf-4c3d-b461-2ea2b9df6ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:07.318842 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63261542-7caf-4c3d-b461-2ea2b9df6ce1 admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:07.319581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63261542-7caf-4c3d-b461-2ea2b9df6ce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:07.321853 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63261542-7caf-4c3d-b461-2ea2b9df6ce1 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:07.422658 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1359/2723] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:31:07 2022] POST /identity/v3/users => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:31:07.426628 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df8a2a-617b-4017-b7bb-acc00a2f37ed admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:07.437292 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df8a2a-617b-4017-b7bb-acc00a2f37ed admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:07.441866 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de03e7f-8bac-40c9-b227-6e367498371c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:07.442491 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de03e7f-8bac-40c9-b227-6e367498371c admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:07.442775 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de03e7f-8bac-40c9-b227-6e367498371c admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:07.443053 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de03e7f-8bac-40c9-b227-6e367498371c admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:07.443704 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de03e7f-8bac-40c9-b227-6e367498371c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:07.445332 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de03e7f-8bac-40c9-b227-6e367498371c admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:07.455654 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1365/2724] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:31:07.460070 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63261542-7caf-4c3d-b461-2ea2b9df6ce1 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:07.470356 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63261542-7caf-4c3d-b461-2ea2b9df6ce1 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:07.475728 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e3eff-1546-43e9-8343-33b8cce87299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:07.476419 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e3eff-1546-43e9-8343-33b8cce87299 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:07.476728 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e3eff-1546-43e9-8343-33b8cce87299 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:07.477010 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e3eff-1546-43e9-8343-33b8cce87299 admin admin] PATH_INFO: `/v3/projects/9d9351f591d24a21ae20d02adf4c9062/users/15e348c792b94380ae7bf643342f70dc/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:07.493205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e3eff-1546-43e9-8343-33b8cce87299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d9351f591d24a21ae20d02adf4c9062, user_id=15e348c792b94380ae7bf643342f70dc, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:07.495896 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e3eff-1546-43e9-8343-33b8cce87299 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:07.565946 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1360/2725] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:31:07 2022] PUT /identity/v3/projects/9d9351f591d24a21ae20d02adf4c9062/users/15e348c792b94380ae7bf643342f70dc/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:31:07.570283 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de03e7f-8bac-40c9-b227-6e367498371c admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:07.580435 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de03e7f-8bac-40c9-b227-6e367498371c admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:07.640717 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2061aa-d829-448a-8b65-90ecf185b6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:07.641368 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2061aa-d829-448a-8b65-90ecf185b6df admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:07.641657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2061aa-d829-448a-8b65-90ecf185b6df admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:07.641938 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2061aa-d829-448a-8b65-90ecf185b6df admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:07.642593 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2061aa-d829-448a-8b65-90ecf185b6df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:07.644317 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2061aa-d829-448a-8b65-90ecf185b6df admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:07.655089 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1366/2726] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:31:07.659276 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e3eff-1546-43e9-8343-33b8cce87299 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:07.672227 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e3eff-1546-43e9-8343-33b8cce87299 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:07.676782 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d23c95-7c7e-4037-bf24-6fa7e81acc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:07.677477 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d23c95-7c7e-4037-bf24-6fa7e81acc2d admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:07.677758 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d23c95-7c7e-4037-bf24-6fa7e81acc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:07.678031 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d23c95-7c7e-4037-bf24-6fa7e81acc2d admin admin] PATH_INFO: `/v3/projects/9d9351f591d24a21ae20d02adf4c9062/users/15e348c792b94380ae7bf643342f70dc/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:07.679923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d23c95-7c7e-4037-bf24-6fa7e81acc2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d9351f591d24a21ae20d02adf4c9062, user_id=15e348c792b94380ae7bf643342f70dc, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:07.682860 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d23c95-7c7e-4037-bf24-6fa7e81acc2d admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:07.692970 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1361/2727] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:31:07 2022] PUT /identity/v3/projects/9d9351f591d24a21ae20d02adf4c9062/users/15e348c792b94380ae7bf643342f70dc/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:31:07.703421 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd90cbd-5b35-4cb2-a3c1-68758bf14a01 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:07.703700 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd90cbd-5b35-4cb2-a3c1-68758bf14a01 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:07.704017 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd90cbd-5b35-4cb2-a3c1-68758bf14a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:07.738733 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-5bd90cbd-5b35-4cb2-a3c1-68758bf14a01 None None] MFA Rules not processed for user `15e348c792b94380ae7bf643342f70dc`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:31:07.739973 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-5bd90cbd-5b35-4cb2-a3c1-68758bf14a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:07.789422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:07.813989 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1367/2728] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:31:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:31:07.825462 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d23c95-7c7e-4037-bf24-6fa7e81acc2d admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:07.827166 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-93d23c95-7c7e-4037-bf24-6fa7e81acc2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:07.834389 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:07.890490 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d23c95-7c7e-4037-bf24-6fa7e81acc2d admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:07.894573 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254ae2b-2766-4599-b5ce-80e30dbbc289 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:07.896511 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254ae2b-2766-4599-b5ce-80e30dbbc289 service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:07.896511 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254ae2b-2766-4599-b5ce-80e30dbbc289 service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:07.896511 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254ae2b-2766-4599-b5ce-80e30dbbc289 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:07.963622 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254ae2b-2766-4599-b5ce-80e30dbbc289 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:07.965163 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254ae2b-2766-4599-b5ce-80e30dbbc289 service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:07.975908 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1362/2729] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:31:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:31:10.158358 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ffbb9-ba19-467d-9f63-c87981248400 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:10.158817 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ffbb9-ba19-467d-9f63-c87981248400 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:10.158932 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ffbb9-ba19-467d-9f63-c87981248400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:10.179799 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-116ffbb9-ba19-467d-9f63-c87981248400 None None] MFA Rules not processed for user `826b9a7c343b4dbc9aeb3dbc0b75fc92`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:31:10.180064 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-116ffbb9-ba19-467d-9f63-c87981248400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:10.234699 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1368/2730] 10.222.0.42 () {58 vars in 967 bytes} [Tue Aug 23 04:31:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:31:10.247429 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254ae2b-2766-4599-b5ce-80e30dbbc289 service cinder] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:10.248856 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-e254ae2b-2766-4599-b5ce-80e30dbbc289 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:10.318776 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254ae2b-2766-4599-b5ce-80e30dbbc289 service cinder] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:10.323723 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d1ef3-41f1-43bf-9eb6-16d9ef4f8e3d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63190c62bc92403880ffaedc4737485a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:10.324331 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d1ef3-41f1-43bf-9eb6-16d9ef4f8e3d service swift] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:10.324611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d1ef3-41f1-43bf-9eb6-16d9ef4f8e3d service swift] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:10.324882 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d1ef3-41f1-43bf-9eb6-16d9ef4f8e3d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:10.332741 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d1ef3-41f1-43bf-9eb6-16d9ef4f8e3d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:10.334351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d1ef3-41f1-43bf-9eb6-16d9ef4f8e3d service swift] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:10.343020 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1363/2731] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 23 04:31:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 04:31:13.165612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ffbb9-ba19-467d-9f63-c87981248400 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:13.174800 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ffbb9-ba19-467d-9f63-c87981248400 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:13.178277 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27fd73f-f885-489a-8397-7ab51a5b68c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:13.179419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fd73f-f885-489a-8397-7ab51a5b68c0 service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:13.179698 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fd73f-f885-489a-8397-7ab51a5b68c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:13.179974 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fd73f-f885-489a-8397-7ab51a5b68c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:13.188888 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27fd73f-f885-489a-8397-7ab51a5b68c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:13.190343 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27fd73f-f885-489a-8397-7ab51a5b68c0 service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:13.199590 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1369/2732] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:31:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:31:15.374751 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d1ef3-41f1-43bf-9eb6-16d9ef4f8e3d service swift] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:15.376220 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-0e7d1ef3-41f1-43bf-9eb6-16d9ef4f8e3d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:15.430158 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=100 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:15.446992 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d1ef3-41f1-43bf-9eb6-16d9ef4f8e3d service swift] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:15.451575 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4afffc-e211-48d8-9d65-38d53020b600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:15.452252 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4afffc-e211-48d8-9d65-38d53020b600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:15.452531 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4afffc-e211-48d8-9d65-38d53020b600 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:15.452799 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4afffc-e211-48d8-9d65-38d53020b600 admin admin] PATH_INFO: `/v3/users/12f824ffcc7d415788c7a7ae2aba9663` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:15.453972 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4afffc-e211-48d8-9d65-38d53020b600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12f824ffcc7d415788c7a7ae2aba9663)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:15.455885 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4afffc-e211-48d8-9d65-38d53020b600 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:15.694864 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-ff4afffc-e211-48d8-9d65-38d53020b600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12f824ffcc7d415788c7a7ae2aba9663'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:15.695529 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-ff4afffc-e211-48d8-9d65-38d53020b600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12f824ffcc7d415788c7a7ae2aba9663'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:15.702825 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-ff4afffc-e211-48d8-9d65-38d53020b600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12f824ffcc7d415788c7a7ae2aba9663'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:15.703455 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-ff4afffc-e211-48d8-9d65-38d53020b600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12f824ffcc7d415788c7a7ae2aba9663'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:15.715645 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-ff4afffc-e211-48d8-9d65-38d53020b600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12f824ffcc7d415788c7a7ae2aba9663'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:15.794816 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1364/2733] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:31:15 2022] DELETE /identity/v3/users/12f824ffcc7d415788c7a7ae2aba9663 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:31:15.799565 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799356f-e12a-4df0-ac91-ac2a7613c34b None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:15.800064 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799356f-e12a-4df0-ac91-ac2a7613c34b None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:15.800165 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799356f-e12a-4df0-ac91-ac2a7613c34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:15.821316 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-3799356f-e12a-4df0-ac91-ac2a7613c34b None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:31:15.822812 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-3799356f-e12a-4df0-ac91-ac2a7613c34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:15.880654 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1370/2734] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:31:15.890573 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4afffc-e211-48d8-9d65-38d53020b600 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:15.891938 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-ff4afffc-e211-48d8-9d65-38d53020b600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:15.950531 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4afffc-e211-48d8-9d65-38d53020b600 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:15.954294 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990cb0c-4635-4333-8f4c-aba53edf2ce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:15.954916 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990cb0c-4635-4333-8f4c-aba53edf2ce0 service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:15.955199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990cb0c-4635-4333-8f4c-aba53edf2ce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:15.955473 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990cb0c-4635-4333-8f4c-aba53edf2ce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:15.965174 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990cb0c-4635-4333-8f4c-aba53edf2ce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:15.966647 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990cb0c-4635-4333-8f4c-aba53edf2ce0 service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:15.976627 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1365/2735] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:31:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:31:16.406356 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799356f-e12a-4df0-ac91-ac2a7613c34b None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:16.407844 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-3799356f-e12a-4df0-ac91-ac2a7613c34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:16.422676 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799356f-e12a-4df0-ac91-ac2a7613c34b None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:16.427269 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054e34a-24ee-4687-a6cf-25daeaa92738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:16.427911 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054e34a-24ee-4687-a6cf-25daeaa92738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:16.428192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054e34a-24ee-4687-a6cf-25daeaa92738 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:16.430993 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054e34a-24ee-4687-a6cf-25daeaa92738 admin admin] PATH_INFO: `/v3/projects/4f2d9e1ba0074e63822981a5c80edcf4` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:16.430993 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054e34a-24ee-4687-a6cf-25daeaa92738 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f2d9e1ba0074e63822981a5c80edcf4)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:16.431672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054e34a-24ee-4687-a6cf-25daeaa92738 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:16.531474 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-a054e34a-24ee-4687-a6cf-25daeaa92738 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f2d9e1ba0074e63822981a5c80edcf4', 'request_id': 'req-a054e34a-24ee-4687-a6cf-25daeaa92738'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:16.539440 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-a054e34a-24ee-4687-a6cf-25daeaa92738 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f2d9e1ba0074e63822981a5c80edcf4', 'request_id': 'req-a054e34a-24ee-4687-a6cf-25daeaa92738'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:16.544975 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-a054e34a-24ee-4687-a6cf-25daeaa92738 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f2d9e1ba0074e63822981a5c80edcf4', 'request_id': 'req-a054e34a-24ee-4687-a6cf-25daeaa92738'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:16.548595 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:16.623561 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-a054e34a-24ee-4687-a6cf-25daeaa92738 admin admin] The token cache is being invalidate because project 4f2d9e1ba0074e63822981a5c80edcf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:31:16.623888 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-a054e34a-24ee-4687-a6cf-25daeaa92738 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:16.624537 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-a054e34a-24ee-4687-a6cf-25daeaa92738 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:16.626096 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1371/2736] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:31:16 2022] DELETE /identity/v3/projects/4f2d9e1ba0074e63822981a5c80edcf4 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:31:19.056674 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990cb0c-4635-4333-8f4c-aba53edf2ce0 service neutron] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:19.058362 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-a990cb0c-4635-4333-8f4c-aba53edf2ce0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:19.070880 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990cb0c-4635-4333-8f4c-aba53edf2ce0 service neutron] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:19.126013 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da943a00-06a0-4e8d-b29a-1fd0e02c3b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:19.126641 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da943a00-06a0-4e8d-b29a-1fd0e02c3b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:19.126926 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da943a00-06a0-4e8d-b29a-1fd0e02c3b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:19.127203 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da943a00-06a0-4e8d-b29a-1fd0e02c3b78 admin admin] PATH_INFO: `/v3/users/9de1fb03fa8d4deb88596949a6420f4e` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:19.128326 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da943a00-06a0-4e8d-b29a-1fd0e02c3b78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9de1fb03fa8d4deb88596949a6420f4e)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:19.130340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da943a00-06a0-4e8d-b29a-1fd0e02c3b78 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:19.142148 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:19.309143 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-da943a00-06a0-4e8d-b29a-1fd0e02c3b78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9de1fb03fa8d4deb88596949a6420f4e'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:19.309780 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-da943a00-06a0-4e8d-b29a-1fd0e02c3b78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9de1fb03fa8d4deb88596949a6420f4e'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:19.316980 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-da943a00-06a0-4e8d-b29a-1fd0e02c3b78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9de1fb03fa8d4deb88596949a6420f4e'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:19.317636 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-da943a00-06a0-4e8d-b29a-1fd0e02c3b78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9de1fb03fa8d4deb88596949a6420f4e'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:19.329523 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-da943a00-06a0-4e8d-b29a-1fd0e02c3b78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9de1fb03fa8d4deb88596949a6420f4e'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:19.405475 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1366/2737] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:31:19 2022] DELETE /identity/v3/users/9de1fb03fa8d4deb88596949a6420f4e => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:31:19.410015 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66a640-cc48-481b-82e7-78d2076cfa02 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:19.410491 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66a640-cc48-481b-82e7-78d2076cfa02 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:19.410588 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66a640-cc48-481b-82e7-78d2076cfa02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:19.430184 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-7e66a640-cc48-481b-82e7-78d2076cfa02 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:31:19.431384 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-7e66a640-cc48-481b-82e7-78d2076cfa02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:19.489296 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1372/2738] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:31:19.499071 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da943a00-06a0-4e8d-b29a-1fd0e02c3b78 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:19.500519 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-da943a00-06a0-4e8d-b29a-1fd0e02c3b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:19.558061 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da943a00-06a0-4e8d-b29a-1fd0e02c3b78 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:19.561805 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793960d-7e1b-401b-844f-4320494e1864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:19.562350 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793960d-7e1b-401b-844f-4320494e1864 service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:19.562632 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793960d-7e1b-401b-844f-4320494e1864 service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:19.562913 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793960d-7e1b-401b-844f-4320494e1864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:19.571810 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793960d-7e1b-401b-844f-4320494e1864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:19.573283 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793960d-7e1b-401b-844f-4320494e1864 service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:19.585127 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1367/2739] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:31:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:31:19.956419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66a640-cc48-481b-82e7-78d2076cfa02 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:19.959491 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-7e66a640-cc48-481b-82e7-78d2076cfa02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:19.970374 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66a640-cc48-481b-82e7-78d2076cfa02 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:19.974957 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1351cd-1304-4914-8cac-84fcc0b6455f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:19.975595 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1351cd-1304-4914-8cac-84fcc0b6455f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:19.975884 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1351cd-1304-4914-8cac-84fcc0b6455f admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:19.976158 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1351cd-1304-4914-8cac-84fcc0b6455f admin admin] PATH_INFO: `/v3/projects/e3f4f39e74be4df99c8999992a5c506d` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:19.977319 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1351cd-1304-4914-8cac-84fcc0b6455f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3f4f39e74be4df99c8999992a5c506d)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:19.979238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1351cd-1304-4914-8cac-84fcc0b6455f admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:20.082148 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-2e1351cd-1304-4914-8cac-84fcc0b6455f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3f4f39e74be4df99c8999992a5c506d', 'request_id': 'req-2e1351cd-1304-4914-8cac-84fcc0b6455f'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:20.090086 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-2e1351cd-1304-4914-8cac-84fcc0b6455f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3f4f39e74be4df99c8999992a5c506d', 'request_id': 'req-2e1351cd-1304-4914-8cac-84fcc0b6455f'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:20.095759 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-2e1351cd-1304-4914-8cac-84fcc0b6455f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3f4f39e74be4df99c8999992a5c506d', 'request_id': 'req-2e1351cd-1304-4914-8cac-84fcc0b6455f'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:20.148051 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-2e1351cd-1304-4914-8cac-84fcc0b6455f admin admin] The token cache is being invalidate because project e3f4f39e74be4df99c8999992a5c506d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:31:20.148342 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-2e1351cd-1304-4914-8cac-84fcc0b6455f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:20.148951 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-2e1351cd-1304-4914-8cac-84fcc0b6455f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:20.150460 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1373/2740] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:31:19 2022] DELETE /identity/v3/projects/e3f4f39e74be4df99c8999992a5c506d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:31:20.154594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793960d-7e1b-401b-844f-4320494e1864 service neutron] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:20.164475 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793960d-7e1b-401b-844f-4320494e1864 service neutron] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:20.220029 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ae50d-e4a9-4e08-8a1d-9935033e1adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:20.220687 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ae50d-e4a9-4e08-8a1d-9935033e1adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:20.220973 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ae50d-e4a9-4e08-8a1d-9935033e1adc admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:20.221287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ae50d-e4a9-4e08-8a1d-9935033e1adc admin admin] PATH_INFO: `/v3/users/15e348c792b94380ae7bf643342f70dc` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:20.222436 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ae50d-e4a9-4e08-8a1d-9935033e1adc admin admin] RBAC: Authorizing `identity:delete_user(user_id=15e348c792b94380ae7bf643342f70dc)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:20.224374 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ae50d-e4a9-4e08-8a1d-9935033e1adc admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:20.420046 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:20.430094 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-d91ae50d-e4a9-4e08-8a1d-9935033e1adc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15e348c792b94380ae7bf643342f70dc'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:20.430743 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-d91ae50d-e4a9-4e08-8a1d-9935033e1adc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15e348c792b94380ae7bf643342f70dc'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:20.437931 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-d91ae50d-e4a9-4e08-8a1d-9935033e1adc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15e348c792b94380ae7bf643342f70dc'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:20.438552 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-d91ae50d-e4a9-4e08-8a1d-9935033e1adc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15e348c792b94380ae7bf643342f70dc'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:20.450490 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-d91ae50d-e4a9-4e08-8a1d-9935033e1adc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15e348c792b94380ae7bf643342f70dc'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:20.517887 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1368/2741] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:31:20 2022] DELETE /identity/v3/users/15e348c792b94380ae7bf643342f70dc => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:31:20.903849 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1351cd-1304-4914-8cac-84fcc0b6455f admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:20.905538 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-2e1351cd-1304-4914-8cac-84fcc0b6455f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:20.919528 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1351cd-1304-4914-8cac-84fcc0b6455f admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:20.979480 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57a523-d360-4b1c-8521-30e966399834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:20.980125 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57a523-d360-4b1c-8521-30e966399834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:20.980405 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57a523-d360-4b1c-8521-30e966399834 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:20.980682 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57a523-d360-4b1c-8521-30e966399834 admin admin] PATH_INFO: `/v3/projects/9d9351f591d24a21ae20d02adf4c9062` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:20.981832 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57a523-d360-4b1c-8521-30e966399834 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d9351f591d24a21ae20d02adf4c9062)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:20.983749 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57a523-d360-4b1c-8521-30e966399834 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:21.006296 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:21.092162 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-5a57a523-d360-4b1c-8521-30e966399834 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d9351f591d24a21ae20d02adf4c9062', 'request_id': 'req-5a57a523-d360-4b1c-8521-30e966399834'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:21.098266 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-5a57a523-d360-4b1c-8521-30e966399834 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d9351f591d24a21ae20d02adf4c9062', 'request_id': 'req-5a57a523-d360-4b1c-8521-30e966399834'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:21.104196 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-5a57a523-d360-4b1c-8521-30e966399834 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d9351f591d24a21ae20d02adf4c9062', 'request_id': 'req-5a57a523-d360-4b1c-8521-30e966399834'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:21.186764 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-5a57a523-d360-4b1c-8521-30e966399834 admin admin] The token cache is being invalidate because project 9d9351f591d24a21ae20d02adf4c9062 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:31:21.186990 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-5a57a523-d360-4b1c-8521-30e966399834 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:21.187634 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-5a57a523-d360-4b1c-8521-30e966399834 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:31:21.189138 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1374/2742] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:31:20 2022] DELETE /identity/v3/projects/9d9351f591d24a21ae20d02adf4c9062 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:31:21.195498 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b73b5e-5254-41e3-92f7-77f1c3e75d72 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:21.195978 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b73b5e-5254-41e3-92f7-77f1c3e75d72 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:21.196078 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b73b5e-5254-41e3-92f7-77f1c3e75d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:21.215952 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-93b73b5e-5254-41e3-92f7-77f1c3e75d72 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:31:21.217184 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-93b73b5e-5254-41e3-92f7-77f1c3e75d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:21.275073 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1369/2743] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:31:21.283358 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0363bb-c817-4e64-9395-c002dba16d54 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:21.283675 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0363bb-c817-4e64-9395-c002dba16d54 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:21.283953 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0363bb-c817-4e64-9395-c002dba16d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:21.303144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-4a0363bb-c817-4e64-9395-c002dba16d54 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:31:21.304360 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-4a0363bb-c817-4e64-9395-c002dba16d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:21.312328 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1375/2744] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:31:21.316345 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b73b5e-5254-41e3-92f7-77f1c3e75d72 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:21.326526 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b73b5e-5254-41e3-92f7-77f1c3e75d72 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:21.331034 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db515400-7f5c-4394-b6ad-805d02b24e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:21.335275 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db515400-7f5c-4394-b6ad-805d02b24e1d admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:21.335275 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db515400-7f5c-4394-b6ad-805d02b24e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:21.335275 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db515400-7f5c-4394-b6ad-805d02b24e1d admin admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:21.335275 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db515400-7f5c-4394-b6ad-805d02b24e1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:31:21.335275 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db515400-7f5c-4394-b6ad-805d02b24e1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:21.335719 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db515400-7f5c-4394-b6ad-805d02b24e1d admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:21.346716 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1370/2745] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:31:21.350947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0363bb-c817-4e64-9395-c002dba16d54 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:21.359822 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0363bb-c817-4e64-9395-c002dba16d54 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:21.364356 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db55d1-ba88-42cc-8aaf-cfc1e419b268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:21.364952 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db55d1-ba88-42cc-8aaf-cfc1e419b268 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:21.365254 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db55d1-ba88-42cc-8aaf-cfc1e419b268 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:21.365550 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db55d1-ba88-42cc-8aaf-cfc1e419b268 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:21.366175 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db55d1-ba88-42cc-8aaf-cfc1e419b268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:21.368071 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db55d1-ba88-42cc-8aaf-cfc1e419b268 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:21.465172 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1376/2746] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:31:21 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:31:21.469114 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db515400-7f5c-4394-b6ad-805d02b24e1d admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:21.479116 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db515400-7f5c-4394-b6ad-805d02b24e1d admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:21.535497 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7044bb-c372-4b9f-8093-b5184cacd4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:21.536120 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7044bb-c372-4b9f-8093-b5184cacd4e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:21.536383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7044bb-c372-4b9f-8093-b5184cacd4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:21.536658 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7044bb-c372-4b9f-8093-b5184cacd4e8 admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:21.537348 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7044bb-c372-4b9f-8093-b5184cacd4e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:21.539270 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7044bb-c372-4b9f-8093-b5184cacd4e8 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:21.611971 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1371/2747] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:31:21 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:31:21.616523 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db55d1-ba88-42cc-8aaf-cfc1e419b268 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:21.626725 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db55d1-ba88-42cc-8aaf-cfc1e419b268 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:21.631256 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fc5a0-9ba8-45ce-945c-1bf1beb86c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:21.632400 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fc5a0-9ba8-45ce-945c-1bf1beb86c0e admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:21.632680 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fc5a0-9ba8-45ce-945c-1bf1beb86c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:21.632949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fc5a0-9ba8-45ce-945c-1bf1beb86c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:21.633627 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83fc5a0-9ba8-45ce-945c-1bf1beb86c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:21.635238 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83fc5a0-9ba8-45ce-945c-1bf1beb86c0e admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:21.645236 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1377/2748] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:31:21.649118 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7044bb-c372-4b9f-8093-b5184cacd4e8 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:21.659008 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7044bb-c372-4b9f-8093-b5184cacd4e8 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:21.663602 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd8ea7-d560-4675-9f23-cfb55d9b160d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:21.664194 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd8ea7-d560-4675-9f23-cfb55d9b160d admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:21.664475 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd8ea7-d560-4675-9f23-cfb55d9b160d admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:21.664747 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd8ea7-d560-4675-9f23-cfb55d9b160d admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:21.665433 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd8ea7-d560-4675-9f23-cfb55d9b160d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:21.667025 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd8ea7-d560-4675-9f23-cfb55d9b160d admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:21.677588 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1372/2749] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:31:21.682014 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fc5a0-9ba8-45ce-945c-1bf1beb86c0e admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:21.692101 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fc5a0-9ba8-45ce-945c-1bf1beb86c0e admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:21.697288 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2e943-eb19-4331-9144-bf0a81dffa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:21.697945 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2e943-eb19-4331-9144-bf0a81dffa5a admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:21.698226 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2e943-eb19-4331-9144-bf0a81dffa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:21.698500 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2e943-eb19-4331-9144-bf0a81dffa5a admin admin] PATH_INFO: `/v3/projects/77a9cd0a37c34fdf8db5cc51851a95aa/users/b75b5638c6d8452bb6da7bb347496665/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:21.712697 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2e943-eb19-4331-9144-bf0a81dffa5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a9cd0a37c34fdf8db5cc51851a95aa, user_id=b75b5638c6d8452bb6da7bb347496665, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:21.715431 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2e943-eb19-4331-9144-bf0a81dffa5a admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:21.794579 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1378/2750] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:31:21 2022] PUT /identity/v3/projects/77a9cd0a37c34fdf8db5cc51851a95aa/users/b75b5638c6d8452bb6da7bb347496665/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:31:21.799695 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdf946-37a0-4e2e-ae88-7eab77e7527b None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:21.799987 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdf946-37a0-4e2e-ae88-7eab77e7527b None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:21.800287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdf946-37a0-4e2e-ae88-7eab77e7527b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:21.820093 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-87bdf946-37a0-4e2e-ae88-7eab77e7527b None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:31:21.821314 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-87bdf946-37a0-4e2e-ae88-7eab77e7527b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:21.833106 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:21.880094 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1373/2751] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:31:21.889609 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2e943-eb19-4331-9144-bf0a81dffa5a admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:21.891318 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-51a2e943-eb19-4331-9144-bf0a81dffa5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:21.948116 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2e943-eb19-4331-9144-bf0a81dffa5a admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:21.951895 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1e11a-9ee1-4439-817e-68edc0d823eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:21.952508 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1e11a-9ee1-4439-817e-68edc0d823eb service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:21.952788 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1e11a-9ee1-4439-817e-68edc0d823eb service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:21.953068 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1e11a-9ee1-4439-817e-68edc0d823eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:21.962978 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc1e11a-9ee1-4439-817e-68edc0d823eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:21.964462 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc1e11a-9ee1-4439-817e-68edc0d823eb service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:21.974117 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1379/2752] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:31:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:31:23.078368 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa011ef-7ed8-4bb5-be5f-c804fc561923 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:23.080171 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa011ef-7ed8-4bb5-be5f-c804fc561923 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:23.080171 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa011ef-7ed8-4bb5-be5f-c804fc561923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:23.108423 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-1fa011ef-7ed8-4bb5-be5f-c804fc561923 None None] MFA Rules not processed for user `b75b5638c6d8452bb6da7bb347496665`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:31:23.109680 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-1fa011ef-7ed8-4bb5-be5f-c804fc561923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:23.175249 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1374/2753] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:31:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:31:23.187268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1e11a-9ee1-4439-817e-68edc0d823eb service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:23.188669 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-7dc1e11a-9ee1-4439-817e-68edc0d823eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:23.242660 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:23.246438 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1e11a-9ee1-4439-817e-68edc0d823eb service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:23.250024 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5f2fc-f147-48ad-8218-c3a2b418edca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:23.250651 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5f2fc-f147-48ad-8218-c3a2b418edca service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:23.251792 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5f2fc-f147-48ad-8218-c3a2b418edca service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:23.251792 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5f2fc-f147-48ad-8218-c3a2b418edca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:23.259903 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5f2fc-f147-48ad-8218-c3a2b418edca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:23.261365 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5f2fc-f147-48ad-8218-c3a2b418edca service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:23.270396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1380/2754] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:31:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:31:24.882129 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f321647-154c-4920-bfa7-6678346ef2c5 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:24.882605 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f321647-154c-4920-bfa7-6678346ef2c5 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:24.882729 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f321647-154c-4920-bfa7-6678346ef2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:24.900878 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-5f321647-154c-4920-bfa7-6678346ef2c5 None None] MFA Rules not processed for user `b75b5638c6d8452bb6da7bb347496665`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:31:24.902087 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-5f321647-154c-4920-bfa7-6678346ef2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:24.908712 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1375/2755] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:31:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:31:33.354656 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=4 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:34.895749 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=54 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:31:55.672353 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057e1f4-0bfd-4f88-8ec6-f7450653309b None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:55.672922 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057e1f4-0bfd-4f88-8ec6-f7450653309b None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:55.672922 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057e1f4-0bfd-4f88-8ec6-f7450653309b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:55.693672 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-a057e1f4-0bfd-4f88-8ec6-f7450653309b None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:31:55.694931 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-a057e1f4-0bfd-4f88-8ec6-f7450653309b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:55.703011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1381/2756] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Aug 23 04:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:31:55.746564 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f321647-154c-4920-bfa7-6678346ef2c5 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:31:55.748682 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-5f321647-154c-4920-bfa7-6678346ef2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:55.823978 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f321647-154c-4920-bfa7-6678346ef2c5 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:31:55.829762 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa828742-db74-4c8b-92e5-00d9a15a1303 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:31:55.830805 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa828742-db74-4c8b-92e5-00d9a15a1303 service nova] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:55.830805 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa828742-db74-4c8b-92e5-00d9a15a1303 service nova] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:55.830991 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa828742-db74-4c8b-92e5-00d9a15a1303 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:55.839620 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa828742-db74-4c8b-92e5-00d9a15a1303 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:31:55.841744 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa828742-db74-4c8b-92e5-00d9a15a1303 service nova] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:31:55.851581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1376/2757] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:31:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:31:56.540292 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8b9c9-0662-421e-8fb3-4655e8205b6c None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:31:56.540582 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8b9c9-0662-421e-8fb3-4655e8205b6c None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:31:56.540860 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8b9c9-0662-421e-8fb3-4655e8205b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:31:56.560583 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-65a8b9c9-0662-421e-8fb3-4655e8205b6c None None] MFA Rules not processed for user `6a9a5ca141da4c26989d6a7c702c4acd`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:31:56.566126 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-65a8b9c9-0662-421e-8fb3-4655e8205b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:31:56.617422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1382/2758] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:31:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:32:00.049351 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13534987-7ba3-4b62-a44b-7b8032185581 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:32:00.056595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13534987-7ba3-4b62-a44b-7b8032185581 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:32:00.056595 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13534987-7ba3-4b62-a44b-7b8032185581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:32:00.075670 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-13534987-7ba3-4b62-a44b-7b8032185581 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:32:00.076973 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-13534987-7ba3-4b62-a44b-7b8032185581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:32:00.085778 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1377/2759] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Aug 23 04:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:32:00.101043 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8b9c9-0662-421e-8fb3-4655e8205b6c None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:32:00.102493 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-65a8b9c9-0662-421e-8fb3-4655e8205b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:32:00.119441 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8b9c9-0662-421e-8fb3-4655e8205b6c None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:32:00.125578 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0f286-ffe5-4553-9d0b-a4b0b7d6b635 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:32:00.126192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0f286-ffe5-4553-9d0b-a4b0b7d6b635 service nova] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:32:00.126473 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0f286-ffe5-4553-9d0b-a4b0b7d6b635 service nova] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:32:00.126881 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0f286-ffe5-4553-9d0b-a4b0b7d6b635 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:32:00.135901 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0f286-ffe5-4553-9d0b-a4b0b7d6b635 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:32:00.137928 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0f286-ffe5-4553-9d0b-a4b0b7d6b635 service nova] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:32:00.148176 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1383/2760] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:32:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:32:03.381287 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2be420-8f0c-440c-800b-6d99ea251354 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:32:03.381871 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2be420-8f0c-440c-800b-6d99ea251354 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:32:03.381871 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2be420-8f0c-440c-800b-6d99ea251354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:32:03.401857 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-0d2be420-8f0c-440c-800b-6d99ea251354 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:32:03.403193 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-0d2be420-8f0c-440c-800b-6d99ea251354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:32:03.411811 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1378/2761] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Aug 23 04:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:32:03.425561 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0f286-ffe5-4553-9d0b-a4b0b7d6b635 service nova] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:32:03.438103 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0f286-ffe5-4553-9d0b-a4b0b7d6b635 service nova] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:32:03.443694 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0d2a9-76d7-47e7-bdfd-43be4ea84d31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:32:03.449021 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0d2a9-76d7-47e7-bdfd-43be4ea84d31 service nova] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:32:03.449021 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0d2a9-76d7-47e7-bdfd-43be4ea84d31 service nova] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:32:03.449021 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0d2a9-76d7-47e7-bdfd-43be4ea84d31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:32:03.453660 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0d2a9-76d7-47e7-bdfd-43be4ea84d31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:32:03.455229 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0d2a9-76d7-47e7-bdfd-43be4ea84d31 service nova] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:32:03.464895 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1384/2762] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:32:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:32:06.308590 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b85db-ad15-4df6-bb8f-16758f916f1e None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:32:06.309137 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b85db-ad15-4df6-bb8f-16758f916f1e None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:32:06.309265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b85db-ad15-4df6-bb8f-16758f916f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:32:06.328794 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-356b85db-ad15-4df6-bb8f-16758f916f1e None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:32:06.330365 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-356b85db-ad15-4df6-bb8f-16758f916f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:32:06.338570 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1379/2763] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Aug 23 04:32:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:32:06.352958 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0d2a9-76d7-47e7-bdfd-43be4ea84d31 service nova] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:32:06.364948 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0d2a9-76d7-47e7-bdfd-43be4ea84d31 service nova] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:32:06.370587 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd761d2-e851-419a-8852-8f21ee41dc14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:32:06.371204 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd761d2-e851-419a-8852-8f21ee41dc14 service nova] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:32:06.371492 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd761d2-e851-419a-8852-8f21ee41dc14 service nova] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:32:06.371778 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd761d2-e851-419a-8852-8f21ee41dc14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:32:06.380396 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd761d2-e851-419a-8852-8f21ee41dc14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:32:06.382068 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd761d2-e851-419a-8852-8f21ee41dc14 service nova] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:32:06.391822 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1385/2764] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:32:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:32:10.578076 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9a6d6-bc0d-475b-8cd7-9e34d9118488 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:32:10.578621 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9a6d6-bc0d-475b-8cd7-9e34d9118488 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:32:10.578745 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9a6d6-bc0d-475b-8cd7-9e34d9118488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:32:10.598863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-f6c9a6d6-bc0d-475b-8cd7-9e34d9118488 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:32:10.600105 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-f6c9a6d6-bc0d-475b-8cd7-9e34d9118488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:32:10.608739 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1380/2765] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Aug 23 04:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:32:10.624172 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd761d2-e851-419a-8852-8f21ee41dc14 service nova] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:32:10.638486 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd761d2-e851-419a-8852-8f21ee41dc14 service nova] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:32:10.644845 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7e947-b25e-49b0-8f54-fc36503a3ac7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:32:10.645563 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7e947-b25e-49b0-8f54-fc36503a3ac7 service nova] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:32:10.645849 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7e947-b25e-49b0-8f54-fc36503a3ac7 service nova] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:32:10.646174 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7e947-b25e-49b0-8f54-fc36503a3ac7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:32:10.656861 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f7e947-b25e-49b0-8f54-fc36503a3ac7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:32:10.658721 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f7e947-b25e-49b0-8f54-fc36503a3ac7 service nova] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:32:10.677315 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1386/2766] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:32:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:32:13.804111 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdea831-1c67-44c5-971e-b004e4d680ac None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:32:13.804615 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdea831-1c67-44c5-971e-b004e4d680ac None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:32:13.804763 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdea831-1c67-44c5-971e-b004e4d680ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:32:13.824027 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-dbdea831-1c67-44c5-971e-b004e4d680ac None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:32:13.825254 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-dbdea831-1c67-44c5-971e-b004e4d680ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:32:13.832889 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1381/2767] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Aug 23 04:32:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:32:13.855084 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7e947-b25e-49b0-8f54-fc36503a3ac7 service nova] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:32:13.867047 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7e947-b25e-49b0-8f54-fc36503a3ac7 service nova] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:32:13.872761 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe0e1a-2b70-4658-8db7-bd0d5781415d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:32:13.873393 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe0e1a-2b70-4658-8db7-bd0d5781415d service nova] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:32:13.873676 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe0e1a-2b70-4658-8db7-bd0d5781415d service nova] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:32:13.873949 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe0e1a-2b70-4658-8db7-bd0d5781415d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:32:13.881894 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe0e1a-2b70-4658-8db7-bd0d5781415d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:32:13.883792 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe0e1a-2b70-4658-8db7-bd0d5781415d service nova] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:32:13.893047 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1387/2768] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:32:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:32:23.818843 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=49 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:32:23.888891 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=58 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:32:29.688687 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3722b12-2f99-435d-96d0-010dc9c2eca5 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:32:29.689210 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3722b12-2f99-435d-96d0-010dc9c2eca5 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:32:29.689307 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3722b12-2f99-435d-96d0-010dc9c2eca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:32:29.708569 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-d3722b12-2f99-435d-96d0-010dc9c2eca5 None None] MFA Rules not processed for user `b75b5638c6d8452bb6da7bb347496665`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:32:29.709786 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-d3722b12-2f99-435d-96d0-010dc9c2eca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:32:29.716963 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1382/2769] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:32:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:32:31.542965 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe0e1a-2b70-4658-8db7-bd0d5781415d service nova] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:32:31.544441 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-23fe0e1a-2b70-4658-8db7-bd0d5781415d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:32:31.634569 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe0e1a-2b70-4658-8db7-bd0d5781415d service nova] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:32:31.639606 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e1974-1e15-4bc1-8748-c1bc6bb4660c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34794124b7234aeb98a15f0c2ae06a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:32:31.640707 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e1974-1e15-4bc1-8748-c1bc6bb4660c service placement] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:32:31.640982 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e1974-1e15-4bc1-8748-c1bc6bb4660c service placement] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:32:31.641278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e1974-1e15-4bc1-8748-c1bc6bb4660c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:32:31.643037 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-b40e1974-1e15-4bc1-8748-c1bc6bb4660c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:32:31.654218 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e1974-1e15-4bc1-8748-c1bc6bb4660c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:32:31.656427 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e1974-1e15-4bc1-8748-c1bc6bb4660c service placement] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:32:31.666120 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1388/2770] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:32:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:32:39.703617 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=3 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:32:41.662025 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=41 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:32:47.606115 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75362e00-6b7c-4e41-bf3f-e1115bf5cdbd None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:32:47.606683 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75362e00-6b7c-4e41-bf3f-e1115bf5cdbd None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:32:47.606683 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75362e00-6b7c-4e41-bf3f-e1115bf5cdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:32:47.654569 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-75362e00-6b7c-4e41-bf3f-e1115bf5cdbd None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:32:47.655862 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-75362e00-6b7c-4e41-bf3f-e1115bf5cdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:32:47.663783 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1383/2771] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Aug 23 04:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:32:47.680405 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e1974-1e15-4bc1-8748-c1bc6bb4660c service placement] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:32:47.709863 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e1974-1e15-4bc1-8748-c1bc6bb4660c service placement] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:32:47.715332 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45ded9-3aac-4887-9478-c58f802830a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:32:47.715931 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45ded9-3aac-4887-9478-c58f802830a4 service nova] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:32:47.716217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45ded9-3aac-4887-9478-c58f802830a4 service nova] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:32:47.716493 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45ded9-3aac-4887-9478-c58f802830a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:32:47.724645 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc45ded9-3aac-4887-9478-c58f802830a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:32:47.726257 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc45ded9-3aac-4887-9478-c58f802830a4 service nova] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:32:47.735613 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1389/2772] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:32:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:32:51.013998 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e950fd-ecd3-452b-8525-be33ab504407 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:32:51.014512 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e950fd-ecd3-452b-8525-be33ab504407 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:32:51.015125 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e950fd-ecd3-452b-8525-be33ab504407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:32:51.035200 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-02e950fd-ecd3-452b-8525-be33ab504407 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:32:51.036420 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-02e950fd-ecd3-452b-8525-be33ab504407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:32:51.044265 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1384/2773] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Aug 23 04:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:32:51.060004 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45ded9-3aac-4887-9478-c58f802830a4 service nova] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:32:51.071488 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45ded9-3aac-4887-9478-c58f802830a4 service nova] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:32:51.076960 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00311ef1-cbce-40e0-ba3d-f5e006014957 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:32:51.078099 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00311ef1-cbce-40e0-ba3d-f5e006014957 service nova] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:32:51.078410 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00311ef1-cbce-40e0-ba3d-f5e006014957 service nova] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:32:51.078688 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00311ef1-cbce-40e0-ba3d-f5e006014957 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:32:51.086875 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00311ef1-cbce-40e0-ba3d-f5e006014957 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:32:51.088448 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00311ef1-cbce-40e0-ba3d-f5e006014957 service nova] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:32:51.098361 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1390/2774] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:32:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:32:53.892939 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14d203-10ce-4c52-8680-9a04c17c16f6 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:32:53.893453 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14d203-10ce-4c52-8680-9a04c17c16f6 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:32:53.893556 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14d203-10ce-4c52-8680-9a04c17c16f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:32:53.914188 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-ed14d203-10ce-4c52-8680-9a04c17c16f6 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:32:53.915389 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-ed14d203-10ce-4c52-8680-9a04c17c16f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:32:53.923311 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1385/2775] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Aug 23 04:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:32:53.962841 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00311ef1-cbce-40e0-ba3d-f5e006014957 service nova] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:32:53.974770 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00311ef1-cbce-40e0-ba3d-f5e006014957 service nova] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:32:53.980343 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d146f-324f-42b2-ae86-432ac3ce5a1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:32:53.980941 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d146f-324f-42b2-ae86-432ac3ce5a1b service nova] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:32:53.981267 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d146f-324f-42b2-ae86-432ac3ce5a1b service nova] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:32:53.981545 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d146f-324f-42b2-ae86-432ac3ce5a1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:32:53.989559 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d146f-324f-42b2-ae86-432ac3ce5a1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:32:53.991127 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d146f-324f-42b2-ae86-432ac3ce5a1b service nova] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:32:54.000325 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1391/2776] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:32:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:32:57.109142 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3152d7a-7d07-4f35-8870-67416e35ffc7 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:32:57.109635 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3152d7a-7d07-4f35-8870-67416e35ffc7 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:32:57.109744 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3152d7a-7d07-4f35-8870-67416e35ffc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:32:57.128370 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-d3152d7a-7d07-4f35-8870-67416e35ffc7 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:32:57.129594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-d3152d7a-7d07-4f35-8870-67416e35ffc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:32:57.138163 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1386/2777] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Aug 23 04:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:32:57.153548 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d146f-324f-42b2-ae86-432ac3ce5a1b service nova] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:32:57.165770 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d146f-324f-42b2-ae86-432ac3ce5a1b service nova] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:32:57.171157 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bd31a-5d4f-477f-a5fe-0485638b9692 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:32:57.171819 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bd31a-5d4f-477f-a5fe-0485638b9692 service nova] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:32:57.172093 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bd31a-5d4f-477f-a5fe-0485638b9692 service nova] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:32:57.172364 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bd31a-5d4f-477f-a5fe-0485638b9692 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:32:57.180411 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4bd31a-5d4f-477f-a5fe-0485638b9692 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:32:57.181999 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4bd31a-5d4f-477f-a5fe-0485638b9692 service nova] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:32:57.191924 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1392/2778] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:32:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:33:00.367467 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c37d54-e8e6-4910-b355-cbfb2c8f3531 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:00.367942 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c37d54-e8e6-4910-b355-cbfb2c8f3531 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:00.368047 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c37d54-e8e6-4910-b355-cbfb2c8f3531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:00.388104 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-18c37d54-e8e6-4910-b355-cbfb2c8f3531 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:33:00.389319 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-18c37d54-e8e6-4910-b355-cbfb2c8f3531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:33:00.397677 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1387/2779] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Aug 23 04:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:33:00.412334 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bd31a-5d4f-477f-a5fe-0485638b9692 service nova] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:33:00.423811 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bd31a-5d4f-477f-a5fe-0485638b9692 service nova] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:33:00.429388 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57461ff-cd6f-4cbd-ab86-871843682875 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:33:00.429887 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57461ff-cd6f-4cbd-ab86-871843682875 service nova] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:00.430172 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57461ff-cd6f-4cbd-ab86-871843682875 service nova] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:00.430861 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57461ff-cd6f-4cbd-ab86-871843682875 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:00.439807 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57461ff-cd6f-4cbd-ab86-871843682875 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:33:00.441421 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57461ff-cd6f-4cbd-ab86-871843682875 service nova] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:33:00.452183 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1393/2780] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:33:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:33:10.382807 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=26 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:33:10.446980 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=37 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:33:13.262620 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093497f-c024-4356-87c1-90d7e40045f6 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:13.263224 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093497f-c024-4356-87c1-90d7e40045f6 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:13.263224 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093497f-c024-4356-87c1-90d7e40045f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:13.292271 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-c093497f-c024-4356-87c1-90d7e40045f6 None None] MFA Rules not processed for user `826b9a7c343b4dbc9aeb3dbc0b75fc92`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:33:13.293513 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-c093497f-c024-4356-87c1-90d7e40045f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:33:13.349323 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1388/2781] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 23 04:33:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:33:13.483596 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57461ff-cd6f-4cbd-ab86-871843682875 service nova] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:33:13.485035 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-c57461ff-cd6f-4cbd-ab86-871843682875 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:33:13.558462 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57461ff-cd6f-4cbd-ab86-871843682875 service nova] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:33:13.563582 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce8c2d-fa8d-4884-b20f-ca31fe4829d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63190c62bc92403880ffaedc4737485a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:33:13.573429 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce8c2d-fa8d-4884-b20f-ca31fe4829d6 service swift] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:13.573429 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce8c2d-fa8d-4884-b20f-ca31fe4829d6 service swift] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:13.573429 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce8c2d-fa8d-4884-b20f-ca31fe4829d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:13.574154 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce8c2d-fa8d-4884-b20f-ca31fe4829d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:33:13.575767 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce8c2d-fa8d-4884-b20f-ca31fe4829d6 service swift] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:33:13.584419 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1394/2782] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 23 04:33:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 04:33:23.342695 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=29 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:33:23.580519 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=32 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:33:29.573055 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fde8c-f1d9-489f-80c3-c3d84ccb268c None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:29.574125 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fde8c-f1d9-489f-80c3-c3d84ccb268c None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:29.574451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fde8c-f1d9-489f-80c3-c3d84ccb268c None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:29.575924 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1389/2783] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 23 04:33:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:33:29.582444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672a24d-d7ca-4c12-95b7-e9e5524500f7 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:29.582873 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672a24d-d7ca-4c12-95b7-e9e5524500f7 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:29.583115 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672a24d-d7ca-4c12-95b7-e9e5524500f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:29.617801 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-b672a24d-d7ca-4c12-95b7-e9e5524500f7 None None] MFA Rules not processed for user `1e0236a0acac4b87be977878b5186551`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:33:29.619027 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-b672a24d-d7ca-4c12-95b7-e9e5524500f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:33:29.628577 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1395/2784] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 23 04:33:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:33:29.641424 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fde8c-f1d9-489f-80c3-c3d84ccb268c None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:33:29.643406 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-ca2fde8c-f1d9-489f-80c3-c3d84ccb268c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:33:29.704912 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fde8c-f1d9-489f-80c3-c3d84ccb268c None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:33:29.708607 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71941b92-a888-43f2-9254-a7af9a4712f7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '020af86302e447a6b3973df4abbabafa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:33:29.709256 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71941b92-a888-43f2-9254-a7af9a4712f7 service glance] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:29.709583 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71941b92-a888-43f2-9254-a7af9a4712f7 service glance] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:29.709863 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71941b92-a888-43f2-9254-a7af9a4712f7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:29.720485 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71941b92-a888-43f2-9254-a7af9a4712f7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:33:29.722043 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71941b92-a888-43f2-9254-a7af9a4712f7 service glance] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:33:29.733234 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1390/2785] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:33:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:33:29.932601 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18312aef-2a42-46ec-b502-0274f4a34b2a None None] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:29.932888 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18312aef-2a42-46ec-b502-0274f4a34b2a None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:29.933263 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18312aef-2a42-46ec-b502-0274f4a34b2a None None] PATH_INFO: `/` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:29.939226 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1396/2786] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 23 04:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:33:29.939751 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72845d69-c9e9-4b7b-9ab3-58d617fe3a4f None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:29.940038 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72845d69-c9e9-4b7b-9ab3-58d617fe3a4f None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:29.940312 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72845d69-c9e9-4b7b-9ab3-58d617fe3a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:29.972577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-72845d69-c9e9-4b7b-9ab3-58d617fe3a4f None None] MFA Rules not processed for user `8304ca06f82742ef8ce74396884e90b4`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:33:29.973882 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-72845d69-c9e9-4b7b-9ab3-58d617fe3a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:33:29.981013 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1391/2787] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 23 04:33:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:33:29.993440 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18312aef-2a42-46ec-b502-0274f4a34b2a None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:33:30.005590 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18312aef-2a42-46ec-b502-0274f4a34b2a None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:33:30.009137 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b8c14-55bd-4a83-9f2f-59117d884d45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:33:30.009745 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b8c14-55bd-4a83-9f2f-59117d884d45 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:30.010031 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b8c14-55bd-4a83-9f2f-59117d884d45 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:30.010305 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b8c14-55bd-4a83-9f2f-59117d884d45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:30.017784 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b8c14-55bd-4a83-9f2f-59117d884d45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:33:30.019209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b8c14-55bd-4a83-9f2f-59117d884d45 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:33:30.027221 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1397/2788] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:33:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 04:33:30.110717 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee4225-b8df-422e-9e8a-31da502c0f16 None None] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:30.116652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee4225-b8df-422e-9e8a-31da502c0f16 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:30.116652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee4225-b8df-422e-9e8a-31da502c0f16 None None] PATH_INFO: `/` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:30.116652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1392/2789] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 23 04:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 04:33:30.117641 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdc5c1-f2c8-4ee3-ac09-eb61db63529b None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:30.117935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdc5c1-f2c8-4ee3-ac09-eb61db63529b None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:30.118218 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdc5c1-f2c8-4ee3-ac09-eb61db63529b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:30.139318 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-94fdc5c1-f2c8-4ee3-ac09-eb61db63529b None None] MFA Rules not processed for user `1e0236a0acac4b87be977878b5186551`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:33:30.140589 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-94fdc5c1-f2c8-4ee3-ac09-eb61db63529b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:33:30.150682 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1398/2790] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 23 04:33:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:33:30.163051 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee4225-b8df-422e-9e8a-31da502c0f16 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:33:30.175280 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee4225-b8df-422e-9e8a-31da502c0f16 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:33:30.179090 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f1170-6657-4505-8ddb-667ad6d6ce3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:33:30.179769 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f1170-6657-4505-8ddb-667ad6d6ce3b service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:30.180053 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f1170-6657-4505-8ddb-667ad6d6ce3b service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:30.180325 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f1170-6657-4505-8ddb-667ad6d6ce3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:30.192286 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f1170-6657-4505-8ddb-667ad6d6ce3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:33:30.193890 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f1170-6657-4505-8ddb-667ad6d6ce3b service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:33:30.206490 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1393/2791] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:33:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:33:32.863746 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e7cdd-f092-4abd-856e-0da4ca241c19 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:32.864289 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e7cdd-f092-4abd-856e-0da4ca241c19 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:32.864289 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e7cdd-f092-4abd-856e-0da4ca241c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:32.883779 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-b02e7cdd-f092-4abd-856e-0da4ca241c19 None None] MFA Rules not processed for user `826b9a7c343b4dbc9aeb3dbc0b75fc92`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:33:32.888175 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-b02e7cdd-f092-4abd-856e-0da4ca241c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:33:32.892663 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1399/2792] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 23 04:33:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:33:32.906627 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f1170-6657-4505-8ddb-667ad6d6ce3b service neutron] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:33:32.918819 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f1170-6657-4505-8ddb-667ad6d6ce3b service neutron] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:33:32.925381 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6506b08-263b-4f4f-8d5f-2e56ec9b220c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63190c62bc92403880ffaedc4737485a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:33:32.926020 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6506b08-263b-4f4f-8d5f-2e56ec9b220c service swift] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:32.926302 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6506b08-263b-4f4f-8d5f-2e56ec9b220c service swift] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:32.926630 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6506b08-263b-4f4f-8d5f-2e56ec9b220c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:32.936426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6506b08-263b-4f4f-8d5f-2e56ec9b220c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:33:32.938077 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6506b08-263b-4f4f-8d5f-2e56ec9b220c service swift] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:33:32.954047 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1394/2793] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 23 04:33:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 04:33:33.593746 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e7cdd-f092-4abd-856e-0da4ca241c19 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:33:33.596339 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-b02e7cdd-f092-4abd-856e-0da4ca241c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:33:33.613423 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e7cdd-f092-4abd-856e-0da4ca241c19 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:33:33.620845 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4257f75-abb2-47c2-a875-1ac8cc41a03f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34794124b7234aeb98a15f0c2ae06a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:33:33.621470 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4257f75-abb2-47c2-a875-1ac8cc41a03f service placement] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:33.621879 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4257f75-abb2-47c2-a875-1ac8cc41a03f service placement] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:33.622023 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4257f75-abb2-47c2-a875-1ac8cc41a03f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:33.623933 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-d4257f75-abb2-47c2-a875-1ac8cc41a03f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:33:33.636954 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4257f75-abb2-47c2-a875-1ac8cc41a03f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:33:33.638657 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4257f75-abb2-47c2-a875-1ac8cc41a03f service placement] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:33:33.649909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1400/2794] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:33:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:33:33.731011 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6506b08-263b-4f4f-8d5f-2e56ec9b220c service swift] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:33:33.746436 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6506b08-263b-4f4f-8d5f-2e56ec9b220c service swift] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:33:33.751686 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76484b04-002f-4409-b7a3-d2ab39f10ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:33:33.752669 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76484b04-002f-4409-b7a3-d2ab39f10ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:33.753047 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76484b04-002f-4409-b7a3-d2ab39f10ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:33.753456 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76484b04-002f-4409-b7a3-d2ab39f10ba7 admin admin] PATH_INFO: `/v3/users/b75b5638c6d8452bb6da7bb347496665` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:33.754703 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76484b04-002f-4409-b7a3-d2ab39f10ba7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b75b5638c6d8452bb6da7bb347496665)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:33:33.756874 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76484b04-002f-4409-b7a3-d2ab39f10ba7 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:33:33.925781 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-76484b04-002f-4409-b7a3-d2ab39f10ba7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b75b5638c6d8452bb6da7bb347496665'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:33:33.927468 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-76484b04-002f-4409-b7a3-d2ab39f10ba7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b75b5638c6d8452bb6da7bb347496665'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:33:33.937104 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-76484b04-002f-4409-b7a3-d2ab39f10ba7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b75b5638c6d8452bb6da7bb347496665'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:33:33.938136 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-76484b04-002f-4409-b7a3-d2ab39f10ba7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b75b5638c6d8452bb6da7bb347496665'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:33:33.954402 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-76484b04-002f-4409-b7a3-d2ab39f10ba7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b75b5638c6d8452bb6da7bb347496665'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:33:34.058391 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1395/2795] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:33:33 2022] DELETE /identity/v3/users/b75b5638c6d8452bb6da7bb347496665 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:33:34.349744 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4257f75-abb2-47c2-a875-1ac8cc41a03f service placement] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:33:34.371082 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4257f75-abb2-47c2-a875-1ac8cc41a03f service placement] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:33:34.442941 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d006e-1780-4639-8f9b-e67e7159e10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:33:34.443680 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d006e-1780-4639-8f9b-e67e7159e10e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:34.443995 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d006e-1780-4639-8f9b-e67e7159e10e admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:34.444997 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d006e-1780-4639-8f9b-e67e7159e10e admin admin] PATH_INFO: `/v3/projects/77a9cd0a37c34fdf8db5cc51851a95aa` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:34.446775 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d006e-1780-4639-8f9b-e67e7159e10e admin admin] RBAC: Authorizing `identity:delete_project(project_id=77a9cd0a37c34fdf8db5cc51851a95aa)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:33:34.448713 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d006e-1780-4639-8f9b-e67e7159e10e admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:33:34.574119 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6d5d006e-1780-4639-8f9b-e67e7159e10e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77a9cd0a37c34fdf8db5cc51851a95aa', 'request_id': 'req-6d5d006e-1780-4639-8f9b-e67e7159e10e'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:33:34.580587 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6d5d006e-1780-4639-8f9b-e67e7159e10e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77a9cd0a37c34fdf8db5cc51851a95aa', 'request_id': 'req-6d5d006e-1780-4639-8f9b-e67e7159e10e'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:33:34.586632 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6d5d006e-1780-4639-8f9b-e67e7159e10e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77a9cd0a37c34fdf8db5cc51851a95aa', 'request_id': 'req-6d5d006e-1780-4639-8f9b-e67e7159e10e'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:33:34.653549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6d5d006e-1780-4639-8f9b-e67e7159e10e admin admin] The token cache is being invalidate because project 77a9cd0a37c34fdf8db5cc51851a95aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:33:34.653984 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6d5d006e-1780-4639-8f9b-e67e7159e10e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:33:34.654639 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-6d5d006e-1780-4639-8f9b-e67e7159e10e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:33:34.662133 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1401/2796] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:33:34 2022] DELETE /identity/v3/projects/77a9cd0a37c34fdf8db5cc51851a95aa => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:33:34.664688 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28ed20-b165-4ea2-8356-4c9edb26592a None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:34.664688 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28ed20-b165-4ea2-8356-4c9edb26592a None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:34.664688 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28ed20-b165-4ea2-8356-4c9edb26592a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:34.685857 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-3b28ed20-b165-4ea2-8356-4c9edb26592a None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:33:34.687444 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-3b28ed20-b165-4ea2-8356-4c9edb26592a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:33:34.725690 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:33:34.768761 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1396/2797] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:33:34.777920 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50cb21-8a13-486a-b9f9-965280e6109a None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:34.778211 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50cb21-8a13-486a-b9f9-965280e6109a None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:34.778485 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50cb21-8a13-486a-b9f9-965280e6109a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:34.800632 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-cb50cb21-8a13-486a-b9f9-965280e6109a None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:33:34.801894 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-cb50cb21-8a13-486a-b9f9-965280e6109a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:33:34.810428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1402/2798] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:33:34.815060 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28ed20-b165-4ea2-8356-4c9edb26592a None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:33:34.825261 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28ed20-b165-4ea2-8356-4c9edb26592a None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:33:34.829808 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efc9d7-eb74-49b9-a4f1-0a49a0c0f4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:33:34.830425 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efc9d7-eb74-49b9-a4f1-0a49a0c0f4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:34.830707 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efc9d7-eb74-49b9-a4f1-0a49a0c0f4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:34.830983 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efc9d7-eb74-49b9-a4f1-0a49a0c0f4f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:34.831638 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32efc9d7-eb74-49b9-a4f1-0a49a0c0f4f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:33:34.831945 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32efc9d7-eb74-49b9-a4f1-0a49a0c0f4f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:33:34.833749 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32efc9d7-eb74-49b9-a4f1-0a49a0c0f4f9 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:33:34.848162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1397/2799] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:33:34.852611 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50cb21-8a13-486a-b9f9-965280e6109a None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:33:34.865881 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50cb21-8a13-486a-b9f9-965280e6109a None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:33:34.871382 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad1086-7e4c-49b1-af33-131273db8845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:33:34.871999 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad1086-7e4c-49b1-af33-131273db8845 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:34.872278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad1086-7e4c-49b1-af33-131273db8845 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:34.872544 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad1086-7e4c-49b1-af33-131273db8845 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:34.873447 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad1086-7e4c-49b1-af33-131273db8845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:33:34.875390 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad1086-7e4c-49b1-af33-131273db8845 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:33:34.962084 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1403/2800] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:33:34 2022] POST /identity/v3/projects => generated 399 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:33:34.966577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efc9d7-eb74-49b9-a4f1-0a49a0c0f4f9 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:33:34.978001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efc9d7-eb74-49b9-a4f1-0a49a0c0f4f9 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:33:35.045625 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348752b-5b8a-40db-9a7e-1b641fa9d446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:33:35.046418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348752b-5b8a-40db-9a7e-1b641fa9d446 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:35.046793 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348752b-5b8a-40db-9a7e-1b641fa9d446 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:35.047162 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348752b-5b8a-40db-9a7e-1b641fa9d446 admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:35.048027 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348752b-5b8a-40db-9a7e-1b641fa9d446 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:33:35.050133 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348752b-5b8a-40db-9a7e-1b641fa9d446 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:33:35.213633 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1398/2801] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:33:34 2022] POST /identity/v3/users => generated 300 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:33:35.217856 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad1086-7e4c-49b1-af33-131273db8845 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:33:35.234482 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:33:35.238801 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad1086-7e4c-49b1-af33-131273db8845 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:33:35.244191 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee7a48-e0f7-4a15-8d40-ff2cc5d76085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:33:35.244840 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee7a48-e0f7-4a15-8d40-ff2cc5d76085 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:35.245130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee7a48-e0f7-4a15-8d40-ff2cc5d76085 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:35.245423 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee7a48-e0f7-4a15-8d40-ff2cc5d76085 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:35.246086 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee7a48-e0f7-4a15-8d40-ff2cc5d76085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:33:35.247767 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee7a48-e0f7-4a15-8d40-ff2cc5d76085 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:33:35.259504 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1404/2802] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:33:35.263759 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348752b-5b8a-40db-9a7e-1b641fa9d446 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:33:35.274988 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348752b-5b8a-40db-9a7e-1b641fa9d446 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:33:35.280140 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96646d-9102-4fae-ae9d-18083edeba62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:33:35.280869 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96646d-9102-4fae-ae9d-18083edeba62 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:35.281288 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96646d-9102-4fae-ae9d-18083edeba62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:35.281701 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96646d-9102-4fae-ae9d-18083edeba62 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:35.282462 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96646d-9102-4fae-ae9d-18083edeba62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:33:35.284173 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96646d-9102-4fae-ae9d-18083edeba62 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:33:35.301446 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1399/2803] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:33:35.303060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee7a48-e0f7-4a15-8d40-ff2cc5d76085 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:33:35.319929 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee7a48-e0f7-4a15-8d40-ff2cc5d76085 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:33:35.326225 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fdd73-5a94-4c82-8fe9-8fd63e0c52ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:33:35.327052 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fdd73-5a94-4c82-8fe9-8fd63e0c52ea admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:35.327486 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fdd73-5a94-4c82-8fe9-8fd63e0c52ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:35.327804 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fdd73-5a94-4c82-8fe9-8fd63e0c52ea admin admin] PATH_INFO: `/v3/projects/5d73e139bfdc4d2ca324db577ee4ba63/users/974ffd7331f6451e91e1368f5c1ba8da/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:35.344465 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3fdd73-5a94-4c82-8fe9-8fd63e0c52ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d73e139bfdc4d2ca324db577ee4ba63, user_id=974ffd7331f6451e91e1368f5c1ba8da, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:33:35.347263 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3fdd73-5a94-4c82-8fe9-8fd63e0c52ea admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:33:35.415742 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1405/2804] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:33:35 2022] PUT /identity/v3/projects/5d73e139bfdc4d2ca324db577ee4ba63/users/974ffd7331f6451e91e1368f5c1ba8da/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:33:35.425833 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a154dc-a06c-4608-b7d9-eee5022ef689 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:35.426129 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a154dc-a06c-4608-b7d9-eee5022ef689 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:35.426409 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a154dc-a06c-4608-b7d9-eee5022ef689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:35.466024 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-c7a154dc-a06c-4608-b7d9-eee5022ef689 None None] MFA Rules not processed for user `974ffd7331f6451e91e1368f5c1ba8da`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:33:35.467188 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-c7a154dc-a06c-4608-b7d9-eee5022ef689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:33:35.542097 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1400/2805] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:33:35 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:33:35.553601 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fdd73-5a94-4c82-8fe9-8fd63e0c52ea admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:33:35.555625 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-3b3fdd73-5a94-4c82-8fe9-8fd63e0c52ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:33:35.654065 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fdd73-5a94-4c82-8fe9-8fd63e0c52ea admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:33:35.658104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80b196-a179-4e14-8796-827ddd038f14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:33:35.658939 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80b196-a179-4e14-8796-827ddd038f14 service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:35.659399 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80b196-a179-4e14-8796-827ddd038f14 service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:35.659835 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80b196-a179-4e14-8796-827ddd038f14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:35.670013 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80b196-a179-4e14-8796-827ddd038f14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:33:35.671726 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80b196-a179-4e14-8796-827ddd038f14 service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:33:35.682368 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1406/2806] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:33:35 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:33:41.848372 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a154dc-a06c-4608-b7d9-eee5022ef689 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:33:41.878625 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:33:41.912604 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a154dc-a06c-4608-b7d9-eee5022ef689 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:33:41.917475 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c759b-2771-4f1b-898b-9a194a5a41b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:33:41.917982 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c759b-2771-4f1b-898b-9a194a5a41b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:41.918273 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c759b-2771-4f1b-898b-9a194a5a41b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:41.918910 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c759b-2771-4f1b-898b-9a194a5a41b8 admin admin] PATH_INFO: `/v3/users/974ffd7331f6451e91e1368f5c1ba8da` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:41.920354 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c759b-2771-4f1b-898b-9a194a5a41b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=974ffd7331f6451e91e1368f5c1ba8da)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:33:41.923049 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c759b-2771-4f1b-898b-9a194a5a41b8 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:33:42.110152 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-589c759b-2771-4f1b-898b-9a194a5a41b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '974ffd7331f6451e91e1368f5c1ba8da'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:33:42.110800 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-589c759b-2771-4f1b-898b-9a194a5a41b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '974ffd7331f6451e91e1368f5c1ba8da'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:33:42.118488 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-589c759b-2771-4f1b-898b-9a194a5a41b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '974ffd7331f6451e91e1368f5c1ba8da'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:33:42.119135 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-589c759b-2771-4f1b-898b-9a194a5a41b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '974ffd7331f6451e91e1368f5c1ba8da'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:33:42.131001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-589c759b-2771-4f1b-898b-9a194a5a41b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '974ffd7331f6451e91e1368f5c1ba8da'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:33:42.215443 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1401/2807] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:33:41 2022] DELETE /identity/v3/users/974ffd7331f6451e91e1368f5c1ba8da => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:33:42.219975 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65a8cf-1c90-455b-92fa-416fd3ac93bf None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:42.220460 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65a8cf-1c90-455b-92fa-416fd3ac93bf None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:42.220567 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65a8cf-1c90-455b-92fa-416fd3ac93bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:42.240054 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-6b65a8cf-1c90-455b-92fa-416fd3ac93bf None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:33:42.241278 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-6b65a8cf-1c90-455b-92fa-416fd3ac93bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:33:42.301639 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1407/2808] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:33:42.312180 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c759b-2771-4f1b-898b-9a194a5a41b8 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:33:42.313615 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-589c759b-2771-4f1b-898b-9a194a5a41b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:33:42.370280 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c759b-2771-4f1b-898b-9a194a5a41b8 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:33:42.373810 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066bcb3-8caa-4600-9bf0-34e6f0b96e4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:33:42.374416 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066bcb3-8caa-4600-9bf0-34e6f0b96e4d service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:42.374700 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066bcb3-8caa-4600-9bf0-34e6f0b96e4d service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:42.374974 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066bcb3-8caa-4600-9bf0-34e6f0b96e4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:42.386878 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066bcb3-8caa-4600-9bf0-34e6f0b96e4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:33:42.388311 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066bcb3-8caa-4600-9bf0-34e6f0b96e4d service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:33:42.397701 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1402/2809] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:33:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:33:43.524539 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65a8cf-1c90-455b-92fa-416fd3ac93bf None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:33:43.526217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-6b65a8cf-1c90-455b-92fa-416fd3ac93bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:33:43.541180 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65a8cf-1c90-455b-92fa-416fd3ac93bf None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:33:43.547477 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab732a-ecae-40e1-a3bd-434fc3f37516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:33:43.548204 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab732a-ecae-40e1-a3bd-434fc3f37516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:43.548491 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab732a-ecae-40e1-a3bd-434fc3f37516 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:43.548775 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab732a-ecae-40e1-a3bd-434fc3f37516 admin admin] PATH_INFO: `/v3/projects/5d73e139bfdc4d2ca324db577ee4ba63` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:43.550219 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab732a-ecae-40e1-a3bd-434fc3f37516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d73e139bfdc4d2ca324db577ee4ba63)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:33:43.555208 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab732a-ecae-40e1-a3bd-434fc3f37516 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:33:43.691112 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:33:43.692447 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-13ab732a-ecae-40e1-a3bd-434fc3f37516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d73e139bfdc4d2ca324db577ee4ba63', 'request_id': 'req-13ab732a-ecae-40e1-a3bd-434fc3f37516'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:33:43.698577 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-13ab732a-ecae-40e1-a3bd-434fc3f37516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d73e139bfdc4d2ca324db577ee4ba63', 'request_id': 'req-13ab732a-ecae-40e1-a3bd-434fc3f37516'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:33:43.704094 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-13ab732a-ecae-40e1-a3bd-434fc3f37516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d73e139bfdc4d2ca324db577ee4ba63', 'request_id': 'req-13ab732a-ecae-40e1-a3bd-434fc3f37516'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:33:43.810573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-13ab732a-ecae-40e1-a3bd-434fc3f37516 admin admin] The token cache is being invalidate because project 5d73e139bfdc4d2ca324db577ee4ba63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:33:43.810893 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-13ab732a-ecae-40e1-a3bd-434fc3f37516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:33:43.811553 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-13ab732a-ecae-40e1-a3bd-434fc3f37516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:33:43.813266 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1408/2810] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:33:43 2022] DELETE /identity/v3/projects/5d73e139bfdc4d2ca324db577ee4ba63 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:33:46.869337 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2793b1-954e-4ad5-b687-635ee1a42bd7 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:46.869780 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2793b1-954e-4ad5-b687-635ee1a42bd7 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:46.869892 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2793b1-954e-4ad5-b687-635ee1a42bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:46.889340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-dd2793b1-954e-4ad5-b687-635ee1a42bd7 None None] MFA Rules not processed for user `826b9a7c343b4dbc9aeb3dbc0b75fc92`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:33:46.890546 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-dd2793b1-954e-4ad5-b687-635ee1a42bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:33:46.933682 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:33:46.945359 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1403/2811] 10.222.0.42 () {58 vars in 967 bytes} [Tue Aug 23 04:33:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:33:46.957344 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab732a-ecae-40e1-a3bd-434fc3f37516 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:33:46.958828 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-13ab732a-ecae-40e1-a3bd-434fc3f37516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:33:47.028467 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab732a-ecae-40e1-a3bd-434fc3f37516 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:33:47.033545 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd023a52-2b07-4ba7-a08c-a546e87d9b3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63190c62bc92403880ffaedc4737485a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:33:47.034153 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd023a52-2b07-4ba7-a08c-a546e87d9b3f service swift] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:33:47.034436 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd023a52-2b07-4ba7-a08c-a546e87d9b3f service swift] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:33:47.034709 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd023a52-2b07-4ba7-a08c-a546e87d9b3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:33:47.042651 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd023a52-2b07-4ba7-a08c-a546e87d9b3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:33:47.044251 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd023a52-2b07-4ba7-a08c-a546e87d9b3f service swift] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:33:47.052193 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1409/2812] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 23 04:33:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 04:33:57.032973 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=3 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:33:57.048933 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=39,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:34:19.871479 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2793b1-954e-4ad5-b687-635ee1a42bd7 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:19.875204 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-dd2793b1-954e-4ad5-b687-635ee1a42bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:19.939591 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2793b1-954e-4ad5-b687-635ee1a42bd7 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:19.944093 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1d07a-0861-4de7-8028-6f2e335b0d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:19.944731 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1d07a-0861-4de7-8028-6f2e335b0d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:19.945012 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1d07a-0861-4de7-8028-6f2e335b0d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:19.945316 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1d07a-0861-4de7-8028-6f2e335b0d7c admin admin] PATH_INFO: `/v3/users/811fd2d4db864678825214eef1ed467f` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:19.946522 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1d07a-0861-4de7-8028-6f2e335b0d7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=811fd2d4db864678825214eef1ed467f)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:19.948486 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1d07a-0861-4de7-8028-6f2e335b0d7c admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:20.130742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-ccb1d07a-0861-4de7-8028-6f2e335b0d7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '811fd2d4db864678825214eef1ed467f'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:20.131393 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-ccb1d07a-0861-4de7-8028-6f2e335b0d7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '811fd2d4db864678825214eef1ed467f'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:20.138374 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-ccb1d07a-0861-4de7-8028-6f2e335b0d7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '811fd2d4db864678825214eef1ed467f'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:20.139056 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-ccb1d07a-0861-4de7-8028-6f2e335b0d7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '811fd2d4db864678825214eef1ed467f'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:20.151235 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-ccb1d07a-0861-4de7-8028-6f2e335b0d7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '811fd2d4db864678825214eef1ed467f'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:20.248452 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1404/2813] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:34:19 2022] DELETE /identity/v3/users/811fd2d4db864678825214eef1ed467f => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:34:20.479126 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd023a52-2b07-4ba7-a08c-a546e87d9b3f service swift] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:20.489533 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd023a52-2b07-4ba7-a08c-a546e87d9b3f service swift] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:20.556561 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efce070-4736-4335-8d8b-de7e196ed55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:20.557250 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efce070-4736-4335-8d8b-de7e196ed55c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:20.557535 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efce070-4736-4335-8d8b-de7e196ed55c admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:20.557812 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efce070-4736-4335-8d8b-de7e196ed55c admin admin] PATH_INFO: `/v3/projects/1980305368b84a3cbde0123e955e826c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:20.559198 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efce070-4736-4335-8d8b-de7e196ed55c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1980305368b84a3cbde0123e955e826c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:20.561137 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efce070-4736-4335-8d8b-de7e196ed55c admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:20.674675 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-1efce070-4736-4335-8d8b-de7e196ed55c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1980305368b84a3cbde0123e955e826c', 'request_id': 'req-1efce070-4736-4335-8d8b-de7e196ed55c'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:20.681113 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-1efce070-4736-4335-8d8b-de7e196ed55c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1980305368b84a3cbde0123e955e826c', 'request_id': 'req-1efce070-4736-4335-8d8b-de7e196ed55c'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:20.686859 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-1efce070-4736-4335-8d8b-de7e196ed55c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1980305368b84a3cbde0123e955e826c', 'request_id': 'req-1efce070-4736-4335-8d8b-de7e196ed55c'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:20.771247 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-1efce070-4736-4335-8d8b-de7e196ed55c admin admin] The token cache is being invalidate because project 1980305368b84a3cbde0123e955e826c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:34:20.772146 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-1efce070-4736-4335-8d8b-de7e196ed55c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:20.772839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-1efce070-4736-4335-8d8b-de7e196ed55c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:20.774379 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1410/2814] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:34:20 2022] DELETE /identity/v3/projects/1980305368b84a3cbde0123e955e826c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:34:20.778594 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1d07a-0861-4de7-8028-6f2e335b0d7c admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:20.780002 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-ccb1d07a-0861-4de7-8028-6f2e335b0d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:20.792902 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1d07a-0861-4de7-8028-6f2e335b0d7c admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:20.847845 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8d63f-75cf-4234-9f2d-2d3965ab6f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:20.848470 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8d63f-75cf-4234-9f2d-2d3965ab6f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:20.848749 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8d63f-75cf-4234-9f2d-2d3965ab6f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:20.849045 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8d63f-75cf-4234-9f2d-2d3965ab6f21 admin admin] PATH_INFO: `/v3/users/a4486054a8ac4aca8430cebcb15d29dd` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:20.850217 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8d63f-75cf-4234-9f2d-2d3965ab6f21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4486054a8ac4aca8430cebcb15d29dd)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:20.852126 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8d63f-75cf-4234-9f2d-2d3965ab6f21 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:20.873255 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:34:21.120830 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-a5f8d63f-75cf-4234-9f2d-2d3965ab6f21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4486054a8ac4aca8430cebcb15d29dd'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:21.121413 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-a5f8d63f-75cf-4234-9f2d-2d3965ab6f21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4486054a8ac4aca8430cebcb15d29dd'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:21.128274 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-a5f8d63f-75cf-4234-9f2d-2d3965ab6f21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4486054a8ac4aca8430cebcb15d29dd'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:21.128893 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-a5f8d63f-75cf-4234-9f2d-2d3965ab6f21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4486054a8ac4aca8430cebcb15d29dd'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:21.141416 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-a5f8d63f-75cf-4234-9f2d-2d3965ab6f21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4486054a8ac4aca8430cebcb15d29dd'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:21.219812 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1405/2815] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:34:20 2022] DELETE /identity/v3/users/a4486054a8ac4aca8430cebcb15d29dd => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:34:21.492355 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efce070-4736-4335-8d8b-de7e196ed55c admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:21.493839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-1efce070-4736-4335-8d8b-de7e196ed55c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:21.507289 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efce070-4736-4335-8d8b-de7e196ed55c admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:21.566285 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d371a2f-64c0-4fcd-ab88-7d7456c0439d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:21.566962 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d371a2f-64c0-4fcd-ab88-7d7456c0439d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:21.567244 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d371a2f-64c0-4fcd-ab88-7d7456c0439d admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:21.567523 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d371a2f-64c0-4fcd-ab88-7d7456c0439d admin admin] PATH_INFO: `/v3/projects/959f33d82f564ad2941181915184bda0` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:21.568652 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d371a2f-64c0-4fcd-ab88-7d7456c0439d admin admin] RBAC: Authorizing `identity:delete_project(project_id=959f33d82f564ad2941181915184bda0)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:21.570596 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d371a2f-64c0-4fcd-ab88-7d7456c0439d admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:21.657774 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:34:21.669865 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-9d371a2f-64c0-4fcd-ab88-7d7456c0439d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '959f33d82f564ad2941181915184bda0', 'request_id': 'req-9d371a2f-64c0-4fcd-ab88-7d7456c0439d'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:21.676031 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-9d371a2f-64c0-4fcd-ab88-7d7456c0439d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '959f33d82f564ad2941181915184bda0', 'request_id': 'req-9d371a2f-64c0-4fcd-ab88-7d7456c0439d'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:21.682150 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-9d371a2f-64c0-4fcd-ab88-7d7456c0439d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '959f33d82f564ad2941181915184bda0', 'request_id': 'req-9d371a2f-64c0-4fcd-ab88-7d7456c0439d'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:21.760103 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-9d371a2f-64c0-4fcd-ab88-7d7456c0439d admin admin] The token cache is being invalidate because project 959f33d82f564ad2941181915184bda0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:34:21.760395 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-9d371a2f-64c0-4fcd-ab88-7d7456c0439d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:21.761017 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-9d371a2f-64c0-4fcd-ab88-7d7456c0439d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:21.762530 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1411/2816] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:34:21 2022] DELETE /identity/v3/projects/959f33d82f564ad2941181915184bda0 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:34:22.046848 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8d63f-75cf-4234-9f2d-2d3965ab6f21 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:22.048248 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-a5f8d63f-75cf-4234-9f2d-2d3965ab6f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:22.106402 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8d63f-75cf-4234-9f2d-2d3965ab6f21 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:22.155568 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937b455-aa05-4059-afa9-9b8a84a67e17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:22.156178 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937b455-aa05-4059-afa9-9b8a84a67e17 service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:22.156462 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937b455-aa05-4059-afa9-9b8a84a67e17 service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:22.156738 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937b455-aa05-4059-afa9-9b8a84a67e17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:22.158514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-9937b455-aa05-4059-afa9-9b8a84a67e17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:22.215672 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9937b455-aa05-4059-afa9-9b8a84a67e17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:22.217074 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9937b455-aa05-4059-afa9-9b8a84a67e17 service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:22.226161 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1406/2817] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:34:22 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:34:23.937356 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d371a2f-64c0-4fcd-ab88-7d7456c0439d admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:23.938770 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-9d371a2f-64c0-4fcd-ab88-7d7456c0439d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:23.997540 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d371a2f-64c0-4fcd-ab88-7d7456c0439d admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:24.001079 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be87c8a-5b45-4e71-8624-496d440c685f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:24.001704 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be87c8a-5b45-4e71-8624-496d440c685f service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:24.001982 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be87c8a-5b45-4e71-8624-496d440c685f service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:24.002252 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be87c8a-5b45-4e71-8624-496d440c685f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:24.003956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-4be87c8a-5b45-4e71-8624-496d440c685f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:24.076708 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be87c8a-5b45-4e71-8624-496d440c685f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:24.078172 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be87c8a-5b45-4e71-8624-496d440c685f service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:24.089301 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1412/2818] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:34:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:34:29.876566 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937b455-aa05-4059-afa9-9b8a84a67e17 service cinder] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:29.877965 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-9937b455-aa05-4059-afa9-9b8a84a67e17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:29.890180 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937b455-aa05-4059-afa9-9b8a84a67e17 service cinder] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:29.893853 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767d050-8f29-45b2-b6b8-96fa4c61459e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:29.894460 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767d050-8f29-45b2-b6b8-96fa4c61459e service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:29.894744 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767d050-8f29-45b2-b6b8-96fa4c61459e service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:29.895023 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767d050-8f29-45b2-b6b8-96fa4c61459e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:29.897397 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-d767d050-8f29-45b2-b6b8-96fa4c61459e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:29.903199 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:34:29.961014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767d050-8f29-45b2-b6b8-96fa4c61459e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:29.963311 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767d050-8f29-45b2-b6b8-96fa4c61459e service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:29.972985 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1407/2819] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:34:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:34:33.716001 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be87c8a-5b45-4e71-8624-496d440c685f service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:33.717500 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-4be87c8a-5b45-4e71-8624-496d440c685f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:33.732065 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be87c8a-5b45-4e71-8624-496d440c685f service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:33.736615 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cc991-ccc0-45cb-8dc7-48562fc60421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:33.740117 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cc991-ccc0-45cb-8dc7-48562fc60421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:33.740117 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cc991-ccc0-45cb-8dc7-48562fc60421 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:33.740117 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cc991-ccc0-45cb-8dc7-48562fc60421 admin admin] PATH_INFO: `/v3/users/6a9a5ca141da4c26989d6a7c702c4acd` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:33.740117 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9cc991-ccc0-45cb-8dc7-48562fc60421 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a9a5ca141da4c26989d6a7c702c4acd)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:33.741535 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9cc991-ccc0-45cb-8dc7-48562fc60421 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:33.922224 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-da9cc991-ccc0-45cb-8dc7-48562fc60421 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a9a5ca141da4c26989d6a7c702c4acd'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:33.983579 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-da9cc991-ccc0-45cb-8dc7-48562fc60421 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a9a5ca141da4c26989d6a7c702c4acd'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:33.986154 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:34:33.992556 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-da9cc991-ccc0-45cb-8dc7-48562fc60421 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a9a5ca141da4c26989d6a7c702c4acd'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:34.004287 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-da9cc991-ccc0-45cb-8dc7-48562fc60421 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a9a5ca141da4c26989d6a7c702c4acd'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:34.004947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-da9cc991-ccc0-45cb-8dc7-48562fc60421 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a9a5ca141da4c26989d6a7c702c4acd'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:34.011484 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1413/2820] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:34:33 2022] DELETE /identity/v3/users/6a9a5ca141da4c26989d6a7c702c4acd => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:34:34.285024 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767d050-8f29-45b2-b6b8-96fa4c61459e service neutron] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:34.295531 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767d050-8f29-45b2-b6b8-96fa4c61459e service neutron] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:34.354366 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa6493-9cfc-4660-bc16-db4666f3b37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:34.355032 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa6493-9cfc-4660-bc16-db4666f3b37b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:34.355313 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa6493-9cfc-4660-bc16-db4666f3b37b admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:34.355587 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa6493-9cfc-4660-bc16-db4666f3b37b admin admin] PATH_INFO: `/v3/projects/ddfc20681bf0452f99cd699c17c4c022` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:34.356705 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa6493-9cfc-4660-bc16-db4666f3b37b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddfc20681bf0452f99cd699c17c4c022)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:34.358697 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa6493-9cfc-4660-bc16-db4666f3b37b admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:34.452888 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-5ffa6493-9cfc-4660-bc16-db4666f3b37b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddfc20681bf0452f99cd699c17c4c022', 'request_id': 'req-5ffa6493-9cfc-4660-bc16-db4666f3b37b'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:34.459804 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-5ffa6493-9cfc-4660-bc16-db4666f3b37b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddfc20681bf0452f99cd699c17c4c022', 'request_id': 'req-5ffa6493-9cfc-4660-bc16-db4666f3b37b'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:34.465484 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-5ffa6493-9cfc-4660-bc16-db4666f3b37b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddfc20681bf0452f99cd699c17c4c022', 'request_id': 'req-5ffa6493-9cfc-4660-bc16-db4666f3b37b'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:34.530514 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-5ffa6493-9cfc-4660-bc16-db4666f3b37b admin admin] The token cache is being invalidate because project ddfc20681bf0452f99cd699c17c4c022 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:34:34.530755 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-5ffa6493-9cfc-4660-bc16-db4666f3b37b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:34.531448 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-5ffa6493-9cfc-4660-bc16-db4666f3b37b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:34.532984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1408/2821] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:34:34 2022] DELETE /identity/v3/projects/ddfc20681bf0452f99cd699c17c4c022 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:34:34.538527 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1d2c6-f2f3-47f5-836a-6d6415fbebfb None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:34.540076 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1d2c6-f2f3-47f5-836a-6d6415fbebfb None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:34.540076 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1d2c6-f2f3-47f5-836a-6d6415fbebfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:34.558646 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-cfb1d2c6-f2f3-47f5-836a-6d6415fbebfb None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:34:34.560115 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-cfb1d2c6-f2f3-47f5-836a-6d6415fbebfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:34.620098 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1414/2822] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 04:34:34.627702 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7ebce-18c5-4b1b-8728-068935560be8 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:34.627984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7ebce-18c5-4b1b-8728-068935560be8 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:34.628255 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7ebce-18c5-4b1b-8728-068935560be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:34.648151 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-c1b7ebce-18c5-4b1b-8728-068935560be8 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:34:34.649370 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-c1b7ebce-18c5-4b1b-8728-068935560be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:34.657068 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1409/2823] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:34:34.661253 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1d2c6-f2f3-47f5-836a-6d6415fbebfb None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:34.671488 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1d2c6-f2f3-47f5-836a-6d6415fbebfb None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:34.675998 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7800b-ab1f-4dc2-ab83-df91847679ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:34.676596 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7800b-ab1f-4dc2-ab83-df91847679ed admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:34.676883 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7800b-ab1f-4dc2-ab83-df91847679ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:34.677213 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7800b-ab1f-4dc2-ab83-df91847679ed admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:34.677871 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7800b-ab1f-4dc2-ab83-df91847679ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:34:34.678179 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7800b-ab1f-4dc2-ab83-df91847679ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:34.679781 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7800b-ab1f-4dc2-ab83-df91847679ed admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:34.691477 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1415/2824] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:34:34.695566 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7ebce-18c5-4b1b-8728-068935560be8 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:34.704804 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7ebce-18c5-4b1b-8728-068935560be8 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:34.710054 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6d652-6b94-420b-8643-b3450338cd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:34.710666 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6d652-6b94-420b-8643-b3450338cd97 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:34.710956 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6d652-6b94-420b-8643-b3450338cd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:34.711256 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6d652-6b94-420b-8643-b3450338cd97 admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:34.711881 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6d652-6b94-420b-8643-b3450338cd97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:34.713844 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6d652-6b94-420b-8643-b3450338cd97 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:34.739026 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:34:34.878705 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1410/2825] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:34:34 2022] POST /identity/v3/projects => generated 371 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:34:34.883454 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7800b-ab1f-4dc2-ab83-df91847679ed admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:34.893611 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7800b-ab1f-4dc2-ab83-df91847679ed admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:34.950661 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf4b7a-26eb-48a2-8189-a1b555ae58a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:34.951281 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf4b7a-26eb-48a2-8189-a1b555ae58a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:34.951563 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf4b7a-26eb-48a2-8189-a1b555ae58a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:34.951836 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf4b7a-26eb-48a2-8189-a1b555ae58a4 admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:34.952468 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf4b7a-26eb-48a2-8189-a1b555ae58a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:34.954462 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf4b7a-26eb-48a2-8189-a1b555ae58a4 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:35.034264 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1416/2826] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:34:34 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:34:35.038399 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6d652-6b94-420b-8643-b3450338cd97 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:35.048970 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6d652-6b94-420b-8643-b3450338cd97 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:35.053531 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc234f54-8208-46e8-8703-ef06c3379858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:35.054165 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc234f54-8208-46e8-8703-ef06c3379858 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:35.054442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc234f54-8208-46e8-8703-ef06c3379858 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:35.054715 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc234f54-8208-46e8-8703-ef06c3379858 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:35.055363 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc234f54-8208-46e8-8703-ef06c3379858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:35.056950 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc234f54-8208-46e8-8703-ef06c3379858 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:35.067074 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1411/2827] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:34:35.071508 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf4b7a-26eb-48a2-8189-a1b555ae58a4 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:35.081489 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf4b7a-26eb-48a2-8189-a1b555ae58a4 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:35.086767 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4b444-028f-4827-a439-5ad52f09539a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:35.087361 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4b444-028f-4827-a439-5ad52f09539a admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:35.088750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4b444-028f-4827-a439-5ad52f09539a admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:35.088750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4b444-028f-4827-a439-5ad52f09539a admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:35.088750 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4b444-028f-4827-a439-5ad52f09539a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:35.090261 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4b444-028f-4827-a439-5ad52f09539a admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:35.101161 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1417/2828] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:34:35.105276 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc234f54-8208-46e8-8703-ef06c3379858 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:35.115261 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc234f54-8208-46e8-8703-ef06c3379858 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:35.119891 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b25609-be9a-4e3a-8da5-ef700a17df24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:35.120534 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b25609-be9a-4e3a-8da5-ef700a17df24 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:35.120818 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b25609-be9a-4e3a-8da5-ef700a17df24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:35.121107 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b25609-be9a-4e3a-8da5-ef700a17df24 admin admin] PATH_INFO: `/v3/projects/c92bd7f6f8564facb08baea370d57b55/users/acacc368d1954823a4b3df95c9faf569/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:35.136316 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b25609-be9a-4e3a-8da5-ef700a17df24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c92bd7f6f8564facb08baea370d57b55, user_id=acacc368d1954823a4b3df95c9faf569, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:35.139016 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b25609-be9a-4e3a-8da5-ef700a17df24 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:35.231309 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1412/2829] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:34:35 2022] PUT /identity/v3/projects/c92bd7f6f8564facb08baea370d57b55/users/acacc368d1954823a4b3df95c9faf569/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:34:35.248854 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055857f-6066-4973-9d58-fd9ffd88a672 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:35.249184 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055857f-6066-4973-9d58-fd9ffd88a672 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:35.249466 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055857f-6066-4973-9d58-fd9ffd88a672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:35.277878 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-5055857f-6066-4973-9d58-fd9ffd88a672 None None] MFA Rules not processed for user `acacc368d1954823a4b3df95c9faf569`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:34:35.279208 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-5055857f-6066-4973-9d58-fd9ffd88a672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:35.307954 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:34:35.342863 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1418/2830] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:34:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:34:35.354702 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b25609-be9a-4e3a-8da5-ef700a17df24 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:35.356520 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-49b25609-be9a-4e3a-8da5-ef700a17df24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:35.430043 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b25609-be9a-4e3a-8da5-ef700a17df24 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:35.435756 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3ea6b-4ee5-4da3-b631-27873ed6fc1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0236a0acac4b87be977878b5186551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:35.436393 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3ea6b-4ee5-4da3-b631-27873ed6fc1e service nova] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:35.436672 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3ea6b-4ee5-4da3-b631-27873ed6fc1e service nova] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:35.436944 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3ea6b-4ee5-4da3-b631-27873ed6fc1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:35.445309 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3ea6b-4ee5-4da3-b631-27873ed6fc1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:35.446958 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3ea6b-4ee5-4da3-b631-27873ed6fc1e service nova] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:35.455524 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1413/2831] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:34:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:34:35.476788 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055857f-6066-4973-9d58-fd9ffd88a672 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:35.478485 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-5055857f-6066-4973-9d58-fd9ffd88a672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:35.536093 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055857f-6066-4973-9d58-fd9ffd88a672 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:35.539741 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142f6d7-b46b-4ff8-a910-d6e30756d707 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:35.540348 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142f6d7-b46b-4ff8-a910-d6e30756d707 service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:35.540632 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142f6d7-b46b-4ff8-a910-d6e30756d707 service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:35.540907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142f6d7-b46b-4ff8-a910-d6e30756d707 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:35.542675 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-3142f6d7-b46b-4ff8-a910-d6e30756d707 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:35.556423 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142f6d7-b46b-4ff8-a910-d6e30756d707 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:35.557887 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142f6d7-b46b-4ff8-a910-d6e30756d707 service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:35.569566 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1419/2832] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:34:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:34:38.626075 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3ea6b-4ee5-4da3-b631-27873ed6fc1e service nova] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:38.684963 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3ea6b-4ee5-4da3-b631-27873ed6fc1e service nova] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:38.689472 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c90674-b5d0-499e-9298-badaaf69fd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:38.690099 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c90674-b5d0-499e-9298-badaaf69fd9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:38.690384 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c90674-b5d0-499e-9298-badaaf69fd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:38.690664 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c90674-b5d0-499e-9298-badaaf69fd9a admin admin] PATH_INFO: `/v3/users/acacc368d1954823a4b3df95c9faf569` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:38.691813 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c90674-b5d0-499e-9298-badaaf69fd9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=acacc368d1954823a4b3df95c9faf569)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:38.693782 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c90674-b5d0-499e-9298-badaaf69fd9a admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:38.882118 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-63c90674-b5d0-499e-9298-badaaf69fd9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acacc368d1954823a4b3df95c9faf569'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:38.882781 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-63c90674-b5d0-499e-9298-badaaf69fd9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acacc368d1954823a4b3df95c9faf569'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:38.883989 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:34:38.890113 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-63c90674-b5d0-499e-9298-badaaf69fd9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acacc368d1954823a4b3df95c9faf569'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:38.890757 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-63c90674-b5d0-499e-9298-badaaf69fd9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acacc368d1954823a4b3df95c9faf569'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:38.902734 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-63c90674-b5d0-499e-9298-badaaf69fd9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acacc368d1954823a4b3df95c9faf569'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:38.966864 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1414/2833] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:34:38 2022] DELETE /identity/v3/users/acacc368d1954823a4b3df95c9faf569 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:34:38.971445 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4146f4d-9717-4fcf-ba59-1f88b682d89c None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:38.971895 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4146f4d-9717-4fcf-ba59-1f88b682d89c None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:38.972027 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4146f4d-9717-4fcf-ba59-1f88b682d89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:38.991533 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-d4146f4d-9717-4fcf-ba59-1f88b682d89c None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:34:38.992766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-d4146f4d-9717-4fcf-ba59-1f88b682d89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:39.050346 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1420/2834] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:34:39.060408 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c90674-b5d0-499e-9298-badaaf69fd9a admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:39.061819 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-63c90674-b5d0-499e-9298-badaaf69fd9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:39.119044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c90674-b5d0-499e-9298-badaaf69fd9a admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:39.122668 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f145495-6dbd-44e2-bd87-220065f1ff62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:39.123302 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f145495-6dbd-44e2-bd87-220065f1ff62 service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:39.123583 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f145495-6dbd-44e2-bd87-220065f1ff62 service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:39.123855 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f145495-6dbd-44e2-bd87-220065f1ff62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:39.132735 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f145495-6dbd-44e2-bd87-220065f1ff62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:39.134208 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f145495-6dbd-44e2-bd87-220065f1ff62 service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:39.143550 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1415/2835] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:34:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:34:39.531288 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4146f4d-9717-4fcf-ba59-1f88b682d89c None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:39.532805 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-d4146f4d-9717-4fcf-ba59-1f88b682d89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:39.545864 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4146f4d-9717-4fcf-ba59-1f88b682d89c None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:39.550870 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242eef2-89e6-4078-9e5d-bdc527a4b723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:39.551606 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242eef2-89e6-4078-9e5d-bdc527a4b723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:39.551893 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242eef2-89e6-4078-9e5d-bdc527a4b723 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:39.552192 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242eef2-89e6-4078-9e5d-bdc527a4b723 admin admin] PATH_INFO: `/v3/projects/c92bd7f6f8564facb08baea370d57b55` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:39.553861 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242eef2-89e6-4078-9e5d-bdc527a4b723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c92bd7f6f8564facb08baea370d57b55)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:39.555804 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242eef2-89e6-4078-9e5d-bdc527a4b723 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:39.812631 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-2242eef2-89e6-4078-9e5d-bdc527a4b723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c92bd7f6f8564facb08baea370d57b55', 'request_id': 'req-2242eef2-89e6-4078-9e5d-bdc527a4b723'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:39.819772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-2242eef2-89e6-4078-9e5d-bdc527a4b723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c92bd7f6f8564facb08baea370d57b55', 'request_id': 'req-2242eef2-89e6-4078-9e5d-bdc527a4b723'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:39.825353 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-2242eef2-89e6-4078-9e5d-bdc527a4b723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c92bd7f6f8564facb08baea370d57b55', 'request_id': 'req-2242eef2-89e6-4078-9e5d-bdc527a4b723'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:39.828968 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:34:39.925127 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-2242eef2-89e6-4078-9e5d-bdc527a4b723 admin admin] The token cache is being invalidate because project c92bd7f6f8564facb08baea370d57b55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:34:39.925428 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-2242eef2-89e6-4078-9e5d-bdc527a4b723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:39.926086 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-2242eef2-89e6-4078-9e5d-bdc527a4b723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:39.927624 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1421/2836] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:34:39 2022] DELETE /identity/v3/projects/c92bd7f6f8564facb08baea370d57b55 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:34:39.933165 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d54d2f-ccc5-4da2-b9e7-da10fce55a8e None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:39.933652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d54d2f-ccc5-4da2-b9e7-da10fce55a8e None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:39.933782 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d54d2f-ccc5-4da2-b9e7-da10fce55a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:39.955511 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-c0d54d2f-ccc5-4da2-b9e7-da10fce55a8e None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:34:39.956753 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-c0d54d2f-ccc5-4da2-b9e7-da10fce55a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:40.017274 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1416/2837] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:34:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:34:40.025323 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d61e20-0443-4bd7-9fae-0928875e9c64 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:40.025794 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d61e20-0443-4bd7-9fae-0928875e9c64 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:40.025903 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d61e20-0443-4bd7-9fae-0928875e9c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:40.046098 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-25d61e20-0443-4bd7-9fae-0928875e9c64 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:34:40.047361 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-25d61e20-0443-4bd7-9fae-0928875e9c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:40.056221 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1422/2838] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:34:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:34:40.060428 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d54d2f-ccc5-4da2-b9e7-da10fce55a8e None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:40.070951 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d54d2f-ccc5-4da2-b9e7-da10fce55a8e None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:40.075526 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48383a2b-1844-4d3f-bef6-f4a26459192a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:40.076194 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48383a2b-1844-4d3f-bef6-f4a26459192a admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:40.076478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48383a2b-1844-4d3f-bef6-f4a26459192a admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:40.076754 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48383a2b-1844-4d3f-bef6-f4a26459192a admin admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:40.077465 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48383a2b-1844-4d3f-bef6-f4a26459192a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:34:40.077771 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48383a2b-1844-4d3f-bef6-f4a26459192a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:40.079388 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48383a2b-1844-4d3f-bef6-f4a26459192a admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:40.090954 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1417/2839] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:34:40.095424 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d61e20-0443-4bd7-9fae-0928875e9c64 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:40.105188 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d61e20-0443-4bd7-9fae-0928875e9c64 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:40.109667 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78abad7-ce58-4b86-8f4f-b3ba322f0cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:40.110300 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78abad7-ce58-4b86-8f4f-b3ba322f0cea admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:40.110579 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78abad7-ce58-4b86-8f4f-b3ba322f0cea admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:40.110850 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78abad7-ce58-4b86-8f4f-b3ba322f0cea admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:40.111478 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78abad7-ce58-4b86-8f4f-b3ba322f0cea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:40.113490 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78abad7-ce58-4b86-8f4f-b3ba322f0cea admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:40.233388 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1423/2840] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:34:40 2022] POST /identity/v3/projects => generated 405 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 04:34:40.237500 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48383a2b-1844-4d3f-bef6-f4a26459192a admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:40.248134 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48383a2b-1844-4d3f-bef6-f4a26459192a admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:40.297042 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:34:40.310611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f792b-0af9-45ad-b7b7-140f029805e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:40.310611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f792b-0af9-45ad-b7b7-140f029805e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:40.310611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f792b-0af9-45ad-b7b7-140f029805e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:40.310611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f792b-0af9-45ad-b7b7-140f029805e7 admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:40.311009 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f792b-0af9-45ad-b7b7-140f029805e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:40.311009 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f792b-0af9-45ad-b7b7-140f029805e7 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:40.408608 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1418/2841] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:34:40 2022] POST /identity/v3/users => generated 303 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:34:40.413288 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78abad7-ce58-4b86-8f4f-b3ba322f0cea admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:40.423557 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78abad7-ce58-4b86-8f4f-b3ba322f0cea admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:40.428151 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf26988-eb7a-49f0-879b-b9f316e28229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:40.429351 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf26988-eb7a-49f0-879b-b9f316e28229 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:40.429633 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf26988-eb7a-49f0-879b-b9f316e28229 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:40.429906 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf26988-eb7a-49f0-879b-b9f316e28229 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:40.430560 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf26988-eb7a-49f0-879b-b9f316e28229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:40.432149 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf26988-eb7a-49f0-879b-b9f316e28229 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:40.442209 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1424/2842] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:34:40.446047 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f792b-0af9-45ad-b7b7-140f029805e7 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:40.455785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f792b-0af9-45ad-b7b7-140f029805e7 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:40.460839 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417874b-417a-41a9-a519-a7246d14bb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:40.463893 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417874b-417a-41a9-a519-a7246d14bb4f admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:40.463893 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417874b-417a-41a9-a519-a7246d14bb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:40.463893 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417874b-417a-41a9-a519-a7246d14bb4f admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:40.463893 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417874b-417a-41a9-a519-a7246d14bb4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:40.464369 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417874b-417a-41a9-a519-a7246d14bb4f admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:40.474637 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1419/2843] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:34:40.479316 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf26988-eb7a-49f0-879b-b9f316e28229 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:40.489559 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf26988-eb7a-49f0-879b-b9f316e28229 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:40.494361 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933f1c9-e88c-428d-a5e8-68d054c165ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:40.495025 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933f1c9-e88c-428d-a5e8-68d054c165ed admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:40.495312 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933f1c9-e88c-428d-a5e8-68d054c165ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:40.495594 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933f1c9-e88c-428d-a5e8-68d054c165ed admin admin] PATH_INFO: `/v3/projects/49b17535a4a64dbf899adbe09f9a314f/users/2cf22ba0136941d58597e9a66d7acf3f/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:40.510484 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933f1c9-e88c-428d-a5e8-68d054c165ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=49b17535a4a64dbf899adbe09f9a314f, user_id=2cf22ba0136941d58597e9a66d7acf3f, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:40.513249 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933f1c9-e88c-428d-a5e8-68d054c165ed admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:40.591876 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1425/2844] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:34:40 2022] PUT /identity/v3/projects/49b17535a4a64dbf899adbe09f9a314f/users/2cf22ba0136941d58597e9a66d7acf3f/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:34:40.596953 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc98ebf-e886-4701-b8f3-98011baa0f36 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:40.597281 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc98ebf-e886-4701-b8f3-98011baa0f36 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:40.597555 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc98ebf-e886-4701-b8f3-98011baa0f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:40.616616 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-acc98ebf-e886-4701-b8f3-98011baa0f36 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:34:40.617844 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-acc98ebf-e886-4701-b8f3-98011baa0f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:40.675098 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1420/2845] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:34:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:34:40.686632 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933f1c9-e88c-428d-a5e8-68d054c165ed admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:40.688444 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-3933f1c9-e88c-428d-a5e8-68d054c165ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:40.745908 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933f1c9-e88c-428d-a5e8-68d054c165ed admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:40.749611 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ae5c9-03b6-40c8-8104-2b7c78e96cf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:40.750217 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ae5c9-03b6-40c8-8104-2b7c78e96cf1 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:40.750499 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ae5c9-03b6-40c8-8104-2b7c78e96cf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:40.750772 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ae5c9-03b6-40c8-8104-2b7c78e96cf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:40.759507 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ae5c9-03b6-40c8-8104-2b7c78e96cf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:40.760933 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ae5c9-03b6-40c8-8104-2b7c78e96cf1 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:40.770220 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1426/2846] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:34:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:34:41.931358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32ba4e-ec05-4de3-afd0-b7e69972b6c6 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:41.931358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32ba4e-ec05-4de3-afd0-b7e69972b6c6 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:41.931358 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32ba4e-ec05-4de3-afd0-b7e69972b6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:41.958940 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-6d32ba4e-ec05-4de3-afd0-b7e69972b6c6 None None] MFA Rules not processed for user `2cf22ba0136941d58597e9a66d7acf3f`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:34:41.961326 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-6d32ba4e-ec05-4de3-afd0-b7e69972b6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:42.029389 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1421/2847] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:34:41 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:34:42.033947 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ae5c9-03b6-40c8-8104-2b7c78e96cf1 service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:42.045018 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ae5c9-03b6-40c8-8104-2b7c78e96cf1 service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:42.049671 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678101b9-9925-41e1-b1d4-12c6fd9fcd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:42.050377 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678101b9-9925-41e1-b1d4-12c6fd9fcd20 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:42.050663 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678101b9-9925-41e1-b1d4-12c6fd9fcd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:42.050941 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678101b9-9925-41e1-b1d4-12c6fd9fcd20 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:42.051619 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678101b9-9925-41e1-b1d4-12c6fd9fcd20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:42.053586 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678101b9-9925-41e1-b1d4-12c6fd9fcd20 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:42.144482 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1427/2848] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:34:42 2022] POST /identity/v3/projects => generated 405 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:34:42.149205 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32ba4e-ec05-4de3-afd0-b7e69972b6c6 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:42.159866 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32ba4e-ec05-4de3-afd0-b7e69972b6c6 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:42.216801 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de34e1-0435-4226-9642-3e35b3726663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:42.217442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de34e1-0435-4226-9642-3e35b3726663 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:42.217726 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de34e1-0435-4226-9642-3e35b3726663 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:42.218001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de34e1-0435-4226-9642-3e35b3726663 admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:42.218632 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de34e1-0435-4226-9642-3e35b3726663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:42.220657 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de34e1-0435-4226-9642-3e35b3726663 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:42.230921 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:34:42.340904 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1422/2849] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:34:42 2022] POST /identity/v3/users => generated 309 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:34:42.344893 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678101b9-9925-41e1-b1d4-12c6fd9fcd20 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:42.355062 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678101b9-9925-41e1-b1d4-12c6fd9fcd20 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:42.359663 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4127ebc-dd9b-4caf-98d4-9c78f2d7c425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:42.360262 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4127ebc-dd9b-4caf-98d4-9c78f2d7c425 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:42.360545 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4127ebc-dd9b-4caf-98d4-9c78f2d7c425 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:42.360820 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4127ebc-dd9b-4caf-98d4-9c78f2d7c425 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:42.361512 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4127ebc-dd9b-4caf-98d4-9c78f2d7c425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:42.363191 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4127ebc-dd9b-4caf-98d4-9c78f2d7c425 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:42.373801 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1428/2850] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:34:42.377905 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de34e1-0435-4226-9642-3e35b3726663 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:42.388270 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de34e1-0435-4226-9642-3e35b3726663 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:42.392827 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348331a3-3d9a-4ade-8fde-3d1f77d8ee97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:42.393518 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348331a3-3d9a-4ade-8fde-3d1f77d8ee97 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:42.393805 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348331a3-3d9a-4ade-8fde-3d1f77d8ee97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:42.394083 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348331a3-3d9a-4ade-8fde-3d1f77d8ee97 admin admin] PATH_INFO: `/v3/projects/c3890177d158432d9292254edb1339bf/users/da89d18024c34d838385b7e00c624524/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:42.409240 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348331a3-3d9a-4ade-8fde-3d1f77d8ee97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3890177d158432d9292254edb1339bf, user_id=da89d18024c34d838385b7e00c624524, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:42.411851 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348331a3-3d9a-4ade-8fde-3d1f77d8ee97 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:42.466042 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1423/2851] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:34:42 2022] PUT /identity/v3/projects/c3890177d158432d9292254edb1339bf/users/da89d18024c34d838385b7e00c624524/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:34:42.470000 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4127ebc-dd9b-4caf-98d4-9c78f2d7c425 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:42.480069 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4127ebc-dd9b-4caf-98d4-9c78f2d7c425 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:42.535743 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e5a22-5fcf-4503-aabe-5528ef537431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:42.536350 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e5a22-5fcf-4503-aabe-5528ef537431 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:42.536629 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e5a22-5fcf-4503-aabe-5528ef537431 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:42.536907 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e5a22-5fcf-4503-aabe-5528ef537431 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:42.537575 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e5a22-5fcf-4503-aabe-5528ef537431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:42.539433 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e5a22-5fcf-4503-aabe-5528ef537431 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:42.541421 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:34:42.549333 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1429/2852] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:34:42.560150 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348331a3-3d9a-4ade-8fde-3d1f77d8ee97 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:42.571031 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348331a3-3d9a-4ade-8fde-3d1f77d8ee97 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:42.575650 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53949c2-774a-4afd-8e53-e9077b8ac07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:42.576441 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53949c2-774a-4afd-8e53-e9077b8ac07e admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:42.576724 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53949c2-774a-4afd-8e53-e9077b8ac07e admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:42.576998 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53949c2-774a-4afd-8e53-e9077b8ac07e admin admin] PATH_INFO: `/v3/projects/c3890177d158432d9292254edb1339bf/users/da89d18024c34d838385b7e00c624524/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:42.578949 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53949c2-774a-4afd-8e53-e9077b8ac07e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3890177d158432d9292254edb1339bf, user_id=da89d18024c34d838385b7e00c624524, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:42.581660 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53949c2-774a-4afd-8e53-e9077b8ac07e admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:42.592714 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1424/2853] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:34:42 2022] PUT /identity/v3/projects/c3890177d158432d9292254edb1339bf/users/da89d18024c34d838385b7e00c624524/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:34:43.847026 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847bf64-9754-4d97-9937-750a5af05b7c None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:43.848058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847bf64-9754-4d97-9937-750a5af05b7c None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:43.848058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847bf64-9754-4d97-9937-750a5af05b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:43.875308 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-8847bf64-9754-4d97-9937-750a5af05b7c None None] MFA Rules not processed for user `da89d18024c34d838385b7e00c624524`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:34:43.876535 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-8847bf64-9754-4d97-9937-750a5af05b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:43.951272 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1430/2854] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:34:43 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:34:45.306818 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53949c2-774a-4afd-8e53-e9077b8ac07e admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:45.370158 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53949c2-774a-4afd-8e53-e9077b8ac07e admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:45.374844 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fcfdd-be16-45c0-b6e5-52363c7f431d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:45.375478 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fcfdd-be16-45c0-b6e5-52363c7f431d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:45.375758 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fcfdd-be16-45c0-b6e5-52363c7f431d admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:45.376028 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fcfdd-be16-45c0-b6e5-52363c7f431d admin admin] PATH_INFO: `/v3/users/2cf22ba0136941d58597e9a66d7acf3f` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:45.377202 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fcfdd-be16-45c0-b6e5-52363c7f431d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cf22ba0136941d58597e9a66d7acf3f)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:45.379183 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fcfdd-be16-45c0-b6e5-52363c7f431d admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:45.582636 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-a97fcfdd-be16-45c0-b6e5-52363c7f431d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cf22ba0136941d58597e9a66d7acf3f'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:45.583252 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-a97fcfdd-be16-45c0-b6e5-52363c7f431d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cf22ba0136941d58597e9a66d7acf3f'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:45.590831 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-a97fcfdd-be16-45c0-b6e5-52363c7f431d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cf22ba0136941d58597e9a66d7acf3f'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:45.591455 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-a97fcfdd-be16-45c0-b6e5-52363c7f431d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cf22ba0136941d58597e9a66d7acf3f'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:45.603426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-a97fcfdd-be16-45c0-b6e5-52363c7f431d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cf22ba0136941d58597e9a66d7acf3f'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:45.686189 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1425/2855] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:34:45 2022] DELETE /identity/v3/users/2cf22ba0136941d58597e9a66d7acf3f => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:34:45.931328 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847bf64-9754-4d97-9937-750a5af05b7c None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:45.942456 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847bf64-9754-4d97-9937-750a5af05b7c None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:46.009764 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02262a-20fd-4f15-8fec-292899bc5f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:46.010402 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02262a-20fd-4f15-8fec-292899bc5f04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:46.010686 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02262a-20fd-4f15-8fec-292899bc5f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:46.010961 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02262a-20fd-4f15-8fec-292899bc5f04 admin admin] PATH_INFO: `/v3/projects/49b17535a4a64dbf899adbe09f9a314f` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:46.012089 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02262a-20fd-4f15-8fec-292899bc5f04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49b17535a4a64dbf899adbe09f9a314f)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:46.014038 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02262a-20fd-4f15-8fec-292899bc5f04 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:46.117871 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-aa02262a-20fd-4f15-8fec-292899bc5f04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49b17535a4a64dbf899adbe09f9a314f', 'request_id': 'req-aa02262a-20fd-4f15-8fec-292899bc5f04'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:46.123978 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-aa02262a-20fd-4f15-8fec-292899bc5f04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49b17535a4a64dbf899adbe09f9a314f', 'request_id': 'req-aa02262a-20fd-4f15-8fec-292899bc5f04'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:46.129449 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-aa02262a-20fd-4f15-8fec-292899bc5f04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49b17535a4a64dbf899adbe09f9a314f', 'request_id': 'req-aa02262a-20fd-4f15-8fec-292899bc5f04'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:46.185529 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-aa02262a-20fd-4f15-8fec-292899bc5f04 admin admin] The token cache is being invalidate because project 49b17535a4a64dbf899adbe09f9a314f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:34:46.185745 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-aa02262a-20fd-4f15-8fec-292899bc5f04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:46.186427 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-aa02262a-20fd-4f15-8fec-292899bc5f04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:46.187919 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1431/2856] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:34:45 2022] DELETE /identity/v3/projects/49b17535a4a64dbf899adbe09f9a314f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:34:46.191947 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fcfdd-be16-45c0-b6e5-52363c7f431d admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:46.193390 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-a97fcfdd-be16-45c0-b6e5-52363c7f431d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:46.206114 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fcfdd-be16-45c0-b6e5-52363c7f431d admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:46.237586 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:34:46.261079 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b98e9f-0e1a-469a-8f37-02033a118113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:46.261732 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b98e9f-0e1a-469a-8f37-02033a118113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:46.262011 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b98e9f-0e1a-469a-8f37-02033a118113 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:46.262282 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b98e9f-0e1a-469a-8f37-02033a118113 admin admin] PATH_INFO: `/v3/users/da89d18024c34d838385b7e00c624524` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:46.263400 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b98e9f-0e1a-469a-8f37-02033a118113 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da89d18024c34d838385b7e00c624524)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:46.265404 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b98e9f-0e1a-469a-8f37-02033a118113 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:46.447752 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-39b98e9f-0e1a-469a-8f37-02033a118113 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da89d18024c34d838385b7e00c624524'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:46.448383 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-39b98e9f-0e1a-469a-8f37-02033a118113 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da89d18024c34d838385b7e00c624524'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:46.455188 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-39b98e9f-0e1a-469a-8f37-02033a118113 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da89d18024c34d838385b7e00c624524'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:46.455952 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-39b98e9f-0e1a-469a-8f37-02033a118113 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da89d18024c34d838385b7e00c624524'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:46.468491 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-39b98e9f-0e1a-469a-8f37-02033a118113 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da89d18024c34d838385b7e00c624524'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:46.543487 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1426/2857] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:34:46 2022] DELETE /identity/v3/users/da89d18024c34d838385b7e00c624524 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:34:46.789966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02262a-20fd-4f15-8fec-292899bc5f04 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:46.791459 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-aa02262a-20fd-4f15-8fec-292899bc5f04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:46.806131 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02262a-20fd-4f15-8fec-292899bc5f04 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:46.816962 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:34:46.864468 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e8157-8c6b-4f08-9d86-d9ed29a6ab76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:46.865121 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e8157-8c6b-4f08-9d86-d9ed29a6ab76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:46.865414 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e8157-8c6b-4f08-9d86-d9ed29a6ab76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:46.865690 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e8157-8c6b-4f08-9d86-d9ed29a6ab76 admin admin] PATH_INFO: `/v3/projects/c3890177d158432d9292254edb1339bf` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:46.866824 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e8157-8c6b-4f08-9d86-d9ed29a6ab76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3890177d158432d9292254edb1339bf)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:46.868806 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e8157-8c6b-4f08-9d86-d9ed29a6ab76 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:46.975752 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b14e8157-8c6b-4f08-9d86-d9ed29a6ab76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3890177d158432d9292254edb1339bf', 'request_id': 'req-b14e8157-8c6b-4f08-9d86-d9ed29a6ab76'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:46.982548 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b14e8157-8c6b-4f08-9d86-d9ed29a6ab76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3890177d158432d9292254edb1339bf', 'request_id': 'req-b14e8157-8c6b-4f08-9d86-d9ed29a6ab76'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:46.987969 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b14e8157-8c6b-4f08-9d86-d9ed29a6ab76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3890177d158432d9292254edb1339bf', 'request_id': 'req-b14e8157-8c6b-4f08-9d86-d9ed29a6ab76'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:47.058824 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b14e8157-8c6b-4f08-9d86-d9ed29a6ab76 admin admin] The token cache is being invalidate because project c3890177d158432d9292254edb1339bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:34:47.059305 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b14e8157-8c6b-4f08-9d86-d9ed29a6ab76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:47.059935 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-b14e8157-8c6b-4f08-9d86-d9ed29a6ab76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:47.061476 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1432/2858] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:34:46 2022] DELETE /identity/v3/projects/c3890177d158432d9292254edb1339bf => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:34:47.067107 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bc85a-aab4-491e-a9e9-3310786229ff None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:47.067489 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bc85a-aab4-491e-a9e9-3310786229ff None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:47.067831 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bc85a-aab4-491e-a9e9-3310786229ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:47.088259 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-4d0bc85a-aab4-491e-a9e9-3310786229ff None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:34:47.089652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-4d0bc85a-aab4-491e-a9e9-3310786229ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:47.147414 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1427/2859] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:34:47.156489 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742463b-0c6b-4449-bb98-b080d0a24fa7 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:47.156781 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742463b-0c6b-4449-bb98-b080d0a24fa7 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:47.157060 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742463b-0c6b-4449-bb98-b080d0a24fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:47.176063 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-f742463b-0c6b-4449-bb98-b080d0a24fa7 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:34:47.177290 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-f742463b-0c6b-4449-bb98-b080d0a24fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:47.185855 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1433/2860] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:34:47.189850 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bc85a-aab4-491e-a9e9-3310786229ff None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:47.200055 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bc85a-aab4-491e-a9e9-3310786229ff None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:47.204548 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce6483-a677-4446-97ed-7041f2227ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:47.205177 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce6483-a677-4446-97ed-7041f2227ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:47.205457 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce6483-a677-4446-97ed-7041f2227ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:47.205728 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce6483-a677-4446-97ed-7041f2227ff9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:47.206374 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce6483-a677-4446-97ed-7041f2227ff9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:34:47.206673 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce6483-a677-4446-97ed-7041f2227ff9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:47.208262 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce6483-a677-4446-97ed-7041f2227ff9 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:47.219533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1428/2861] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:34:47.223549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742463b-0c6b-4449-bb98-b080d0a24fa7 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:47.232557 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742463b-0c6b-4449-bb98-b080d0a24fa7 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:47.237203 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eeeb1d-adf9-4906-abed-865b8056a511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:47.237795 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eeeb1d-adf9-4906-abed-865b8056a511 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:47.238074 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eeeb1d-adf9-4906-abed-865b8056a511 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:47.238349 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eeeb1d-adf9-4906-abed-865b8056a511 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:47.238981 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eeeb1d-adf9-4906-abed-865b8056a511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:47.240922 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eeeb1d-adf9-4906-abed-865b8056a511 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:47.355503 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1434/2862] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:34:47 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:34:47.359642 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce6483-a677-4446-97ed-7041f2227ff9 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:47.370288 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce6483-a677-4446-97ed-7041f2227ff9 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:47.410533 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:34:47.426479 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392522c5-ed45-45b7-9f5f-e80a689b1d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:47.427141 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392522c5-ed45-45b7-9f5f-e80a689b1d27 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:47.427419 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392522c5-ed45-45b7-9f5f-e80a689b1d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:47.427692 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392522c5-ed45-45b7-9f5f-e80a689b1d27 admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:47.428327 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392522c5-ed45-45b7-9f5f-e80a689b1d27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:47.430786 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392522c5-ed45-45b7-9f5f-e80a689b1d27 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:47.531432 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1429/2863] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:34:47 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:34:47.535466 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eeeb1d-adf9-4906-abed-865b8056a511 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:47.546040 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eeeb1d-adf9-4906-abed-865b8056a511 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:47.550636 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f1b6d-7992-4ec6-b797-812ad8b2a2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:47.552459 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f1b6d-7992-4ec6-b797-812ad8b2a2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:47.552459 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f1b6d-7992-4ec6-b797-812ad8b2a2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:47.552459 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f1b6d-7992-4ec6-b797-812ad8b2a2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:47.552459 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f1b6d-7992-4ec6-b797-812ad8b2a2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:47.554122 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f1b6d-7992-4ec6-b797-812ad8b2a2b6 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:47.564860 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1435/2864] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:34:47.568675 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392522c5-ed45-45b7-9f5f-e80a689b1d27 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:47.578786 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392522c5-ed45-45b7-9f5f-e80a689b1d27 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:47.583396 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b34026-5961-4a7d-b645-6abb258e8694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:47.583990 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b34026-5961-4a7d-b645-6abb258e8694 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:47.584270 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b34026-5961-4a7d-b645-6abb258e8694 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:47.584543 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b34026-5961-4a7d-b645-6abb258e8694 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:47.585241 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b34026-5961-4a7d-b645-6abb258e8694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:47.586829 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b34026-5961-4a7d-b645-6abb258e8694 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:47.597442 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1430/2865] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:34:47.601845 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f1b6d-7992-4ec6-b797-812ad8b2a2b6 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:47.611467 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f1b6d-7992-4ec6-b797-812ad8b2a2b6 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:47.615909 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9326dd9-5ad7-46e7-a08b-0a617db23816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:47.616549 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9326dd9-5ad7-46e7-a08b-0a617db23816 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:47.616828 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9326dd9-5ad7-46e7-a08b-0a617db23816 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:47.617177 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9326dd9-5ad7-46e7-a08b-0a617db23816 admin admin] PATH_INFO: `/v3/projects/b3e8640f9bd349be83b39d9824e6f3fe/users/1de4026293414b138ba87935415f4706/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:47.631805 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9326dd9-5ad7-46e7-a08b-0a617db23816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3e8640f9bd349be83b39d9824e6f3fe, user_id=1de4026293414b138ba87935415f4706, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:47.634515 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9326dd9-5ad7-46e7-a08b-0a617db23816 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:47.708361 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1436/2866] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:34:47 2022] PUT /identity/v3/projects/b3e8640f9bd349be83b39d9824e6f3fe/users/1de4026293414b138ba87935415f4706/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 04:34:47.718617 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae910d5-7069-4c03-9e21-a593e363edbc None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:47.718905 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae910d5-7069-4c03-9e21-a593e363edbc None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:47.719175 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae910d5-7069-4c03-9e21-a593e363edbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:47.746914 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-7ae910d5-7069-4c03-9e21-a593e363edbc None None] MFA Rules not processed for user `1de4026293414b138ba87935415f4706`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:34:47.748109 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-7ae910d5-7069-4c03-9e21-a593e363edbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:47.810166 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1431/2867] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:34:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:34:47.820880 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9326dd9-5ad7-46e7-a08b-0a617db23816 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:47.822625 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-a9326dd9-5ad7-46e7-a08b-0a617db23816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:47.865557 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:34:47.879810 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9326dd9-5ad7-46e7-a08b-0a617db23816 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:47.883395 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90184615-2bd5-4b0a-b1ef-970a14b768da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:47.883992 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90184615-2bd5-4b0a-b1ef-970a14b768da service cinder] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:47.884272 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90184615-2bd5-4b0a-b1ef-970a14b768da service cinder] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:47.884544 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90184615-2bd5-4b0a-b1ef-970a14b768da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:47.892487 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90184615-2bd5-4b0a-b1ef-970a14b768da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:47.893932 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90184615-2bd5-4b0a-b1ef-970a14b768da service cinder] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:47.903926 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1437/2868] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:34:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:34:54.541418 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae910d5-7069-4c03-9e21-a593e363edbc None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:54.602238 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae910d5-7069-4c03-9e21-a593e363edbc None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:54.607461 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633602e2-f333-44a4-afe8-9a69384f5602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:54.608095 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633602e2-f333-44a4-afe8-9a69384f5602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:54.608377 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633602e2-f333-44a4-afe8-9a69384f5602 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:54.608652 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633602e2-f333-44a4-afe8-9a69384f5602 admin admin] PATH_INFO: `/v3/users/1de4026293414b138ba87935415f4706` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:54.609799 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633602e2-f333-44a4-afe8-9a69384f5602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1de4026293414b138ba87935415f4706)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:54.611782 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633602e2-f333-44a4-afe8-9a69384f5602 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:54.807378 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-633602e2-f333-44a4-afe8-9a69384f5602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1de4026293414b138ba87935415f4706'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:54.807960 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-633602e2-f333-44a4-afe8-9a69384f5602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1de4026293414b138ba87935415f4706'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:54.812785 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:34:54.815704 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-633602e2-f333-44a4-afe8-9a69384f5602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1de4026293414b138ba87935415f4706'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:54.816340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-633602e2-f333-44a4-afe8-9a69384f5602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1de4026293414b138ba87935415f4706'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:54.828098 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-633602e2-f333-44a4-afe8-9a69384f5602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1de4026293414b138ba87935415f4706'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:54.907920 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1432/2869] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:34:54 2022] DELETE /identity/v3/users/1de4026293414b138ba87935415f4706 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:34:54.912309 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadf405-cba2-4ede-88a1-cd5c3df0dcf0 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:54.912763 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadf405-cba2-4ede-88a1-cd5c3df0dcf0 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:54.912932 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadf405-cba2-4ede-88a1-cd5c3df0dcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:54.932111 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-8fadf405-cba2-4ede-88a1-cd5c3df0dcf0 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:34:54.933320 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-8fadf405-cba2-4ede-88a1-cd5c3df0dcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:54.992018 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1438/2870] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:34:55.001742 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633602e2-f333-44a4-afe8-9a69384f5602 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:55.003151 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-633602e2-f333-44a4-afe8-9a69384f5602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:55.061038 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633602e2-f333-44a4-afe8-9a69384f5602 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:55.064636 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35408a2d-f3fb-4a9f-b118-18aa82214a11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:55.065280 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35408a2d-f3fb-4a9f-b118-18aa82214a11 service neutron] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:55.065565 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35408a2d-f3fb-4a9f-b118-18aa82214a11 service neutron] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:55.065837 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35408a2d-f3fb-4a9f-b118-18aa82214a11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:55.075325 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35408a2d-f3fb-4a9f-b118-18aa82214a11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:55.076796 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35408a2d-f3fb-4a9f-b118-18aa82214a11 service neutron] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:55.086337 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1433/2871] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:34:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:34:55.475529 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadf405-cba2-4ede-88a1-cd5c3df0dcf0 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:55.476944 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-8fadf405-cba2-4ede-88a1-cd5c3df0dcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:55.491049 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadf405-cba2-4ede-88a1-cd5c3df0dcf0 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:55.496551 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01feb191-d8e7-46a7-90d1-25504f72596d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:55.497235 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01feb191-d8e7-46a7-90d1-25504f72596d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:55.497525 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01feb191-d8e7-46a7-90d1-25504f72596d admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:55.497794 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01feb191-d8e7-46a7-90d1-25504f72596d admin admin] PATH_INFO: `/v3/projects/b3e8640f9bd349be83b39d9824e6f3fe` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:55.499627 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01feb191-d8e7-46a7-90d1-25504f72596d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3e8640f9bd349be83b39d9824e6f3fe)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:55.501115 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01feb191-d8e7-46a7-90d1-25504f72596d admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:55.593977 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-01feb191-d8e7-46a7-90d1-25504f72596d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3e8640f9bd349be83b39d9824e6f3fe', 'request_id': 'req-01feb191-d8e7-46a7-90d1-25504f72596d'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:55.600056 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-01feb191-d8e7-46a7-90d1-25504f72596d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3e8640f9bd349be83b39d9824e6f3fe', 'request_id': 'req-01feb191-d8e7-46a7-90d1-25504f72596d'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:55.606175 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-01feb191-d8e7-46a7-90d1-25504f72596d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3e8640f9bd349be83b39d9824e6f3fe', 'request_id': 'req-01feb191-d8e7-46a7-90d1-25504f72596d'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:55.670218 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-01feb191-d8e7-46a7-90d1-25504f72596d admin admin] The token cache is being invalidate because project b3e8640f9bd349be83b39d9824e6f3fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:34:55.670504 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-01feb191-d8e7-46a7-90d1-25504f72596d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:55.671144 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-01feb191-d8e7-46a7-90d1-25504f72596d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:34:55.672679 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1439/2872] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:34:55 2022] DELETE /identity/v3/projects/b3e8640f9bd349be83b39d9824e6f3fe => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:34:55.680316 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5673b-6ac1-4b20-9613-4dd57d3f6305 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:55.680794 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5673b-6ac1-4b20-9613-4dd57d3f6305 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:55.680908 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5673b-6ac1-4b20-9613-4dd57d3f6305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:55.703050 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-8fd5673b-6ac1-4b20-9613-4dd57d3f6305 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:34:55.704244 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-8fd5673b-6ac1-4b20-9613-4dd57d3f6305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:55.884039 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1434/2873] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:34:55.892268 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467776ac-a77a-4d26-a346-8c8004b4b38d None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:55.892583 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467776ac-a77a-4d26-a346-8c8004b4b38d None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:55.892862 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467776ac-a77a-4d26-a346-8c8004b4b38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:55.912565 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-467776ac-a77a-4d26-a346-8c8004b4b38d None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:34:55.913809 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-467776ac-a77a-4d26-a346-8c8004b4b38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:55.922010 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1440/2874] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:34:55.926186 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5673b-6ac1-4b20-9613-4dd57d3f6305 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:55.936002 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5673b-6ac1-4b20-9613-4dd57d3f6305 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:55.940451 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff139f6-dd6d-4194-b72e-795d0b5860d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:55.941047 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff139f6-dd6d-4194-b72e-795d0b5860d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:55.941366 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff139f6-dd6d-4194-b72e-795d0b5860d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:55.941639 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff139f6-dd6d-4194-b72e-795d0b5860d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:55.942282 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff139f6-dd6d-4194-b72e-795d0b5860d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:34:55.942584 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff139f6-dd6d-4194-b72e-795d0b5860d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:55.944190 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff139f6-dd6d-4194-b72e-795d0b5860d7 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:55.956436 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1435/2875] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:34:55.960732 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467776ac-a77a-4d26-a346-8c8004b4b38d None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:55.970606 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467776ac-a77a-4d26-a346-8c8004b4b38d None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:55.975157 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0c024-231d-42a4-8906-53e0c8213b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:55.975748 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0c024-231d-42a4-8906-53e0c8213b07 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:55.976029 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0c024-231d-42a4-8906-53e0c8213b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:55.976304 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0c024-231d-42a4-8906-53e0c8213b07 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:55.976939 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0c024-231d-42a4-8906-53e0c8213b07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:55.978860 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0c024-231d-42a4-8906-53e0c8213b07 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:56.085322 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1441/2876] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:34:55 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:34:56.088873 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff139f6-dd6d-4194-b72e-795d0b5860d7 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:56.098936 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff139f6-dd6d-4194-b72e-795d0b5860d7 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:56.154336 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d25377-29fd-40f8-8a85-e81f65996829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:56.154873 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d25377-29fd-40f8-8a85-e81f65996829 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:56.155148 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d25377-29fd-40f8-8a85-e81f65996829 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:56.155415 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d25377-29fd-40f8-8a85-e81f65996829 admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:56.156037 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d25377-29fd-40f8-8a85-e81f65996829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:56.158014 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d25377-29fd-40f8-8a85-e81f65996829 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:56.165576 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:34:56.254307 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1436/2877] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:34:56 2022] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:34:56.258721 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0c024-231d-42a4-8906-53e0c8213b07 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:56.269905 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0c024-231d-42a4-8906-53e0c8213b07 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:56.274679 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596643d7-5e21-4744-a189-de3178431c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:56.275339 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596643d7-5e21-4744-a189-de3178431c76 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:56.275677 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596643d7-5e21-4744-a189-de3178431c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:56.276011 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596643d7-5e21-4744-a189-de3178431c76 admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:56.276662 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596643d7-5e21-4744-a189-de3178431c76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:56.278297 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596643d7-5e21-4744-a189-de3178431c76 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:56.288460 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1442/2878] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:34:56.292515 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d25377-29fd-40f8-8a85-e81f65996829 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:56.302581 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d25377-29fd-40f8-8a85-e81f65996829 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:56.307532 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e92581-e8ba-4cc6-90a2-66a428000cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:56.308122 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e92581-e8ba-4cc6-90a2-66a428000cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:56.308398 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e92581-e8ba-4cc6-90a2-66a428000cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:56.308669 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e92581-e8ba-4cc6-90a2-66a428000cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:56.309606 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e92581-e8ba-4cc6-90a2-66a428000cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:56.311188 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e92581-e8ba-4cc6-90a2-66a428000cf6 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:56.321214 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1437/2879] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:34:56.326086 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596643d7-5e21-4744-a189-de3178431c76 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:56.336096 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596643d7-5e21-4744-a189-de3178431c76 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:56.340757 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac1839-d433-4df8-b6bd-6a6ae35ee370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:56.341443 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac1839-d433-4df8-b6bd-6a6ae35ee370 admin admin] REQUEST_METHOD: `PUT` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:56.341729 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac1839-d433-4df8-b6bd-6a6ae35ee370 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:56.342012 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac1839-d433-4df8-b6bd-6a6ae35ee370 admin admin] PATH_INFO: `/v3/projects/2f76a2d1605545f9825d9413b1371b4e/users/a9153a8effde4707a5d9a453bf07d2f3/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:56.356542 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac1839-d433-4df8-b6bd-6a6ae35ee370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f76a2d1605545f9825d9413b1371b4e, user_id=a9153a8effde4707a5d9a453bf07d2f3, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:56.359258 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac1839-d433-4df8-b6bd-6a6ae35ee370 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:56.437897 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1443/2880] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:34:56 2022] PUT /identity/v3/projects/2f76a2d1605545f9825d9413b1371b4e/users/a9153a8effde4707a5d9a453bf07d2f3/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:34:56.506743 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f411fc5-cfe1-45b2-befe-0119145462fb None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:56.507091 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f411fc5-cfe1-45b2-befe-0119145462fb None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:56.507374 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f411fc5-cfe1-45b2-befe-0119145462fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:56.534757 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-3f411fc5-cfe1-45b2-befe-0119145462fb None None] MFA Rules not processed for user `a9153a8effde4707a5d9a453bf07d2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:34:56.536651 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-3f411fc5-cfe1-45b2-befe-0119145462fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:56.599766 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1438/2881] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:34:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:34:56.604766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac1839-d433-4df8-b6bd-6a6ae35ee370 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:56.609162 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:34:56.667416 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac1839-d433-4df8-b6bd-6a6ae35ee370 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:56.672658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59d3c9-f0a9-44e1-82b1-e1bb3ae925b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:56.673295 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59d3c9-f0a9-44e1-82b1-e1bb3ae925b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:56.673578 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59d3c9-f0a9-44e1-82b1-e1bb3ae925b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:56.673850 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59d3c9-f0a9-44e1-82b1-e1bb3ae925b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:56.674477 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59d3c9-f0a9-44e1-82b1-e1bb3ae925b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:56.676367 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59d3c9-f0a9-44e1-82b1-e1bb3ae925b6 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:56.754906 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1444/2882] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:34:56 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:34:56.758893 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f411fc5-cfe1-45b2-befe-0119145462fb None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:56.769667 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f411fc5-cfe1-45b2-befe-0119145462fb None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:56.826246 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8f2e8-10df-4f4b-a8a4-c9f1e4c813a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:56.826879 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8f2e8-10df-4f4b-a8a4-c9f1e4c813a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:56.827158 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8f2e8-10df-4f4b-a8a4-c9f1e4c813a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:56.827426 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8f2e8-10df-4f4b-a8a4-c9f1e4c813a8 admin admin] PATH_INFO: `/v3/users` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:56.828051 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8f2e8-10df-4f4b-a8a4-c9f1e4c813a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:56.830065 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8f2e8-10df-4f4b-a8a4-c9f1e4c813a8 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:56.908993 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1439/2883] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:34:56 2022] POST /identity/v3/users => generated 294 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:34:56.910397 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59d3c9-f0a9-44e1-82b1-e1bb3ae925b6 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:56.921955 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59d3c9-f0a9-44e1-82b1-e1bb3ae925b6 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:56.926798 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab1e83-631f-461b-baef-9b81364c044f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:56.927451 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab1e83-631f-461b-baef-9b81364c044f admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:56.927766 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab1e83-631f-461b-baef-9b81364c044f admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:56.928042 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab1e83-631f-461b-baef-9b81364c044f admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:56.928696 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab1e83-631f-461b-baef-9b81364c044f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:56.930340 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab1e83-631f-461b-baef-9b81364c044f admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:56.941422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1445/2884] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:34:56.945656 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8f2e8-10df-4f4b-a8a4-c9f1e4c813a8 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:56.955837 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8f2e8-10df-4f4b-a8a4-c9f1e4c813a8 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:56.960563 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0dbc7-2962-4ae6-b952-2f91ef947bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:56.961291 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0dbc7-2962-4ae6-b952-2f91ef947bd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:56.961573 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0dbc7-2962-4ae6-b952-2f91ef947bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:56.961848 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0dbc7-2962-4ae6-b952-2f91ef947bd3 admin admin] PATH_INFO: `/v3/projects/69dfef0a9a574197a8495cc533ccef08/users/39a5316c48bd4ada982552048a1d4067/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:56.977753 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da0dbc7-2962-4ae6-b952-2f91ef947bd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69dfef0a9a574197a8495cc533ccef08, user_id=39a5316c48bd4ada982552048a1d4067, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:56.981028 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da0dbc7-2962-4ae6-b952-2f91ef947bd3 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:57.057044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1440/2885] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:34:56 2022] PUT /identity/v3/projects/69dfef0a9a574197a8495cc533ccef08/users/39a5316c48bd4ada982552048a1d4067/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:34:57.061258 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab1e83-631f-461b-baef-9b81364c044f admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:57.071413 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab1e83-631f-461b-baef-9b81364c044f admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:57.128156 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded9a9d-9cd7-4e48-9026-00d16c89052c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:57.128762 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded9a9d-9cd7-4e48-9026-00d16c89052c admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:57.129044 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded9a9d-9cd7-4e48-9026-00d16c89052c admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:57.129356 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded9a9d-9cd7-4e48-9026-00d16c89052c admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:57.130000 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded9a9d-9cd7-4e48-9026-00d16c89052c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:57.131582 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded9a9d-9cd7-4e48-9026-00d16c89052c admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:57.141104 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1446/2886] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:34:57.145206 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0dbc7-2962-4ae6-b952-2f91ef947bd3 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:57.155848 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0dbc7-2962-4ae6-b952-2f91ef947bd3 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:57.160381 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651274e-0c8e-495f-9582-527e97b6e6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:57.161029 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651274e-0c8e-495f-9582-527e97b6e6ee admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:57.161340 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651274e-0c8e-495f-9582-527e97b6e6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:57.161615 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651274e-0c8e-495f-9582-527e97b6e6ee admin admin] PATH_INFO: `/v3/projects/69dfef0a9a574197a8495cc533ccef08/users/39a5316c48bd4ada982552048a1d4067/roles/255d9e4004c54505a7cda1b8af74e5f1` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:57.163526 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651274e-0c8e-495f-9582-527e97b6e6ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=69dfef0a9a574197a8495cc533ccef08, user_id=39a5316c48bd4ada982552048a1d4067, role_id=255d9e4004c54505a7cda1b8af74e5f1)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:57.166814 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651274e-0c8e-495f-9582-527e97b6e6ee admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:57.176924 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1441/2887] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:34:57 2022] PUT /identity/v3/projects/69dfef0a9a574197a8495cc533ccef08/users/39a5316c48bd4ada982552048a1d4067/roles/255d9e4004c54505a7cda1b8af74e5f1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:34:57.186974 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ab7c0-0f06-44bb-aefa-07804dc8f7e5 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:57.187266 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ab7c0-0f06-44bb-aefa-07804dc8f7e5 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:57.187573 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ab7c0-0f06-44bb-aefa-07804dc8f7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:57.215671 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-105ab7c0-0f06-44bb-aefa-07804dc8f7e5 None None] MFA Rules not processed for user `39a5316c48bd4ada982552048a1d4067`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:34:57.216878 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-105ab7c0-0f06-44bb-aefa-07804dc8f7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:57.278169 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:34:57.283304 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1447/2888] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:34:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:34:57.294016 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651274e-0c8e-495f-9582-527e97b6e6ee admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:34:57.295710 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-2651274e-0c8e-495f-9582-527e97b6e6ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:34:57.323965 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:34:57.353474 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651274e-0c8e-495f-9582-527e97b6e6ee admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:34:57.357016 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374a564-eff5-411f-b1da-0a4d2ccd0330 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:34:57.357650 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374a564-eff5-411f-b1da-0a4d2ccd0330 service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:34:57.357923 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374a564-eff5-411f-b1da-0a4d2ccd0330 service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:34:57.358191 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374a564-eff5-411f-b1da-0a4d2ccd0330 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:34:57.414731 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374a564-eff5-411f-b1da-0a4d2ccd0330 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:34:57.416236 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374a564-eff5-411f-b1da-0a4d2ccd0330 service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:34:57.425127 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1442/2889] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:34:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:35:00.472993 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ab7c0-0f06-44bb-aefa-07804dc8f7e5 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:35:00.536036 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ab7c0-0f06-44bb-aefa-07804dc8f7e5 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:35:00.540479 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e23f5-6759-4e96-b16f-0062cc2bab67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:35:00.541131 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e23f5-6759-4e96-b16f-0062cc2bab67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:35:00.541417 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e23f5-6759-4e96-b16f-0062cc2bab67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:35:00.541696 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e23f5-6759-4e96-b16f-0062cc2bab67 admin admin] PATH_INFO: `/v3/users/a9153a8effde4707a5d9a453bf07d2f3` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:35:00.542839 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e23f5-6759-4e96-b16f-0062cc2bab67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9153a8effde4707a5d9a453bf07d2f3)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:35:00.544756 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e23f5-6759-4e96-b16f-0062cc2bab67 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:35:00.758520 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-072e23f5-6759-4e96-b16f-0062cc2bab67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9153a8effde4707a5d9a453bf07d2f3'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:35:00.842434 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-072e23f5-6759-4e96-b16f-0062cc2bab67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9153a8effde4707a5d9a453bf07d2f3'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:35:00.849475 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-072e23f5-6759-4e96-b16f-0062cc2bab67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9153a8effde4707a5d9a453bf07d2f3'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:35:00.861457 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-072e23f5-6759-4e96-b16f-0062cc2bab67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9153a8effde4707a5d9a453bf07d2f3'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:35:00.862197 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-072e23f5-6759-4e96-b16f-0062cc2bab67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9153a8effde4707a5d9a453bf07d2f3'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:35:00.868129 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1448/2890] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:35:00 2022] DELETE /identity/v3/users/a9153a8effde4707a5d9a453bf07d2f3 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:35:00.873278 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70fb51-f06e-47d4-a51f-ca50fc11b609 None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:35:00.873745 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70fb51-f06e-47d4-a51f-ca50fc11b609 None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:35:00.873865 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70fb51-f06e-47d4-a51f-ca50fc11b609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:35:00.893775 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-4a70fb51-f06e-47d4-a51f-ca50fc11b609 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:35:00.895044 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-4a70fb51-f06e-47d4-a51f-ca50fc11b609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:35:00.954767 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1443/2891] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:35:00.964427 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e23f5-6759-4e96-b16f-0062cc2bab67 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:35:00.965973 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-072e23f5-6759-4e96-b16f-0062cc2bab67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:35:01.023363 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e23f5-6759-4e96-b16f-0062cc2bab67 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:35:01.027014 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb74f8b-d1fa-461d-8a98-c33563c3aeb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:35:01.029924 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb74f8b-d1fa-461d-8a98-c33563c3aeb4 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:35:01.029924 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb74f8b-d1fa-461d-8a98-c33563c3aeb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:35:01.029924 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb74f8b-d1fa-461d-8a98-c33563c3aeb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:35:01.037311 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb74f8b-d1fa-461d-8a98-c33563c3aeb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:35:01.038745 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb74f8b-d1fa-461d-8a98-c33563c3aeb4 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:35:01.048694 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1449/2892] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:35:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:35:01.435561 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70fb51-f06e-47d4-a51f-ca50fc11b609 None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:35:01.437048 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-4a70fb51-f06e-47d4-a51f-ca50fc11b609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:35:01.449462 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70fb51-f06e-47d4-a51f-ca50fc11b609 None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:35:01.454611 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade7874-aa74-4884-9638-cb30f4026b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:35:01.455291 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade7874-aa74-4884-9638-cb30f4026b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:35:01.455573 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade7874-aa74-4884-9638-cb30f4026b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:35:01.455848 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade7874-aa74-4884-9638-cb30f4026b55 admin admin] PATH_INFO: `/v3/projects/2f76a2d1605545f9825d9413b1371b4e` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:35:01.457059 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade7874-aa74-4884-9638-cb30f4026b55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f76a2d1605545f9825d9413b1371b4e)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:35:01.459006 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade7874-aa74-4884-9638-cb30f4026b55 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:35:01.574398 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-7ade7874-aa74-4884-9638-cb30f4026b55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f76a2d1605545f9825d9413b1371b4e', 'request_id': 'req-7ade7874-aa74-4884-9638-cb30f4026b55'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:35:01.580577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-7ade7874-aa74-4884-9638-cb30f4026b55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f76a2d1605545f9825d9413b1371b4e', 'request_id': 'req-7ade7874-aa74-4884-9638-cb30f4026b55'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:35:01.586320 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-7ade7874-aa74-4884-9638-cb30f4026b55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f76a2d1605545f9825d9413b1371b4e', 'request_id': 'req-7ade7874-aa74-4884-9638-cb30f4026b55'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:35:01.654893 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:35:01.659508 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-7ade7874-aa74-4884-9638-cb30f4026b55 admin admin] The token cache is being invalidate because project 2f76a2d1605545f9825d9413b1371b4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:35:01.659802 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-7ade7874-aa74-4884-9638-cb30f4026b55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:35:01.660415 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-7ade7874-aa74-4884-9638-cb30f4026b55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:35:01.661937 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1444/2893] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:35:01 2022] DELETE /identity/v3/projects/2f76a2d1605545f9825d9413b1371b4e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:35:01.666003 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb74f8b-d1fa-461d-8a98-c33563c3aeb4 service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:35:01.676181 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb74f8b-d1fa-461d-8a98-c33563c3aeb4 service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:35:01.693076 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:35:01.732331 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f9b89-abdf-4a67-9155-b439471e29cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:35:01.732959 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f9b89-abdf-4a67-9155-b439471e29cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:35:01.733270 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f9b89-abdf-4a67-9155-b439471e29cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:35:01.733543 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f9b89-abdf-4a67-9155-b439471e29cb admin admin] PATH_INFO: `/v3/users/39a5316c48bd4ada982552048a1d4067` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:35:01.734660 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f9b89-abdf-4a67-9155-b439471e29cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=39a5316c48bd4ada982552048a1d4067)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:35:01.736569 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f9b89-abdf-4a67-9155-b439471e29cb admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:35:01.907914 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-551f9b89-abdf-4a67-9155-b439471e29cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39a5316c48bd4ada982552048a1d4067'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:35:01.991392 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-551f9b89-abdf-4a67-9155-b439471e29cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39a5316c48bd4ada982552048a1d4067'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:35:01.998831 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-551f9b89-abdf-4a67-9155-b439471e29cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39a5316c48bd4ada982552048a1d4067'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:35:02.010303 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-551f9b89-abdf-4a67-9155-b439471e29cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39a5316c48bd4ada982552048a1d4067'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:35:02.011494 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-551f9b89-abdf-4a67-9155-b439471e29cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39a5316c48bd4ada982552048a1d4067'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:35:02.017248 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1450/2894] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:35:01 2022] DELETE /identity/v3/users/39a5316c48bd4ada982552048a1d4067 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:35:02.416402 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade7874-aa74-4884-9638-cb30f4026b55 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:35:02.418559 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-7ade7874-aa74-4884-9638-cb30f4026b55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:35:02.431854 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade7874-aa74-4884-9638-cb30f4026b55 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:35:02.488124 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b5fe3-a5ec-4228-af17-6dadf3c05184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:35:02.488762 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b5fe3-a5ec-4228-af17-6dadf3c05184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:35:02.489042 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b5fe3-a5ec-4228-af17-6dadf3c05184 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:35:02.489339 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b5fe3-a5ec-4228-af17-6dadf3c05184 admin admin] PATH_INFO: `/v3/projects/69dfef0a9a574197a8495cc533ccef08` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:35:02.490449 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b5fe3-a5ec-4228-af17-6dadf3c05184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69dfef0a9a574197a8495cc533ccef08)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:35:02.492356 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b5fe3-a5ec-4228-af17-6dadf3c05184 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:35:02.603070 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-ea3b5fe3-a5ec-4228-af17-6dadf3c05184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69dfef0a9a574197a8495cc533ccef08', 'request_id': 'req-ea3b5fe3-a5ec-4228-af17-6dadf3c05184'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:35:02.609847 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-ea3b5fe3-a5ec-4228-af17-6dadf3c05184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69dfef0a9a574197a8495cc533ccef08', 'request_id': 'req-ea3b5fe3-a5ec-4228-af17-6dadf3c05184'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:35:02.615489 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-ea3b5fe3-a5ec-4228-af17-6dadf3c05184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69dfef0a9a574197a8495cc533ccef08', 'request_id': 'req-ea3b5fe3-a5ec-4228-af17-6dadf3c05184'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:35:02.710181 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-ea3b5fe3-a5ec-4228-af17-6dadf3c05184 admin admin] The token cache is being invalidate because project 69dfef0a9a574197a8495cc533ccef08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:35:02.710403 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-ea3b5fe3-a5ec-4228-af17-6dadf3c05184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:35:02.711013 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-ea3b5fe3-a5ec-4228-af17-6dadf3c05184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:35:02.712476 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1445/2895] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:35:02 2022] DELETE /identity/v3/projects/69dfef0a9a574197a8495cc533ccef08 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:35:02.717530 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549f15e-df97-4bdb-b7b1-b37b97ce9d61 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:35:02.717995 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549f15e-df97-4bdb-b7b1-b37b97ce9d61 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:35:02.718097 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549f15e-df97-4bdb-b7b1-b37b97ce9d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:35:02.737817 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-4549f15e-df97-4bdb-b7b1-b37b97ce9d61 None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:35:02.739063 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-4549f15e-df97-4bdb-b7b1-b37b97ce9d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:35:02.799191 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1451/2896] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:35:02.806713 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9e594-cdfd-4634-a7a7-bfde41e0404a None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:35:02.807001 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9e594-cdfd-4634-a7a7-bfde41e0404a None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:35:02.807277 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9e594-cdfd-4634-a7a7-bfde41e0404a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:35:02.826388 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-dbd9e594-cdfd-4634-a7a7-bfde41e0404a None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:35:02.827596 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-dbd9e594-cdfd-4634-a7a7-bfde41e0404a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:35:02.835291 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1446/2897] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:35:02.839662 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549f15e-df97-4bdb-b7b1-b37b97ce9d61 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:35:02.849181 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549f15e-df97-4bdb-b7b1-b37b97ce9d61 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:35:02.853678 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f665d7-ddfc-440d-bed5-4273a97e0fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:35:02.854275 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f665d7-ddfc-440d-bed5-4273a97e0fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:35:02.855099 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f665d7-ddfc-440d-bed5-4273a97e0fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:35:02.855376 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f665d7-ddfc-440d-bed5-4273a97e0fa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:35:02.856026 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f665d7-ddfc-440d-bed5-4273a97e0fa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 04:35:02.856334 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f665d7-ddfc-440d-bed5-4273a97e0fa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:35:02.857961 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f665d7-ddfc-440d-bed5-4273a97e0fa5 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:35:02.869284 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1452/2898] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 23 04:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 04:35:02.873249 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9e594-cdfd-4634-a7a7-bfde41e0404a None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:35:02.882164 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9e594-cdfd-4634-a7a7-bfde41e0404a None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:35:02.886709 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b1dec-cd00-4afa-906e-69bcb03d412a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:35:02.887297 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b1dec-cd00-4afa-906e-69bcb03d412a admin admin] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:35:02.887604 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b1dec-cd00-4afa-906e-69bcb03d412a admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:35:02.887876 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b1dec-cd00-4afa-906e-69bcb03d412a admin admin] PATH_INFO: `/v3/projects` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:35:02.888487 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b1dec-cd00-4afa-906e-69bcb03d412a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:35:02.890422 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b1dec-cd00-4afa-906e-69bcb03d412a admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:35:02.971651 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1447/2899] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 23 04:35:02 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:35:02.975412 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f665d7-ddfc-440d-bed5-4273a97e0fa5 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:35:02.986237 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f665d7-ddfc-440d-bed5-4273a97e0fa5 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:35:03.011449 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:35:03.043466 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b09f9f-8b2d-4a67-900f-a639cc526dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:35:03.044069 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b09f9f-8b2d-4a67-900f-a639cc526dbe admin admin] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:35:03.044351 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b09f9f-8b2d-4a67-900f-a639cc526dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:35:03.044621 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b09f9f-8b2d-4a67-900f-a639cc526dbe admin admin] PATH_INFO: `/v3/users` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:35:03.045283 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b09f9f-8b2d-4a67-900f-a639cc526dbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:35:03.047289 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b09f9f-8b2d-4a67-900f-a639cc526dbe admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:35:03.174816 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1453/2900] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 23 04:35:02 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 04:35:03.179217 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b1dec-cd00-4afa-906e-69bcb03d412a admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:35:03.189635 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b1dec-cd00-4afa-906e-69bcb03d412a admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:35:03.194101 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488c28c-8c11-4f32-8937-635341a95348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:35:03.194707 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488c28c-8c11-4f32-8937-635341a95348 admin admin] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:35:03.194984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488c28c-8c11-4f32-8937-635341a95348 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:35:03.195255 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488c28c-8c11-4f32-8937-635341a95348 admin admin] PATH_INFO: `/v3/roles` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:35:03.195896 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c488c28c-8c11-4f32-8937-635341a95348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:35:03.197541 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c488c28c-8c11-4f32-8937-635341a95348 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:35:03.207719 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1448/2901] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 04:35:03.211422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b09f9f-8b2d-4a67-900f-a639cc526dbe admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:35:03.221956 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b09f9f-8b2d-4a67-900f-a639cc526dbe admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:35:03.226388 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2ece2-ac12-4991-8d4c-fee92ee5f7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:35:03.227058 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2ece2-ac12-4991-8d4c-fee92ee5f7cb admin admin] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:35:03.227339 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2ece2-ac12-4991-8d4c-fee92ee5f7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:35:03.227612 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2ece2-ac12-4991-8d4c-fee92ee5f7cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:35:03.228251 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2ece2-ac12-4991-8d4c-fee92ee5f7cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:35:03.229872 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2ece2-ac12-4991-8d4c-fee92ee5f7cb admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:35:03.240290 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1454/2902] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 23 04:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 04:35:03.244178 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488c28c-8c11-4f32-8937-635341a95348 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:35:03.254019 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488c28c-8c11-4f32-8937-635341a95348 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:35:03.258480 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a5a35-34fa-420c-8171-ac9022ddb184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:35:03.259119 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a5a35-34fa-420c-8171-ac9022ddb184 admin admin] REQUEST_METHOD: `PUT` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:35:03.259404 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a5a35-34fa-420c-8171-ac9022ddb184 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:35:03.259679 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a5a35-34fa-420c-8171-ac9022ddb184 admin admin] PATH_INFO: `/v3/projects/5ac10aa8aff74eedb9f0b8262fffbecd/users/7caa7eb28ee44230950145f9594e965e/roles/b28fe6f1db4c4738862acb96ff94007c` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:35:03.274577 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a5a35-34fa-420c-8171-ac9022ddb184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ac10aa8aff74eedb9f0b8262fffbecd, user_id=7caa7eb28ee44230950145f9594e965e, role_id=b28fe6f1db4c4738862acb96ff94007c)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:35:03.277948 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a5a35-34fa-420c-8171-ac9022ddb184 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:35:03.345654 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1449/2903] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 23 04:35:03 2022] PUT /identity/v3/projects/5ac10aa8aff74eedb9f0b8262fffbecd/users/7caa7eb28ee44230950145f9594e965e/roles/b28fe6f1db4c4738862acb96ff94007c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:35:03.356767 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d53b2-224a-48c1-8e8e-3af9cae1cde1 None None] REQUEST_METHOD: `POST` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:35:03.357053 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d53b2-224a-48c1-8e8e-3af9cae1cde1 None None] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:35:03.357359 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d53b2-224a-48c1-8e8e-3af9cae1cde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:35:03.384090 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.auth.core [None req-285d53b2-224a-48c1-8e8e-3af9cae1cde1 None None] MFA Rules not processed for user `7caa7eb28ee44230950145f9594e965e`. Rule list: `[]` (Enabled: `True`). {{(pid=82354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:35:03.385344 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-285d53b2-224a-48c1-8e8e-3af9cae1cde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:35:03.449314 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1455/2904] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:35:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:35:03.459662 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a5a35-34fa-420c-8171-ac9022ddb184 admin admin] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:35:03.461466 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-371a5a35-34fa-420c-8171-ac9022ddb184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:35:03.489367 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:35:03.517893 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a5a35-34fa-420c-8171-ac9022ddb184 admin admin] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:35:03.521596 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3c327-22b8-4c65-9de6-625237228e48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b0ac2dd135450c9bfe918f98c19425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:35:03.522443 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3c327-22b8-4c65-9de6-625237228e48 service cinder] REQUEST_METHOD: `GET` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:35:03.522919 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3c327-22b8-4c65-9de6-625237228e48 service cinder] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:35:03.523559 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3c327-22b8-4c65-9de6-625237228e48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:35:03.532663 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3c327-22b8-4c65-9de6-625237228e48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:35:03.534215 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3c327-22b8-4c65-9de6-625237228e48 service cinder] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:35:03.542806 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1450/2905] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:35:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:35:13.445939 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=54,keystone:INSERT=3 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:35:13.579419 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=15 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:35:14.525896 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d53b2-224a-48c1-8e8e-3af9cae1cde1 None None] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:35:14.587886 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d53b2-224a-48c1-8e8e-3af9cae1cde1 None None] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:35:14.592344 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18371a94-dd28-4260-9871-76d38f8c9f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:35:14.592969 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18371a94-dd28-4260-9871-76d38f8c9f93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:35:14.593281 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18371a94-dd28-4260-9871-76d38f8c9f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:35:14.593557 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18371a94-dd28-4260-9871-76d38f8c9f93 admin admin] PATH_INFO: `/v3/users/7caa7eb28ee44230950145f9594e965e` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:35:14.594677 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18371a94-dd28-4260-9871-76d38f8c9f93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7caa7eb28ee44230950145f9594e965e)` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:35:14.596601 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18371a94-dd28-4260-9871-76d38f8c9f93 admin admin] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:35:14.772212 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-18371a94-dd28-4260-9871-76d38f8c9f93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7caa7eb28ee44230950145f9594e965e'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:35:14.847778 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-18371a94-dd28-4260-9871-76d38f8c9f93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7caa7eb28ee44230950145f9594e965e'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:35:14.855623 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-18371a94-dd28-4260-9871-76d38f8c9f93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7caa7eb28ee44230950145f9594e965e'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:35:14.867489 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-18371a94-dd28-4260-9871-76d38f8c9f93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7caa7eb28ee44230950145f9594e965e'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:35:14.868130 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.notifications [None req-18371a94-dd28-4260-9871-76d38f8c9f93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7caa7eb28ee44230950145f9594e965e'} {{(pid=82354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:35:14.874123 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1456/2906] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 23 04:35:14 2022] DELETE /identity/v3/users/7caa7eb28ee44230950145f9594e965e => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:35:14.878573 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ae58c-3d61-425a-b599-15773c84b3cb None None] REQUEST_METHOD: `POST` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:35:14.879094 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ae58c-3d61-425a-b599-15773c84b3cb None None] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:35:14.879206 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ae58c-3d61-425a-b599-15773c84b3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:35:14.897853 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.auth.core [None req-525ae58c-3d61-425a-b599-15773c84b3cb None None] MFA Rules not processed for user `54d7bb4b588246d59feaf1dfc8886cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 04:35:14.899032 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-525ae58c-3d61-425a-b599-15773c84b3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:35:14.957574 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1451/2907] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 23 04:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 04:35:14.968004 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18371a94-dd28-4260-9871-76d38f8c9f93 admin admin] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:35:14.969429 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-18371a94-dd28-4260-9871-76d38f8c9f93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:35:15.026033 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18371a94-dd28-4260-9871-76d38f8c9f93 admin admin] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:35:15.030051 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb6f61-6ad3-4e30-a80c-105ec6b5fa70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8304ca06f82742ef8ce74396884e90b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:35:15.030658 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb6f61-6ad3-4e30-a80c-105ec6b5fa70 service neutron] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:35:15.030943 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb6f61-6ad3-4e30-a80c-105ec6b5fa70 service neutron] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:35:15.031216 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb6f61-6ad3-4e30-a80c-105ec6b5fa70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:35:15.040111 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb6f61-6ad3-4e30-a80c-105ec6b5fa70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:35:15.041585 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb6f61-6ad3-4e30-a80c-105ec6b5fa70 service neutron] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:35:15.051747 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1457/2908] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:35:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:35:15.432457 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ae58c-3d61-425a-b599-15773c84b3cb None None] Authenticating user token {{(pid=82355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:35:15.434517 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.fernet_utils [None req-525ae58c-3d61-425a-b599-15773c84b3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:35:15.446346 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ae58c-3d61-425a-b599-15773c84b3cb None None] Validating token access rules against request {{(pid=82355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:35:15.451639 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215546e-3087-4a7e-870f-e0d7900569d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54d7bb4b588246d59feaf1dfc8886cde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb9c03cfd85c4ddcb76ee846b01a3645', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:35:15.453047 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215546e-3087-4a7e-870f-e0d7900569d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:35:15.453359 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215546e-3087-4a7e-870f-e0d7900569d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:35:15.453632 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215546e-3087-4a7e-870f-e0d7900569d3 admin admin] PATH_INFO: `/v3/projects/5ac10aa8aff74eedb9f0b8262fffbecd` {{(pid=82355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:35:15.455023 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215546e-3087-4a7e-870f-e0d7900569d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ac10aa8aff74eedb9f0b8262fffbecd)` {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:35:15.456984 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215546e-3087-4a7e-870f-e0d7900569d3 admin admin] RBAC: Authorization granted {{(pid=82355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:35:15.553063 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c215546e-3087-4a7e-870f-e0d7900569d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ac10aa8aff74eedb9f0b8262fffbecd', 'request_id': 'req-c215546e-3087-4a7e-870f-e0d7900569d3'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:35:15.560096 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c215546e-3087-4a7e-870f-e0d7900569d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ac10aa8aff74eedb9f0b8262fffbecd', 'request_id': 'req-c215546e-3087-4a7e-870f-e0d7900569d3'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:35:15.565762 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c215546e-3087-4a7e-870f-e0d7900569d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ac10aa8aff74eedb9f0b8262fffbecd', 'request_id': 'req-c215546e-3087-4a7e-870f-e0d7900569d3'} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:35:15.658256 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c215546e-3087-4a7e-870f-e0d7900569d3 admin admin] The token cache is being invalidate because project 5ac10aa8aff74eedb9f0b8262fffbecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 04:35:15.658547 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c215546e-3087-4a7e-870f-e0d7900569d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:35:15.659170 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG keystone.notifications [None req-c215546e-3087-4a7e-870f-e0d7900569d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 04:35:15.660650 dv-cinder-854070-1-smb devstack@keystone.service[82355]: [pid: 82355|app: 0|req: 1452/2909] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 23 04:35:15 2022] DELETE /identity/v3/projects/5ac10aa8aff74eedb9f0b8262fffbecd => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 04:35:25.047422 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:35:25.655152 dv-cinder-854070-1-smb devstack@keystone.service[82355]: DEBUG dbcounter [-] [82355] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 04:37:34.042966 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb6f61-6ad3-4e30-a80c-105ec6b5fa70 service neutron] Authenticating user token {{(pid=82354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 04:37:34.045023 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-dfdb6f61-6ad3-4e30-a80c-105ec6b5fa70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:37:34.113107 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb6f61-6ad3-4e30-a80c-105ec6b5fa70 service neutron] Validating token access rules against request {{(pid=82354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 04:37:34.171090 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f1b01-1e47-40e0-929b-2d95b8f2059e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34794124b7234aeb98a15f0c2ae06a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7ada12a1e3a42949c00f483efd522ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 04:37:34.171716 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f1b01-1e47-40e0-929b-2d95b8f2059e service placement] REQUEST_METHOD: `GET` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 04:37:34.171983 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f1b01-1e47-40e0-929b-2d95b8f2059e service placement] SCRIPT_NAME: `/identity` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 04:37:34.172260 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f1b01-1e47-40e0-929b-2d95b8f2059e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 04:37:34.173997 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.fernet_utils [None req-4e5f1b01-1e47-40e0-929b-2d95b8f2059e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 04:37:34.185162 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f1b01-1e47-40e0-929b-2d95b8f2059e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 04:37:34.186742 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f1b01-1e47-40e0-929b-2d95b8f2059e service placement] RBAC: Authorization granted {{(pid=82354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 04:37:34.196453 dv-cinder-854070-1-smb devstack@keystone.service[82354]: [pid: 82354|app: 0|req: 1458/2910] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 23 04:37:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 04:37:44.192307 dv-cinder-854070-1-smb devstack@keystone.service[82354]: DEBUG dbcounter [-] [82354] Writing DB stats keystone:SELECT=58 {{(pid=82354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}